-- Logs begin at Fri 2022-09-09 15:52:11 UTC, end at Fri 2022-09-09 16:48:45 UTC. -- Sep 09 16:16:53.225217 dv-cinder-831247-27-smb systemd[1]: Starting Devstack devstack@keystone.service... Sep 09 16:16:53.234761 dv-cinder-831247-27-smb devstack@keystone.service[81433]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 09 16:16:53.236822 dv-cinder-831247-27-smb devstack@keystone.service[81433]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Sep 9 16:16:53 2022] *** Sep 09 16:16:53.236822 dv-cinder-831247-27-smb devstack@keystone.service[81433]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 09 16:16:53.236822 dv-cinder-831247-27-smb devstack@keystone.service[81433]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 09 16:16:53.236822 dv-cinder-831247-27-smb devstack@keystone.service[81433]: nodename: dv-cinder-831247-27-smb Sep 09 16:16:53.236822 dv-cinder-831247-27-smb devstack@keystone.service[81433]: machine: x86_64 Sep 09 16:16:53.236822 dv-cinder-831247-27-smb devstack@keystone.service[81433]: clock source: unix Sep 09 16:16:53.236822 dv-cinder-831247-27-smb devstack@keystone.service[81433]: pcre jit disabled Sep 09 16:16:53.236822 dv-cinder-831247-27-smb devstack@keystone.service[81433]: detected number of CPU cores: 4 Sep 09 16:16:53.236822 dv-cinder-831247-27-smb devstack@keystone.service[81433]: current working directory: / Sep 09 16:16:53.236822 dv-cinder-831247-27-smb devstack@keystone.service[81433]: detected binary path: /usr/bin/uwsgi-core Sep 09 16:16:53.236822 dv-cinder-831247-27-smb devstack@keystone.service[81433]: your processes number limit is 47680 Sep 09 16:16:53.237391 dv-cinder-831247-27-smb devstack@keystone.service[81433]: your memory page size is 4096 bytes Sep 09 16:16:53.237391 dv-cinder-831247-27-smb devstack@keystone.service[81433]: detected max file descriptor number: 2048 Sep 09 16:16:53.237391 dv-cinder-831247-27-smb devstack@keystone.service[81433]: lock engine: pthread robust mutexes Sep 09 16:16:53.237391 dv-cinder-831247-27-smb devstack@keystone.service[81433]: thunder lock: enabled Sep 09 16:16:53.237391 dv-cinder-831247-27-smb devstack@keystone.service[81433]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 09 16:16:53.237391 dv-cinder-831247-27-smb devstack@keystone.service[81433]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 09 16:16:53.276409 dv-cinder-831247-27-smb devstack@keystone.service[81433]: Python main interpreter initialized at 0x55f37dc5e9c0 Sep 09 16:16:53.276409 dv-cinder-831247-27-smb devstack@keystone.service[81433]: python threads support enabled Sep 09 16:16:53.276409 dv-cinder-831247-27-smb devstack@keystone.service[81433]: your server socket listen backlog is limited to 100 connections Sep 09 16:16:53.276409 dv-cinder-831247-27-smb devstack@keystone.service[81433]: your mercy for graceful operations on workers is 90 seconds Sep 09 16:16:53.276746 dv-cinder-831247-27-smb devstack@keystone.service[81433]: mapped 403077 bytes (393 KB) for 2 cores Sep 09 16:16:53.276879 dv-cinder-831247-27-smb devstack@keystone.service[81433]: *** Operational MODE: preforking *** Sep 09 16:16:53.277114 dv-cinder-831247-27-smb devstack@keystone.service[81433]: *** uWSGI is running in multiple interpreter mode *** Sep 09 16:16:53.277114 dv-cinder-831247-27-smb devstack@keystone.service[81433]: spawned uWSGI master process (pid: 81433) Sep 09 16:16:53.277311 dv-cinder-831247-27-smb systemd[1]: Started Devstack devstack@keystone.service. Sep 09 16:16:53.277855 dv-cinder-831247-27-smb devstack@keystone.service[81433]: spawned uWSGI worker 1 (pid: 81445, cores: 1) Sep 09 16:16:53.278205 dv-cinder-831247-27-smb devstack@keystone.service[81433]: spawned uWSGI worker 2 (pid: 81446, cores: 1) Sep 09 16:16:53.278391 dv-cinder-831247-27-smb devstack@keystone.service[81433]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 09 16:16:57.564397 dv-cinder-831247-27-smb devstack@keystone.service[81445]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 09 16:16:57.564397 dv-cinder-831247-27-smb devstack@keystone.service[81445]: from cryptography.utils import int_from_bytes Sep 09 16:16:57.565139 dv-cinder-831247-27-smb devstack@keystone.service[81445]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 09 16:16:57.565139 dv-cinder-831247-27-smb devstack@keystone.service[81445]: from cryptography.utils import int_from_bytes Sep 09 16:16:57.566846 dv-cinder-831247-27-smb devstack@keystone.service[81446]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 09 16:16:57.566846 dv-cinder-831247-27-smb devstack@keystone.service[81446]: from cryptography.utils import int_from_bytes Sep 09 16:16:57.567302 dv-cinder-831247-27-smb devstack@keystone.service[81446]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 09 16:16:57.567302 dv-cinder-831247-27-smb devstack@keystone.service[81446]: from cryptography.utils import int_from_bytes Sep 09 16:16:57.617921 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 09 16:16:57.618098 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 09 16:16:57.618287 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] command line args: [] {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 09 16:16:57.618582 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 09 16:16:57.618760 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] ================================================================================ {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 09 16:16:57.619013 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] admin_token = **** {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:16:57.619261 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] config_dir = [] {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:16:57.619451 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:16:57.619633 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] config_source = [] {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:16:57.619812 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] debug = True {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:16:57.620009 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:16:57.620486 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:16:57.620572 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:16:57.620785 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:16:57.621033 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:16:57.621265 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] list_limit = None {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:16:57.621445 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] log_config_append = None {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:16:57.621623 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:16:57.621842 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] log_dir = None {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:16:57.621978 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] log_file = None {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:16:57.622213 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:16:57.622483 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:16:57.622732 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:16:57.622978 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:16:57.623155 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:16:57.623330 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:16:57.623575 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:16:57.623820 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:16:57.624056 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:16:57.624291 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:16:57.624524 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:16:57.624759 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:16:57.625003 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:16:57.625249 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:16:57.625525 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:16:57.626023 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.27/identity {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:16:57.626205 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] publish_errors = False {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:16:57.626463 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:16:57.626695 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:16:57.626872 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:16:57.627117 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:16:57.627352 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:16:57.627584 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] standard_threads = False {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:16:57.627815 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:16:57.628056 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:16:57.628231 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:16:57.628406 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] use_journal = False {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:16:57.628581 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] use_json = False {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:16:57.628756 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] use_stderr = False {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:16:57.628931 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] use_syslog = False {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:16:57.629160 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:16:57.629413 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.629650 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.629908 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.630146 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.630416 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.630507 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 09 16:16:57.630657 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.630742 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 09 16:16:57.630930 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.631007 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] command line args: [] {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 09 16:16:57.631168 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.631405 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 09 16:16:57.631498 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.631648 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.631734 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] ================================================================================ {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 09 16:16:57.631901 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.632019 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] admin_token = **** {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:16:57.632131 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.632376 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.632453 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] config_dir = [] {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:16:57.632610 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.632735 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:16:57.632855 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.632934 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] config_source = [] {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:16:57.633100 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.633227 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] debug = True {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:16:57.633336 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.633562 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:16:57.633668 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.633804 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:16:57.633898 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.633977 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:16:57.634055 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.634216 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:16:57.634294 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.634486 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:16:57.634574 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.634712 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] list_limit = None {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:16:57.634798 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.634876 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] log_config_append = None {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:16:57.635028 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.635105 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:16:57.635207 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] log_dir = None {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:16:57.635283 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.635422 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] log_file = None {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:16:57.635497 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.635643 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:16:57.635726 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.635894 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:16:57.635982 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.636138 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:16:57.636220 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.636378 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:16:57.636457 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.636552 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:16:57.636636 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.636709 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:16:57.636837 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.636951 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:16:57.637066 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.637193 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:16:57.637328 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.637502 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:16:57.637579 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.637767 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.637843 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:16:57.638015 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.638194 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:16:57.638272 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.638488 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.638565 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:16:57.638720 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.638933 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:16:57.639022 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.639167 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.639300 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:16:57.639397 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.639625 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.639700 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:16:57.639860 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.640106 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.640335 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.640411 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.27/identity {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:16:57.640572 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.640683 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] publish_errors = False {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:16:57.640800 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.641036 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:16:57.641120 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.641271 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.641385 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:16:57.641504 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.641647 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:16:57.641723 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.641957 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.642042 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:16:57.642193 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.642378 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:16:57.642460 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.642678 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.642804 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] standard_threads = False {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:16:57.642915 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.643062 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:16:57.643140 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.643379 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.643455 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:16:57.643613 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.643702 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:16:57.643848 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.643956 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] use_journal = False {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:16:57.644079 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.644245 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] use_json = False {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:16:57.644324 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.644533 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] use_stderr = False {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:16:57.644619 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.644778 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.644853 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] use_syslog = False {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:16:57.645014 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.645097 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 16:16:57.645248 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.645326 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.645513 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.645589 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.645747 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.645824 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.645999 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.646077 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.646242 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.646334 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.647025 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.647118 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.647268 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.647350 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.647485 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.647572 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.647732 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.647810 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.647973 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.648052 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.648211 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.648293 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.648447 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.648529 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.648684 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.648761 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.648914 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.648989 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.649158 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.649234 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.649394 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.649573 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.649650 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.649855 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.649932 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.650091 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.650339 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.650422 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.650730 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.650855 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.650960 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.651057 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.651161 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.651308 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.651412 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.651538 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.651767 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.651850 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.652001 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.652161 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.652239 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.652454 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.652571 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.652683 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.652900 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.652987 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.653134 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.653260 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.653403 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.653576 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.653657 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.653829 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.653911 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.654077 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.654261 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.654361 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.654578 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.654668 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.654839 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.655021 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.655099 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.655299 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] auth.external = None {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.655379 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.655529 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.655737 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.655814 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.656049 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.656127 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.656280 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] auth.password = None {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.656510 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] auth.token = None {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.656589 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.656748 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.656886 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.656984 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.657230 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.657315 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.657461 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.657567 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.657706 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.657887 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.657964 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.658132 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.658212 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.658386 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.658470 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] credential.caching = True {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.658617 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.658695 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.658847 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.658927 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.659074 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.659152 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.659309 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.659387 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.659553 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.659634 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.659780 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.659859 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.660011 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.660133 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.660221 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.660300 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.660456 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.660535 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.660688 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.660778 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.660932 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.661018 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.661159 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.661238 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.661392 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.661554 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.661637 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.661717 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.661844 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.661950 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.662159 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.662755 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] federation.caching = True {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.662901 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.662995 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.663116 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.663232 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.663363 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.663480 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.663597 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.663712 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.663830 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.663961 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.664059 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.664199 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.664313 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.664454 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.664534 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.664691 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.664769 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.664947 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.665025 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.665187 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.665275 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.665480 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.665570 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.665651 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] identity.caching = True {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.665725 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.665902 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.665980 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.666144 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.666281 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.666430 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.666517 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.666622 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.666711 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.666853 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.666933 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.667089 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.667166 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.667322 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.667400 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.667557 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.667638 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.667797 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.667875 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.668027 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.668104 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.668258 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.668338 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.668489 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.668568 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.668719 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.668798 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.668951 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.669032 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.669185 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.669263 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.669416 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.669510 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.669672 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.669754 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.669909 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.669989 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.670154 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.670234 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.670412 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.670493 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.670646 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.670725 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.670882 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.670965 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.671111 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.671190 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.671341 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.671419 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.671574 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.671654 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.671802 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.671889 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.672029 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.672107 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.672254 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.672341 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.672484 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.672563 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.672708 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.672792 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.672945 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.673078 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.673176 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.673256 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.673419 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.673508 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.673650 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.673737 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.673888 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.673966 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.674115 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.674193 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.674377 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.674475 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.674608 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] auth.external = None {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.674686 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.674837 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.674915 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.675071 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.675220 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.675345 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.675423 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.675573 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] auth.password = None {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.675652 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.675800 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] auth.token = None {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.675886 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.676033 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.676112 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.676263 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.676342 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.676510 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.676599 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.676737 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.676816 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.676978 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.677058 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.677221 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.677307 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.677448 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.677526 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.677710 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] credential.caching = True {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.677789 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] ldap.user = None {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.677956 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.678043 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.678202 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.678281 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.678461 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.678543 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.678710 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.678840 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.678941 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.679026 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.679170 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.679248 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.679411 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.679498 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.679640 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.679718 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.679876 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.679955 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.680112 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.680200 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.680352 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.680430 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.680581 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.680668 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.680827 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.680914 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.681072 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.681151 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.681318 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.681397 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.681548 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] federation.caching = True {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.681633 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.681783 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.681861 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.682012 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.682089 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.682255 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.682388 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.682508 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.682588 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.682742 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.682820 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.682974 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.683060 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.683208 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.683286 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.683445 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.683523 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.683690 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.683776 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.684187 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.684271 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.684432 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.684511 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.684661 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.684739 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] identity.caching = True {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.684902 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.684980 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.685136 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.685213 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.685367 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.685446 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.685597 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.685676 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.685841 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.685918 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.686067 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.686146 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.686312 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.686417 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.686555 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.686635 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.686796 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] resource.caching = True {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.686877 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.687033 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.687110 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.687259 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.687338 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.687487 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.687567 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.687725 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.687804 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.687967 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.688046 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.688199 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.688279 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.688446 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.688525 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.688684 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.688762 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.688922 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.689002 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.689157 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] role.caching = True {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.689235 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.689394 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.689471 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] role.driver = sql {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.689620 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.689699 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.689852 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.689929 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.690079 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.690157 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.690341 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.690425 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.690569 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.690648 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.690803 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.690880 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.691046 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.691127 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.691273 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.691352 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.691514 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.691592 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.691745 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.691823 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.691973 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.692051 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.692213 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.692291 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.692454 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.692535 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.692680 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.692759 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.692913 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.693075 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.693162 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.693337 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.693414 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.693587 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.693666 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.693835 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.693915 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.694066 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.694144 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.694319 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.694406 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.694556 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.694637 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.694798 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.694877 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.695026 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.695104 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.695252 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.695333 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.695492 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.695570 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.695723 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.695802 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.695953 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.696032 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.696185 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.696264 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.696445 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.696522 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.696694 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.696774 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] ldap.user = None {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.696932 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.697022 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.697169 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.697248 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.697400 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.697481 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.697635 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] token.caching = True {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.697720 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.697873 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.697952 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.698121 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.698203 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.698374 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.698458 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.698607 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.698690 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.698824 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.698905 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.699057 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.699135 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.699292 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.699371 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.699518 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.699598 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.699761 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.699857 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.700002 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.700080 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.700238 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.700319 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.700473 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.700551 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.700713 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.700790 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.700940 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.701021 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.701183 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.701262 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.701417 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.701505 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.701649 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.701735 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.701916 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.702003 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] database.connection = **** {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.702113 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.702192 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.702374 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.702467 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.702621 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.702700 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.702854 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.702934 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.703086 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.703172 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.703320 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.703401 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.703553 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.703631 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.703784 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.703870 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.704016 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.704094 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.704247 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.704325 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.704489 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.704575 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.704719 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.704797 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.704945 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.705023 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.705177 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.705263 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.705414 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] resource.caching = True {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.705493 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.705638 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.705716 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.705879 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.705966 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.706108 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.706186 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.706264 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 09 16:16:57.706378 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.706617 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.706849 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.707091 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.707326 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.707561 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.707792 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] role.caching = True {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.708034 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] role.driver = sql {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.708261 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.708505 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.708747 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.709513 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.709759 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.710003 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.710245 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.710514 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.710758 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.710987 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.711231 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.711474 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.711717 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.711957 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.712343 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.712575 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.712820 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.713067 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.713312 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.713557 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.713787 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.714036 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.714285 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.714549 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.714778 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.715005 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.715232 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.715481 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.715731 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.715977 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.716210 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.716443 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.716683 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.716920 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] token.caching = True {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.717154 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.717397 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.717630 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.717882 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.718126 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.718383 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.718625 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.718864 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.719107 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.719341 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.719573 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.719804 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.720046 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.720315 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.720541 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.720778 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.721039 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.721295 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] database.connection = **** {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.721533 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.721776 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.722010 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.722247 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.722504 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.722736 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.722970 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.723202 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.723442 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.723674 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.723915 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.724146 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.724388 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.725184 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.725429 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.725655 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.725891 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.726122 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 16:16:57.726289 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81445) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 09 16:16:57.736295 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81446) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 16:16:57.736537 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81446) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 16:16:57.736767 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81446) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 16:16:57.745087 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81446) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 16:16:57.750915 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81445) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 16:16:57.751149 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81445) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 16:16:57.751377 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81445) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 16:16:57.759596 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81445) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 16:16:57.773280 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81446) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 16:16:57.773513 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81446) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 16:16:57.777997 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81445) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 16:16:57.778228 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81445) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 16:16:57.828094 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81445) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 16:16:57.828466 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81446) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 16:16:57.876809 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81445) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 16:16:57.877041 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81445) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 16:16:57.877881 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81446) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 16:16:57.878119 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81446) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 16:16:58.034497 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81446) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 16:16:58.034718 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81446) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 16:16:58.034942 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81446) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 16:16:58.035161 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81446) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 16:16:58.035381 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81446) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 16:16:58.035599 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81446) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 16:16:58.039772 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81445) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 16:16:58.040006 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81445) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 16:16:58.040226 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81445) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 16:16:58.040443 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81445) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 16:16:58.040659 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81445) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 16:16:58.040873 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81445) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 16:16:58.058490 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81446) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 16:16:58.058631 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81445) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 16:16:58.058767 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81446) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 16:16:58.058868 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81445) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 16:16:58.059253 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81446) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 16:16:58.059337 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81445) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 16:16:58.059482 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81446) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 16:16:58.059565 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81445) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 16:16:58.059704 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81446) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 16:16:58.059789 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81445) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 16:16:58.059920 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81446) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 16:16:58.060003 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81445) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 16:16:58.060145 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81445) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 16:16:58.060281 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81446) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 16:16:58.071868 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81446) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 16:16:58.071975 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81445) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 16:16:58.084997 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81445) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 16:16:58.085178 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81445) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 16:16:58.085401 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81445) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 16:16:58.085496 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81446) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 16:16:58.085617 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81445) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 16:16:58.085700 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81446) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 16:16:58.085829 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81445) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 16:16:58.085911 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81446) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 16:16:58.086040 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81445) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 16:16:58.086123 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81446) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 16:16:58.086250 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81445) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 16:16:58.086349 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81446) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 16:16:58.086494 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81446) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 16:16:58.086711 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81446) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 16:16:58.102680 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81445) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 16:16:58.102887 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81445) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 09 16:16:58.103227 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81445) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 16:16:58.103390 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81446) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 16:16:58.103472 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81445) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 09 16:16:58.103603 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81446) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 09 16:16:58.103685 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81445) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 16:16:58.103927 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81445) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 16:16:58.104008 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81446) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 16:16:58.104133 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81446) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 09 16:16:58.104225 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81445) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 16:16:58.104408 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81446) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 16:16:58.104489 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81445) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 16:16:58.104670 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81446) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 16:16:58.104932 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81446) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 16:16:58.105192 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81446) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 16:16:58.113893 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81445) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 16:16:58.114169 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81445) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 16:16:58.114459 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81445) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 16:16:58.114740 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81445) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 16:16:58.114819 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81446) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 16:16:58.115095 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81446) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 16:16:58.115392 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81446) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 16:16:58.115674 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81446) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 16:16:58.121632 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81445) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 16:16:58.122647 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81446) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 16:16:58.124512 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81445) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 16:16:58.124797 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81445) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 16:16:58.125078 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81445) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 16:16:58.125357 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81445) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 16:16:58.125528 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81446) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 16:16:58.125637 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81445) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 16:16:58.125817 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81446) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 16:16:58.125899 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81445) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 16:16:58.126105 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81446) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 16:16:58.126184 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81445) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 16:16:58.126417 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81446) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 16:16:58.126512 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81445) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 16:16:58.126684 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81445) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 16:16:58.127021 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81446) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 16:16:58.127102 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81445) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 16:16:58.127175 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81446) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 16:16:58.127254 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81445) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 16:16:58.127318 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81446) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 16:16:58.127475 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81446) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 16:16:58.127748 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81446) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 16:16:58.128022 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81446) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 16:16:58.128290 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81446) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 16:16:58.150628 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81445) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 16:16:58.151895 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81446) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 16:16:58.152079 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81445) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 16:16:58.152360 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81445) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 16:16:58.153366 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81446) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 16:16:58.153654 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81446) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 16:16:58.156973 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81445) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 16:16:58.157258 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81445) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 16:16:58.157538 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81445) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 16:16:58.158321 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81446) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 16:16:58.158613 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81446) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 16:16:58.158897 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81446) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 16:16:58.163868 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81445) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 16:16:58.164156 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81445) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 16:16:58.165238 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81446) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 16:16:58.165532 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81446) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 16:16:58.169661 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81445) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 16:16:58.169950 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81445) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 16:16:58.170233 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81445) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 16:16:58.170539 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81445) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 16:16:58.170818 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81445) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 16:16:58.171091 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81445) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 16:16:58.171172 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81446) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 16:16:58.171358 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81445) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 16:16:58.171439 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81446) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 16:16:58.171622 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81445) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 16:16:58.171711 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81446) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 16:16:58.171977 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81446) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 16:16:58.172259 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81446) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 16:16:58.172537 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81446) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 16:16:58.172808 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81446) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 16:16:58.173080 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81446) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 16:16:58.187196 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81445) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 16:16:58.187472 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81445) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 16:16:58.188810 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81446) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 16:16:58.189093 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81446) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 16:16:58.191317 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81445) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 16:16:58.192948 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81446) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 16:16:58.195071 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81445) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 16:16:58.195368 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81445) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 16:16:58.196734 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81446) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 16:16:58.197034 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81446) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 16:16:58.199548 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81445) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 16:16:58.201254 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81446) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 16:16:58.202664 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81445) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 16:16:58.204411 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81446) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 16:16:58.206271 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81445) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 16:16:58.206595 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81445) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 16:16:58.206878 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81445) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 16:16:58.207160 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81445) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 16:16:58.207444 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81445) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 16:16:58.207651 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81446) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 16:16:58.207740 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81445) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 16:16:58.207954 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81446) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 16:16:58.208243 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81446) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 16:16:58.208538 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81446) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 16:16:58.208821 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81446) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 16:16:58.209674 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81446) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 16:16:58.223838 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81445) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 16:16:58.224123 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81445) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 16:16:58.224392 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81445) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 16:16:58.224682 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81445) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 16:16:58.225420 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81446) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 16:16:58.225710 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81446) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 16:16:58.225982 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81446) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 16:16:58.226247 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81446) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 16:16:58.231490 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81445) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 16:16:58.233029 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81445) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 16:16:58.233149 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81446) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 16:16:58.234561 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81445) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 16:16:58.234648 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81446) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 16:16:58.234848 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81445) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 16:16:58.236155 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81446) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 16:16:58.236435 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81446) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 16:16:58.237547 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81445) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 16:16:58.237829 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81445) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 16:16:58.238108 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81445) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 16:16:58.238412 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81445) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 16:16:58.238808 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81445) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 16:16:58.239149 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81446) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 16:16:58.239436 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81446) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 16:16:58.239733 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81446) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 16:16:58.240019 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81446) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 16:16:58.240442 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81446) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 16:16:58.249829 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81445) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 16:16:58.250112 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81445) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 16:16:58.250412 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81445) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 16:16:58.250692 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81445) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 16:16:58.251066 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81445) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 16:16:58.251342 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81445) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 16:16:58.251563 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81446) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 16:16:58.251645 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81445) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 16:16:58.251851 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81446) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 16:16:58.252134 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81446) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 16:16:58.252418 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81446) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 16:16:58.252797 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81446) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 16:16:58.253084 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81446) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 16:16:58.253365 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81446) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 16:16:58.267344 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81445) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 16:16:58.269208 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81446) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 16:16:58.270230 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81445) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 16:16:58.272760 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81446) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 16:16:58.273646 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81445) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 16:16:58.275111 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81445) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 16:16:58.275678 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81446) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 16:16:58.276894 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81445) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 16:16:58.276894 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81445) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 16:16:58.277172 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81446) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 16:16:58.277281 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81445) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 16:16:58.278668 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81446) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 16:16:58.278954 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81446) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 16:16:58.279360 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81446) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 16:16:58.283565 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81445) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 16:16:58.285022 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81445) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 16:16:58.285711 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81446) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 16:16:58.287230 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81446) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 16:16:58.287952 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81445) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 16:16:58.288347 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81445) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 16:16:58.288630 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81445) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 16:16:58.288902 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81445) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 16:16:58.290144 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81446) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 16:16:58.290570 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81446) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 16:16:58.290858 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81446) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 16:16:58.291135 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81446) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 16:16:58.296607 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81445) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 16:16:58.296907 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81445) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 16:16:58.297187 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81445) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 16:16:58.298907 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81446) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 16:16:58.299211 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81446) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 16:16:58.299497 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81446) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 16:16:58.304025 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81445) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 16:16:58.304310 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81445) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 16:16:58.304590 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81445) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 16:16:58.304864 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81445) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 16:16:58.305148 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81445) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 16:16:58.305416 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81445) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 16:16:58.305685 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81445) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 16:16:58.305967 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81445) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 16:16:58.306233 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81445) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 16:16:58.306387 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81446) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 16:16:58.306530 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81445) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 16:16:58.306677 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81446) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 16:16:58.306808 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81445) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 16:16:58.306960 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81446) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 16:16:58.307077 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81445) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 16:16:58.307237 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81446) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 16:16:58.307339 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81445) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 16:16:58.307522 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81446) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 16:16:58.307602 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81445) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 16:16:58.307795 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81446) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 16:16:58.308070 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81446) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 16:16:58.308353 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81446) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 16:16:58.308622 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81446) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 16:16:58.309145 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81446) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 16:16:58.309433 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81446) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 16:16:58.309744 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81446) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 16:16:58.310052 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81446) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 16:16:58.310348 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81446) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 16:16:58.342423 dv-cinder-831247-27-smb devstack@keystone.service[81445]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55f37dc5e9c0 pid: 81445 (default app) Sep 09 16:16:58.344992 dv-cinder-831247-27-smb devstack@keystone.service[81446]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55f37dc5e9c0 pid: 81446 (default app) Sep 09 16:16:58.345602 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b38b355-c345-49e0-9772-57c48f80f653 None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:16:58.345886 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b38b355-c345-49e0-9772-57c48f80f653 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:16:58.346153 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b38b355-c345-49e0-9772-57c48f80f653 None None] PATH_INFO: `/v3` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:16:58.350333 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1/1] 10.222.0.27 () {50 vars in 791 bytes} [Fri Sep 9 16:16:58 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:17:05.056396 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70111f1e-336b-4ce9-8269-9506384fd425 None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:05.056927 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70111f1e-336b-4ce9-8269-9506384fd425 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:05.056927 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70111f1e-336b-4ce9-8269-9506384fd425 None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:05.061508 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1/2] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:17:05 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:17:05.066741 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aca6e6-48f7-43b4-96e8-fa3786d2d1b0 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:05.067216 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aca6e6-48f7-43b4-96e8-fa3786d2d1b0 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:05.067307 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aca6e6-48f7-43b4-96e8-fa3786d2d1b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:05.138776 dv-cinder-831247-27-smb devstack@keystone.service[81445]: INFO dbcounter [None req-c5aca6e6-48f7-43b4-96e8-fa3786d2d1b0 None None] Registered counter for database keystone Sep 09 16:17:05.157961 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG oslo_db.sqlalchemy.engines [None req-c5aca6e6-48f7-43b4-96e8-fa3786d2d1b0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81445) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 16:17:05.164839 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writer thread running {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 16:17:05.342195 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG passlib.handlers.bcrypt [None req-c5aca6e6-48f7-43b4-96e8-fa3786d2d1b0 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81445) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 09 16:17:05.342534 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG passlib.handlers.bcrypt [None req-c5aca6e6-48f7-43b4-96e8-fa3786d2d1b0 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81445) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 09 16:17:05.399915 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-c5aca6e6-48f7-43b4-96e8-fa3786d2d1b0 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:17:05.401479 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-c5aca6e6-48f7-43b4-96e8-fa3786d2d1b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:17:05.526504 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 2/3] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:17:05 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 461 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 09 16:17:06.011928 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70111f1e-336b-4ce9-8269-9506384fd425 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:06.082015 dv-cinder-831247-27-smb devstack@keystone.service[81446]: INFO dbcounter [None req-70111f1e-336b-4ce9-8269-9506384fd425 None None] Registered counter for database keystone Sep 09 16:17:06.102919 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG oslo_db.sqlalchemy.engines [None req-70111f1e-336b-4ce9-8269-9506384fd425 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81446) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 16:17:06.109037 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writer thread running {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 16:17:06.228012 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70111f1e-336b-4ce9-8269-9506384fd425 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:06.232338 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa452ba-02f0-4914-a937-ae4b8f6e4775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:06.232967 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa452ba-02f0-4914-a937-ae4b8f6e4775 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:06.233250 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa452ba-02f0-4914-a937-ae4b8f6e4775 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:06.233522 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa452ba-02f0-4914-a937-ae4b8f6e4775 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:06.242441 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa452ba-02f0-4914-a937-ae4b8f6e4775 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:06.295347 dv-cinder-831247-27-smb devstack@keystone.service[81446]: WARNING keystone.common.rbac_enforcer.enforcer [None req-4aa452ba-02f0-4914-a937-ae4b8f6e4775 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 09 16:17:06.295699 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa452ba-02f0-4914-a937-ae4b8f6e4775 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:06.306157 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 2/4] 10.222.0.27 () {58 vars in 1324 bytes} [Fri Sep 9 16:17:06 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 09 16:17:06.312283 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5aca6e6-48f7-43b4-96e8-fa3786d2d1b0 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:06.328554 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5aca6e6-48f7-43b4-96e8-fa3786d2d1b0 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:06.332830 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a41d3fa-67a7-45cb-9aac-4c84a530fb9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:06.333922 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a41d3fa-67a7-45cb-9aac-4c84a530fb9a admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:06.334199 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a41d3fa-67a7-45cb-9aac-4c84a530fb9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:06.334494 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a41d3fa-67a7-45cb-9aac-4c84a530fb9a admin admin] PATH_INFO: `/v3/projects/5e37a1d93b9b4afb9e8aecb24b733b95` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:06.336064 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a41d3fa-67a7-45cb-9aac-4c84a530fb9a admin admin] RBAC: Authorizing `identity:get_project(project_id=5e37a1d93b9b4afb9e8aecb24b733b95)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:06.388175 dv-cinder-831247-27-smb devstack@keystone.service[81445]: WARNING keystone.common.rbac_enforcer.enforcer [None req-1a41d3fa-67a7-45cb-9aac-4c84a530fb9a admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 09 16:17:06.388510 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a41d3fa-67a7-45cb-9aac-4c84a530fb9a admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:06.392930 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 3/5] 10.222.0.27 () {56 vars in 1207 bytes} [Fri Sep 9 16:17:06 2022] GET /identity/v3/projects/5e37a1d93b9b4afb9e8aecb24b733b95 => generated 344 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:17:08.489943 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7572965e-19b7-46bf-a64b-c74ddff60baa None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:08.490490 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7572965e-19b7-46bf-a64b-c74ddff60baa None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:08.490490 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7572965e-19b7-46bf-a64b-c74ddff60baa None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:08.494890 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 3/6] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:17:08 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:17:08.501530 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff73c428-d467-4f85-b868-994c7ed9e724 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:08.501928 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff73c428-d467-4f85-b868-994c7ed9e724 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:08.502081 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff73c428-d467-4f85-b868-994c7ed9e724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:08.523276 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-ff73c428-d467-4f85-b868-994c7ed9e724 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:17:08.524815 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-ff73c428-d467-4f85-b868-994c7ed9e724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:17:08.532506 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 4/7] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:17:08 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 09 16:17:08.797837 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7572965e-19b7-46bf-a64b-c74ddff60baa None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:08.810135 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7572965e-19b7-46bf-a64b-c74ddff60baa None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:08.814288 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424e5819-6ec1-4098-a6b9-f07bc936bd3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:08.814902 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424e5819-6ec1-4098-a6b9-f07bc936bd3b admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:08.815182 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424e5819-6ec1-4098-a6b9-f07bc936bd3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:08.815454 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424e5819-6ec1-4098-a6b9-f07bc936bd3b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:08.823498 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424e5819-6ec1-4098-a6b9-f07bc936bd3b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:08.825272 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424e5819-6ec1-4098-a6b9-f07bc936bd3b admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:08.834573 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 4/8] 10.222.0.27 () {58 vars in 1324 bytes} [Fri Sep 9 16:17:08 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 09 16:17:08.839646 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff73c428-d467-4f85-b868-994c7ed9e724 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:08.848710 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff73c428-d467-4f85-b868-994c7ed9e724 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:08.853064 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c7857c-f180-42bd-ae56-ef1080c5487f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:08.853681 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c7857c-f180-42bd-ae56-ef1080c5487f admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:08.853961 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c7857c-f180-42bd-ae56-ef1080c5487f admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:08.854234 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c7857c-f180-42bd-ae56-ef1080c5487f admin admin] PATH_INFO: `/v3/users/1a543813ca244c90b6fbbe30c16ad55b` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:08.855568 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c7857c-f180-42bd-ae56-ef1080c5487f admin admin] RBAC: Authorizing `identity:get_user(user_id=1a543813ca244c90b6fbbe30c16ad55b)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:08.857389 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c7857c-f180-42bd-ae56-ef1080c5487f admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:08.858943 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 5/9] 10.222.0.27 () {56 vars in 1198 bytes} [Fri Sep 9 16:17:08 2022] GET /identity/v3/users/1a543813ca244c90b6fbbe30c16ad55b => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:17:11.073182 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc97a734-b968-4e38-8d30-c72f0029cd47 None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:11.073740 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc97a734-b968-4e38-8d30-c72f0029cd47 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:11.073740 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc97a734-b968-4e38-8d30-c72f0029cd47 None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:11.076284 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 5/10] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:17:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:17:11.080609 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cefa95b-3c56-444a-896f-8f5dd23e3c8f None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:11.081014 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cefa95b-3c56-444a-896f-8f5dd23e3c8f None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:11.081226 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cefa95b-3c56-444a-896f-8f5dd23e3c8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:11.099516 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-4cefa95b-3c56-444a-896f-8f5dd23e3c8f None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:17:11.100786 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-4cefa95b-3c56-444a-896f-8f5dd23e3c8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:17:11.101747 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca64210-9c97-4771-b06c-41742a07de0a None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:11.102036 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca64210-9c97-4771-b06c-41742a07de0a None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:11.102332 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca64210-9c97-4771-b06c-41742a07de0a None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:11.103653 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 6/11] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:17:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 16:17:11.108816 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c4bbcb-6e9b-48f4-a245-530cfc18dd37 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:11.109103 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c4bbcb-6e9b-48f4-a245-530cfc18dd37 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:11.109379 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c4bbcb-6e9b-48f4-a245-530cfc18dd37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:11.151479 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG passlib.handlers.bcrypt [None req-09c4bbcb-6e9b-48f4-a245-530cfc18dd37 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81446) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 09 16:17:11.151879 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG passlib.handlers.bcrypt [None req-09c4bbcb-6e9b-48f4-a245-530cfc18dd37 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81446) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 09 16:17:11.183710 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 6/12] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:17:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 16:17:11.200747 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-09c4bbcb-6e9b-48f4-a245-530cfc18dd37 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:17:11.202358 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-09c4bbcb-6e9b-48f4-a245-530cfc18dd37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:17:11.302498 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 7/13] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:17:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 16:17:11.457093 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cefa95b-3c56-444a-896f-8f5dd23e3c8f None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:11.483350 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:17:11.560316 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cefa95b-3c56-444a-896f-8f5dd23e3c8f None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:11.566562 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c4bbcb-6e9b-48f4-a245-530cfc18dd37 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:11.593933 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e068b29-322b-44cb-a1d4-c2f77ce3f748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:11.594587 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e068b29-322b-44cb-a1d4-c2f77ce3f748 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:11.594864 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e068b29-322b-44cb-a1d4-c2f77ce3f748 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:11.595135 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e068b29-322b-44cb-a1d4-c2f77ce3f748 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:11.606539 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e068b29-322b-44cb-a1d4-c2f77ce3f748 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 16:17:11.615221 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-4e068b29-322b-44cb-a1d4-c2f77ce3f748 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 16:17:11.615221 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:17:11.615221 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:17:11.615221 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:17:11.615221 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:17:11.615221 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:17:11.615221 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:17:11.615221 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:17:11.615221 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:17:11.615221 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:17:11.615221 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:17:11.615221 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:17:11.615221 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 16:17:11.615221 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 16:17:11.615221 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 16:17:11.615221 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 16:17:11.616397 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 16:17:11.616397 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 16:17:11.616397 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 16:17:11.616397 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 16:17:11.616397 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:17:11.616397 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:17:11.616397 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:17:11.616397 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:17:11.616397 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:17:11.616397 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:17:11.616397 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:17:11.616397 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 16:17:11.616397 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:17:11.616397 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:17:11.616397 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:17:11.616397 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:17:11.617602 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:17:11.617602 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:17:11.617602 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:17:11.617602 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:17:11.617602 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 16:17:11.617602 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 16:17:11.617602 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 16:17:11.617602 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 16:17:11.617602 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 16:17:11.617602 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 16:17:11.617602 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 16:17:11.617602 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 16:17:11.617602 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 7/14] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Sep 9 16:17:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:17:11.622052 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e068b29-322b-44cb-a1d4-c2f77ce3f748 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:11.666884 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c4bbcb-6e9b-48f4-a245-530cfc18dd37 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:11.669141 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:17:11.702566 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:17:11.704861 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b14dcfd-4973-4991-946c-0ebe266097e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:11.705791 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b14dcfd-4973-4991-946c-0ebe266097e2 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:11.706167 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b14dcfd-4973-4991-946c-0ebe266097e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:11.706479 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b14dcfd-4973-4991-946c-0ebe266097e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:11.721962 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e068b29-322b-44cb-a1d4-c2f77ce3f748 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:11.754819 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3be9e9-574c-41b3-8d93-634c46102d72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:11.755908 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3be9e9-574c-41b3-8d93-634c46102d72 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:11.756184 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3be9e9-574c-41b3-8d93-634c46102d72 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:11.756456 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3be9e9-574c-41b3-8d93-634c46102d72 None admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:11.757119 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3be9e9-574c-41b3-8d93-634c46102d72 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:17:11.757419 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3be9e9-574c-41b3-8d93-634c46102d72 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:11.758839 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3be9e9-574c-41b3-8d93-634c46102d72 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:11.770225 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 8/15] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Sep 9 16:17:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 16:17:11.776337 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3be9e9-574c-41b3-8d93-634c46102d72 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:11.778445 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b14dcfd-4973-4991-946c-0ebe266097e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:11.779973 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b14dcfd-4973-4991-946c-0ebe266097e2 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:11.875575 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3be9e9-574c-41b3-8d93-634c46102d72 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:11.877516 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 8/16] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Sep 9 16:17:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 16:17:11.883118 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b14dcfd-4973-4991-946c-0ebe266097e2 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:11.885854 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:17:11.909123 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6541cc2-f267-4d78-99a0-10372d0dbdc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:11.909750 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6541cc2-f267-4d78-99a0-10372d0dbdc1 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:11.910024 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6541cc2-f267-4d78-99a0-10372d0dbdc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:11.910296 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6541cc2-f267-4d78-99a0-10372d0dbdc1 None admin] PATH_INFO: `/v3/users/1a543813ca244c90b6fbbe30c16ad55b` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:11.911492 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6541cc2-f267-4d78-99a0-10372d0dbdc1 None admin] RBAC: Authorizing `identity:get_user(user_id=1a543813ca244c90b6fbbe30c16ad55b)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:11.913443 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6541cc2-f267-4d78-99a0-10372d0dbdc1 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:11.915015 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 9/17] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Sep 9 16:17:11 2022] GET /identity/v3/users/1a543813ca244c90b6fbbe30c16ad55b => generated 247 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 16:17:11.920267 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6541cc2-f267-4d78-99a0-10372d0dbdc1 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:11.937994 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:17:11.982993 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b14dcfd-4973-4991-946c-0ebe266097e2 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:12.015122 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ad9ee7-6480-4908-a81a-7421e47838a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:12.015963 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ad9ee7-6480-4908-a81a-7421e47838a5 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:12.016240 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ad9ee7-6480-4908-a81a-7421e47838a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:12.016508 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ad9ee7-6480-4908-a81a-7421e47838a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:12.021885 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6541cc2-f267-4d78-99a0-10372d0dbdc1 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:12.034625 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ad9ee7-6480-4908-a81a-7421e47838a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:12.036095 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ad9ee7-6480-4908-a81a-7421e47838a5 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:12.054452 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276e5cd1-9413-4d68-a70f-d63d1b843307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:12.054623 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-23ad9ee7-6480-4908-a81a-7421e47838a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 16:17:12.054623 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:17:12.054623 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:17:12.054623 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:17:12.054623 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:17:12.054623 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:17:12.054623 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:17:12.054623 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:17:12.054623 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:17:12.054623 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:17:12.054623 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:17:12.054623 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:17:12.054623 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 16:17:12.054623 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 16:17:12.054623 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 16:17:12.054623 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 16:17:12.055651 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:17:12.055651 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:17:12.055651 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:17:12.055651 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:17:12.055651 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:17:12.055651 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:17:12.055651 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:17:12.055651 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Sep 09 16:17:12.055651 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:17:12.055651 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:17:12.055651 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:17:12.055651 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:17:12.055651 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:17:12.055651 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:17:12.055651 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:17:12.055651 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:17:12.055651 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 16:17:12.056660 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 16:17:12.056660 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 16:17:12.056660 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:17:12.056860 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276e5cd1-9413-4d68-a70f-d63d1b843307 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:12.056860 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276e5cd1-9413-4d68-a70f-d63d1b843307 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:12.056860 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276e5cd1-9413-4d68-a70f-d63d1b843307 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:12.057072 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 9/18] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 16:17:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 16:17:12.057155 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276e5cd1-9413-4d68-a70f-d63d1b843307 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:12.058171 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276e5cd1-9413-4d68-a70f-d63d1b843307 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:12.060139 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 10/19] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 16:17:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 16:17:12.063363 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ad9ee7-6480-4908-a81a-7421e47838a5 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:12.066679 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276e5cd1-9413-4d68-a70f-d63d1b843307 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:12.124378 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:17:12.148385 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:17:12.167842 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276e5cd1-9413-4d68-a70f-d63d1b843307 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:12.170605 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ad9ee7-6480-4908-a81a-7421e47838a5 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:12.201242 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eeb0ce-dbf9-448e-8c33-77972c0bc78a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:12.201850 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eeb0ce-dbf9-448e-8c33-77972c0bc78a None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:12.202129 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eeb0ce-dbf9-448e-8c33-77972c0bc78a None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:12.202429 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eeb0ce-dbf9-448e-8c33-77972c0bc78a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:12.203139 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1eeb0ce-dbf9-448e-8c33-77972c0bc78a None admin] RBAC: Adding query filter params (role.id=0a36d1be416f4089be19be979943b731, scope.domain.id=default, user.id=1a543813ca244c90b6fbbe30c16ad55b) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:17:12.203444 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1eeb0ce-dbf9-448e-8c33-77972c0bc78a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:12.203531 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53ac15f-e2a0-4154-8406-9c6e1a70b3d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:12.204127 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53ac15f-e2a0-4154-8406-9c6e1a70b3d9 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:12.204406 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53ac15f-e2a0-4154-8406-9c6e1a70b3d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:12.204675 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53ac15f-e2a0-4154-8406-9c6e1a70b3d9 None admin] PATH_INFO: `/v3/domains` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:12.204878 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1eeb0ce-dbf9-448e-8c33-77972c0bc78a None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:12.205303 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53ac15f-e2a0-4154-8406-9c6e1a70b3d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:17:12.205604 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53ac15f-e2a0-4154-8406-9c6e1a70b3d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:12.207007 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53ac15f-e2a0-4154-8406-9c6e1a70b3d9 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:12.211895 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 11/20] 10.222.0.27 () {56 vars in 1322 bytes} [Fri Sep 9 16:17:12 2022] GET /identity/v3/role_assignments?user.id=1a543813ca244c90b6fbbe30c16ad55b&scope.domain.id=default&role.id=0a36d1be416f4089be19be979943b731 => generated 233 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:17:12.226148 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 10/21] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Sep 9 16:17:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:17:14.629590 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef14bea6-9c02-4892-8d41-1e43cf73abce None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:14.630125 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef14bea6-9c02-4892-8d41-1e43cf73abce None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:14.630125 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef14bea6-9c02-4892-8d41-1e43cf73abce None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:14.631474 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 12/22] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:17:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:17:14.638893 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327a238c-f70a-49c2-864d-eb5025340de6 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:14.639402 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327a238c-f70a-49c2-864d-eb5025340de6 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:14.639482 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327a238c-f70a-49c2-864d-eb5025340de6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:14.667330 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-327a238c-f70a-49c2-864d-eb5025340de6 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:17:14.668546 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-327a238c-f70a-49c2-864d-eb5025340de6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:17:14.727104 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e99339-7639-4132-83c1-922803540678 None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:14.727432 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e99339-7639-4132-83c1-922803540678 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:14.727647 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e99339-7639-4132-83c1-922803540678 None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:14.729314 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 13/23] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:17:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:17:14.735294 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7925f5-6cd3-4e51-ba70-9ca37590271d None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:14.735623 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7925f5-6cd3-4e51-ba70-9ca37590271d None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:14.735842 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7925f5-6cd3-4e51-ba70-9ca37590271d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:14.766159 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-6f7925f5-6cd3-4e51-ba70-9ca37590271d None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:17:14.769231 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-6f7925f5-6cd3-4e51-ba70-9ca37590271d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:17:14.783393 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 11/24] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:17:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 16:17:14.862672 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 14/25] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:17:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Sep 09 16:17:15.119106 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327a238c-f70a-49c2-864d-eb5025340de6 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:15.175052 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:17:15.240829 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327a238c-f70a-49c2-864d-eb5025340de6 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:15.281593 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08a701b-c971-478a-b318-3f7f977e910f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:15.282247 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08a701b-c971-478a-b318-3f7f977e910f None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:15.282550 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08a701b-c971-478a-b318-3f7f977e910f None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:15.282821 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08a701b-c971-478a-b318-3f7f977e910f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:15.304486 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08a701b-c971-478a-b318-3f7f977e910f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 16:17:15.311699 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-d08a701b-c971-478a-b318-3f7f977e910f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 16:17:15.311699 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:17:15.311699 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:17:15.311699 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:17:15.311699 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:17:15.311699 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:17:15.311699 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:17:15.311699 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:17:15.311699 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:17:15.311699 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:17:15.311699 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:17:15.311699 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:17:15.311699 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 16:17:15.311699 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 16:17:15.311699 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 16:17:15.311699 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 16:17:15.312604 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 16:17:15.312604 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 16:17:15.312604 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 16:17:15.312604 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 16:17:15.312604 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:17:15.312604 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:17:15.312604 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:17:15.312604 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:17:15.312604 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:17:15.312604 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:17:15.312604 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:17:15.312604 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Sep 09 16:17:15.312604 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:17:15.312604 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:17:15.312604 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:17:15.312604 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:17:15.313372 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:17:15.313372 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:17:15.313372 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:17:15.313372 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:17:15.313372 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 16:17:15.313372 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 16:17:15.313372 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 16:17:15.313372 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 16:17:15.313372 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 16:17:15.313372 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 16:17:15.313372 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 16:17:15.313372 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:17:15.313372 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 12/26] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Sep 9 16:17:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:17:15.320812 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7925f5-6cd3-4e51-ba70-9ca37590271d None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:15.416022 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995d6c1a-2792-42d8-981b-ec2dc4285e22 None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:15.416619 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995d6c1a-2792-42d8-981b-ec2dc4285e22 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:15.417123 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995d6c1a-2792-42d8-981b-ec2dc4285e22 None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:15.418913 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 13/27] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:17:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:17:15.419983 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995d6c1a-2792-42d8-981b-ec2dc4285e22 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:15.428790 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:17:15.457729 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7925f5-6cd3-4e51-ba70-9ca37590271d None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:15.494676 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f30f136-413e-462d-a2ab-e8ef233d3a08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:15.495279 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f30f136-413e-462d-a2ab-e8ef233d3a08 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:15.495708 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f30f136-413e-462d-a2ab-e8ef233d3a08 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:15.496135 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f30f136-413e-462d-a2ab-e8ef233d3a08 None admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:15.496943 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f30f136-413e-462d-a2ab-e8ef233d3a08 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:17:15.497412 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f30f136-413e-462d-a2ab-e8ef233d3a08 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:15.498984 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f30f136-413e-462d-a2ab-e8ef233d3a08 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:15.508179 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 15/28] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Sep 9 16:17:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:17:15.509587 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee6dc04-7536-4c1e-9f18-5cc0c35df78a None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:15.510056 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee6dc04-7536-4c1e-9f18-5cc0c35df78a None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:15.510491 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee6dc04-7536-4c1e-9f18-5cc0c35df78a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:15.528773 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-4ee6dc04-7536-4c1e-9f18-5cc0c35df78a None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:17:15.530185 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-4ee6dc04-7536-4c1e-9f18-5cc0c35df78a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:17:15.553121 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995d6c1a-2792-42d8-981b-ec2dc4285e22 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:15.562674 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:17:15.593475 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b02873-c8bc-4226-a8c6-d241d1b3dc60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:15.594244 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b02873-c8bc-4226-a8c6-d241d1b3dc60 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:15.594660 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b02873-c8bc-4226-a8c6-d241d1b3dc60 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:15.595038 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b02873-c8bc-4226-a8c6-d241d1b3dc60 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:15.604327 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 16/29] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:17:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 16:17:15.605937 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f40ba82-f27d-4c55-84e5-63119196cac9 None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:15.606424 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f40ba82-f27d-4c55-84e5-63119196cac9 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:15.606838 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f40ba82-f27d-4c55-84e5-63119196cac9 None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:15.607476 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b02873-c8bc-4226-a8c6-d241d1b3dc60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:15.608396 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 17/30] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:17:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:17:15.609171 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b02873-c8bc-4226-a8c6-d241d1b3dc60 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:15.609460 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f40ba82-f27d-4c55-84e5-63119196cac9 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:15.630945 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-52b02873-c8bc-4226-a8c6-d241d1b3dc60 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 16:17:15.630945 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:17:15.630945 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:17:15.630945 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:17:15.630945 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:17:15.630945 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:17:15.630945 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:17:15.630945 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:17:15.630945 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:17:15.630945 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:17:15.630945 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:17:15.630945 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:17:15.630945 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 16:17:15.630945 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 16:17:15.630945 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 16:17:15.630945 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 16:17:15.631991 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:17:15.631991 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:17:15.631991 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:17:15.631991 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:17:15.631991 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:17:15.631991 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:17:15.631991 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:17:15.631991 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Sep 09 16:17:15.631991 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:17:15.631991 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:17:15.631991 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:17:15.631991 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:17:15.631991 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:17:15.631991 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:17:15.631991 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:17:15.631991 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:17:15.631991 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 16:17:15.632941 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 16:17:15.632941 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 16:17:15.632941 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:17:15.634096 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 14/31] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 16:17:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:17:15.635375 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b313b40-9fe1-4f36-85ef-ac7b12dcd696 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:15.636127 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b313b40-9fe1-4f36-85ef-ac7b12dcd696 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:15.636127 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b313b40-9fe1-4f36-85ef-ac7b12dcd696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:15.656342 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-7b313b40-9fe1-4f36-85ef-ac7b12dcd696 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:17:15.657678 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-7b313b40-9fe1-4f36-85ef-ac7b12dcd696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:17:15.687359 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:17:15.727345 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f40ba82-f27d-4c55-84e5-63119196cac9 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:15.735735 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 15/32] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:17:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 16:17:15.736504 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b313b40-9fe1-4f36-85ef-ac7b12dcd696 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:15.823015 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a26752-0c4c-4724-b227-b76a6e402679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:15.823646 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a26752-0c4c-4724-b227-b76a6e402679 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:15.823921 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a26752-0c4c-4724-b227-b76a6e402679 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:15.824188 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a26752-0c4c-4724-b227-b76a6e402679 None admin] PATH_INFO: `/v3/users/1a543813ca244c90b6fbbe30c16ad55b` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:15.825343 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a26752-0c4c-4724-b227-b76a6e402679 None admin] RBAC: Authorizing `identity:get_user(user_id=1a543813ca244c90b6fbbe30c16ad55b)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:15.826840 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a26752-0c4c-4724-b227-b76a6e402679 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:15.828712 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 18/33] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Sep 9 16:17:15 2022] GET /identity/v3/users/1a543813ca244c90b6fbbe30c16ad55b => generated 247 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:17:15.831495 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:17:15.834288 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a26752-0c4c-4724-b227-b76a6e402679 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:15.843458 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b313b40-9fe1-4f36-85ef-ac7b12dcd696 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:15.912133 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ca71ca-e435-4def-bc6a-d9b17d246fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:15.912764 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ca71ca-e435-4def-bc6a-d9b17d246fc5 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:15.913044 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ca71ca-e435-4def-bc6a-d9b17d246fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:15.913316 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ca71ca-e435-4def-bc6a-d9b17d246fc5 None admin] PATH_INFO: `/v3/domains` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:15.913963 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ca71ca-e435-4def-bc6a-d9b17d246fc5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:17:15.914268 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ca71ca-e435-4def-bc6a-d9b17d246fc5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:15.915677 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ca71ca-e435-4def-bc6a-d9b17d246fc5 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:15.941333 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 16/34] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Sep 9 16:17:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:17:15.946819 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ca71ca-e435-4def-bc6a-d9b17d246fc5 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:16.018369 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a26752-0c4c-4724-b227-b76a6e402679 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:16.058374 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f936bba4-466a-4066-98e5-327b6ba0a761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:16.059270 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f936bba4-466a-4066-98e5-327b6ba0a761 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:16.060020 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f936bba4-466a-4066-98e5-327b6ba0a761 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:16.060298 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f936bba4-466a-4066-98e5-327b6ba0a761 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:16.061417 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f936bba4-466a-4066-98e5-327b6ba0a761 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:16.062922 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f936bba4-466a-4066-98e5-327b6ba0a761 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:16.064794 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 19/35] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 16:17:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 16:17:16.065556 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f936bba4-466a-4066-98e5-327b6ba0a761 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:16.069633 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:17:16.180476 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f936bba4-466a-4066-98e5-327b6ba0a761 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:16.197685 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ca71ca-e435-4def-bc6a-d9b17d246fc5 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:16.225924 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9892afb5-7e03-44ba-8b1b-77ccdeffb4f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:16.226841 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9892afb5-7e03-44ba-8b1b-77ccdeffb4f5 None admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:16.227124 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9892afb5-7e03-44ba-8b1b-77ccdeffb4f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:16.227667 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9892afb5-7e03-44ba-8b1b-77ccdeffb4f5 None admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:16.228755 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9892afb5-7e03-44ba-8b1b-77ccdeffb4f5 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:16.230708 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9892afb5-7e03-44ba-8b1b-77ccdeffb4f5 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:16.236292 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b111b9f-d867-4262-91c1-c3014bc28296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:16.236900 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b111b9f-d867-4262-91c1-c3014bc28296 None admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:16.237177 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b111b9f-d867-4262-91c1-c3014bc28296 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:16.237445 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b111b9f-d867-4262-91c1-c3014bc28296 None admin] PATH_INFO: `/v3/projects` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:16.239142 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b111b9f-d867-4262-91c1-c3014bc28296 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:16.240901 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b111b9f-d867-4262-91c1-c3014bc28296 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:16.275016 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:17:16.375966 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 20/36] 10.222.0.27 () {60 vars in 1131 bytes} [Fri Sep 9 16:17:16 2022] POST /identity/v3/roles => generated 225 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:17:16.377250 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9892afb5-7e03-44ba-8b1b-77ccdeffb4f5 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:16.415817 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 17/37] 10.222.0.27 () {60 vars in 1141 bytes} [Fri Sep 9 16:17:15 2022] POST /identity/v3/projects => generated 301 bytes in 469 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:17:16.417492 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b111b9f-d867-4262-91c1-c3014bc28296 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:16.491594 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:17:16.550280 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9892afb5-7e03-44ba-8b1b-77ccdeffb4f5 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:16.583401 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b111b9f-d867-4262-91c1-c3014bc28296 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:16.590610 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1f3419-c325-4655-9ad1-c2f7bb53761b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:16.591797 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1f3419-c325-4655-9ad1-c2f7bb53761b None admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:16.592288 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1f3419-c325-4655-9ad1-c2f7bb53761b None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:16.592759 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1f3419-c325-4655-9ad1-c2f7bb53761b None admin] PATH_INFO: `/v3/domains/default/users/1a543813ca244c90b6fbbe30c16ad55b/roles/0a36d1be416f4089be19be979943b731` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:16.595573 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1f3419-c325-4655-9ad1-c2f7bb53761b None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=1a543813ca244c90b6fbbe30c16ad55b, role_id=0a36d1be416f4089be19be979943b731)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:16.597485 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1f3419-c325-4655-9ad1-c2f7bb53761b None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:16.617886 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 21/38] 10.222.0.27 () {58 vars in 1361 bytes} [Fri Sep 9 16:17:16 2022] PUT /identity/v3/domains/default/users/1a543813ca244c90b6fbbe30c16ad55b/roles/0a36d1be416f4089be19be979943b731 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:17:16.619957 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd885a0a-0b10-48ca-9e35-247b35212253 None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:16.620569 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd885a0a-0b10-48ca-9e35-247b35212253 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:16.621090 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd885a0a-0b10-48ca-9e35-247b35212253 None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:16.622979 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 22/39] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:17:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:17:16.629632 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700d4d3e-641e-4a27-b578-7d5d3bb2c2f4 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:16.630868 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700d4d3e-641e-4a27-b578-7d5d3bb2c2f4 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:16.631370 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700d4d3e-641e-4a27-b578-7d5d3bb2c2f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:16.633441 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223e0afc-7095-4d26-ab88-18a757a8efbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:16.634088 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223e0afc-7095-4d26-ab88-18a757a8efbc None admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:16.634414 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223e0afc-7095-4d26-ab88-18a757a8efbc None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:16.634761 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223e0afc-7095-4d26-ab88-18a757a8efbc None admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:16.635516 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223e0afc-7095-4d26-ab88-18a757a8efbc None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:16.637331 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223e0afc-7095-4d26-ab88-18a757a8efbc None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:16.656174 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-700d4d3e-641e-4a27-b578-7d5d3bb2c2f4 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:17:16.661830 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-700d4d3e-641e-4a27-b578-7d5d3bb2c2f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:17:16.679623 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 18/40] 10.222.0.27 () {60 vars in 1131 bytes} [Fri Sep 9 16:17:16 2022] POST /identity/v3/roles => generated 219 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:17:16.682733 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff506aa-a717-4012-9416-834022aad249 None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:16.683195 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff506aa-a717-4012-9416-834022aad249 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:16.683524 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff506aa-a717-4012-9416-834022aad249 None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:16.685767 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 19/41] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:17:16 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:17:16.693378 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4f7dc4-2a41-46a4-bb7e-0baa9ce50655 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:16.693712 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4f7dc4-2a41-46a4-bb7e-0baa9ce50655 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:16.693936 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4f7dc4-2a41-46a4-bb7e-0baa9ce50655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:16.738947 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-3c4f7dc4-2a41-46a4-bb7e-0baa9ce50655 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:17:16.741939 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-3c4f7dc4-2a41-46a4-bb7e-0baa9ce50655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:17:16.783150 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 23/42] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:17:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 16:17:16.835055 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:17:16.851784 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 20/43] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:17:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 16:17:17.097734 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700d4d3e-641e-4a27-b578-7d5d3bb2c2f4 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:17.137157 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4f7dc4-2a41-46a4-bb7e-0baa9ce50655 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:17.160273 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:17:17.211376 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700d4d3e-641e-4a27-b578-7d5d3bb2c2f4 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:17.248037 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4f7dc4-2a41-46a4-bb7e-0baa9ce50655 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:17.293363 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d1c6f4-3d85-44e8-ac69-fc012654d9dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:17.294111 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d1c6f4-3d85-44e8-ac69-fc012654d9dd None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:17.294488 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d1c6f4-3d85-44e8-ac69-fc012654d9dd None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:17.294834 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d1c6f4-3d85-44e8-ac69-fc012654d9dd None admin] PATH_INFO: `/v3/domains/default` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:17.296091 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d1c6f4-3d85-44e8-ac69-fc012654d9dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:17.297691 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d1c6f4-3d85-44e8-ac69-fc012654d9dd None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:17.299703 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 21/44] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 16:17:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 16:17:17.305420 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d1c6f4-3d85-44e8-ac69-fc012654d9dd None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:17.355140 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c8a7cf-2e66-4f5e-967d-e28817ff89b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:17.355670 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c8a7cf-2e66-4f5e-967d-e28817ff89b6 None admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:17.355966 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c8a7cf-2e66-4f5e-967d-e28817ff89b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:17.356223 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c8a7cf-2e66-4f5e-967d-e28817ff89b6 None admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:17.356895 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c8a7cf-2e66-4f5e-967d-e28817ff89b6 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:17.358286 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c8a7cf-2e66-4f5e-967d-e28817ff89b6 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:17.370027 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:17:17.375505 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 24/45] 10.222.0.27 () {60 vars in 1131 bytes} [Fri Sep 9 16:17:17 2022] POST /identity/v3/roles => generated 223 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:17:17.417636 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d1c6f4-3d85-44e8-ac69-fc012654d9dd None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:17.459645 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0fd84a-3561-4a15-b3b3-c5baa6d64436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:17.460264 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0fd84a-3561-4a15-b3b3-c5baa6d64436 None admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:17.460550 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0fd84a-3561-4a15-b3b3-c5baa6d64436 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:17.460825 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0fd84a-3561-4a15-b3b3-c5baa6d64436 None admin] PATH_INFO: `/v3/projects` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:17.461511 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0fd84a-3561-4a15-b3b3-c5baa6d64436 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:17.463050 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0fd84a-3561-4a15-b3b3-c5baa6d64436 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:17.493053 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 22/46] 10.222.0.27 () {60 vars in 1141 bytes} [Fri Sep 9 16:17:17 2022] POST /identity/v3/projects => generated 312 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 16:17:18.920973 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0553772d-e363-4f06-a65b-500e0feac898 None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:18.921494 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0553772d-e363-4f06-a65b-500e0feac898 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:18.921580 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0553772d-e363-4f06-a65b-500e0feac898 None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:18.922889 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 25/47] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:17:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:17:18.927992 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0905fdcf-8e97-486e-8662-b54983346fc5 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:18.928360 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0905fdcf-8e97-486e-8662-b54983346fc5 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:18.928572 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0905fdcf-8e97-486e-8662-b54983346fc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:18.946770 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-0905fdcf-8e97-486e-8662-b54983346fc5 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:17:18.947926 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-0905fdcf-8e97-486e-8662-b54983346fc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:17:19.012181 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 23/48] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:17:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 16:17:19.278126 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0553772d-e363-4f06-a65b-500e0feac898 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:19.377420 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0553772d-e363-4f06-a65b-500e0feac898 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:19.390492 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:17:19.412632 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5970db00-befe-4278-a3ea-3cf70864bead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:19.413258 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5970db00-befe-4278-a3ea-3cf70864bead None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:19.413536 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5970db00-befe-4278-a3ea-3cf70864bead None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:19.413803 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5970db00-befe-4278-a3ea-3cf70864bead None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:19.424099 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5970db00-befe-4278-a3ea-3cf70864bead None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 16:17:19.428901 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-5970db00-befe-4278-a3ea-3cf70864bead None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 16:17:19.428901 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:17:19.428901 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:17:19.428901 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:17:19.428901 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:17:19.428901 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:17:19.428901 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:17:19.428901 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:17:19.428901 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:17:19.428901 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:17:19.428901 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:17:19.428901 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:17:19.428901 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 16:17:19.428901 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 16:17:19.428901 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 16:17:19.428901 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 16:17:19.429711 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 16:17:19.429711 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 16:17:19.429711 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 16:17:19.429711 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 16:17:19.429711 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:17:19.429711 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:17:19.429711 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:17:19.429711 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:17:19.429711 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:17:19.429711 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:17:19.429711 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:17:19.429711 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 16:17:19.429711 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:17:19.429711 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:17:19.429711 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:17:19.429711 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:17:19.430476 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:17:19.430476 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:17:19.430476 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:17:19.430476 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:17:19.430476 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 16:17:19.430476 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 16:17:19.430476 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 16:17:19.430476 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 16:17:19.430476 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 16:17:19.430476 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 16:17:19.430476 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 16:17:19.430476 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 16:17:19.430476 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 26/49] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Sep 9 16:17:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:17:19.436089 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0905fdcf-8e97-486e-8662-b54983346fc5 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:19.476852 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:17:19.534191 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0905fdcf-8e97-486e-8662-b54983346fc5 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:19.570796 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becd2e14-9e74-416f-8040-56b9fdfb0a7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:19.571410 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becd2e14-9e74-416f-8040-56b9fdfb0a7d None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:19.571692 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becd2e14-9e74-416f-8040-56b9fdfb0a7d None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:19.571965 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becd2e14-9e74-416f-8040-56b9fdfb0a7d None admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:19.572631 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becd2e14-9e74-416f-8040-56b9fdfb0a7d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:17:19.572935 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becd2e14-9e74-416f-8040-56b9fdfb0a7d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:19.574342 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becd2e14-9e74-416f-8040-56b9fdfb0a7d None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:19.586504 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 24/50] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Sep 9 16:17:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:17:19.592663 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5970db00-befe-4278-a3ea-3cf70864bead None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:19.654519 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a6ee37-9613-49e9-a110-64c8a689a90d None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:19.654803 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a6ee37-9613-49e9-a110-64c8a689a90d None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:19.655077 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a6ee37-9613-49e9-a110-64c8a689a90d None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:19.656401 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 25/51] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:17:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 16:17:19.661978 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d52241-6d88-45e3-9ca7-5998a5666bac None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:19.662257 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d52241-6d88-45e3-9ca7-5998a5666bac None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:19.662557 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d52241-6d88-45e3-9ca7-5998a5666bac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:19.679935 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-15d52241-6d88-45e3-9ca7-5998a5666bac None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:17:19.681120 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-15d52241-6d88-45e3-9ca7-5998a5666bac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:17:19.691696 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5970db00-befe-4278-a3ea-3cf70864bead None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:19.729950 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9744c604-108c-4a7d-b269-72110f44b681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:19.730622 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9744c604-108c-4a7d-b269-72110f44b681 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:19.730905 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9744c604-108c-4a7d-b269-72110f44b681 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:19.731183 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9744c604-108c-4a7d-b269-72110f44b681 None admin] PATH_INFO: `/v3/users/1a543813ca244c90b6fbbe30c16ad55b` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:19.732319 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9744c604-108c-4a7d-b269-72110f44b681 None admin] RBAC: Authorizing `identity:get_user(user_id=1a543813ca244c90b6fbbe30c16ad55b)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:19.733800 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9744c604-108c-4a7d-b269-72110f44b681 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:19.735415 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 27/52] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Sep 9 16:17:19 2022] GET /identity/v3/users/1a543813ca244c90b6fbbe30c16ad55b => generated 247 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:17:19.740764 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9744c604-108c-4a7d-b269-72110f44b681 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:19.761856 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 26/53] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:17:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 16:17:19.783892 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:17:19.841767 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9744c604-108c-4a7d-b269-72110f44b681 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:19.873418 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f47529-bf3f-43c6-b540-b51f51c565de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:19.874042 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f47529-bf3f-43c6-b540-b51f51c565de None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:19.874350 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f47529-bf3f-43c6-b540-b51f51c565de None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:19.874633 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f47529-bf3f-43c6-b540-b51f51c565de None admin] PATH_INFO: `/v3/domains/default` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:19.875753 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f47529-bf3f-43c6-b540-b51f51c565de None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:19.877219 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f47529-bf3f-43c6-b540-b51f51c565de None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:19.878807 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 28/54] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 16:17:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 16:17:19.885213 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d52241-6d88-45e3-9ca7-5998a5666bac None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:19.917104 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:17:20.029968 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f47529-bf3f-43c6-b540-b51f51c565de None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:20.090550 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d52241-6d88-45e3-9ca7-5998a5666bac None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:20.137682 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a1b8ff-a280-4384-b730-2db15de1c36f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:20.138209 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a1b8ff-a280-4384-b730-2db15de1c36f None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:20.138518 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a1b8ff-a280-4384-b730-2db15de1c36f None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:20.138803 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a1b8ff-a280-4384-b730-2db15de1c36f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:20.139521 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a1b8ff-a280-4384-b730-2db15de1c36f None admin] RBAC: Adding query filter params (role.id=0a36d1be416f4089be19be979943b731, scope.domain.id=default, user.id=1a543813ca244c90b6fbbe30c16ad55b) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:17:20.139827 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a1b8ff-a280-4384-b730-2db15de1c36f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:20.141310 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a1b8ff-a280-4384-b730-2db15de1c36f None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:20.144366 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f47529-bf3f-43c6-b540-b51f51c565de None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:20.150511 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 27/55] 10.222.0.27 () {56 vars in 1322 bytes} [Fri Sep 9 16:17:19 2022] GET /identity/v3/role_assignments?user.id=1a543813ca244c90b6fbbe30c16ad55b&scope.domain.id=default&role.id=0a36d1be416f4089be19be979943b731 => generated 530 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:17:20.154703 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:17:20.181590 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe82d4f-7ab0-4050-9f03-04160a5eddc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:20.182233 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe82d4f-7ab0-4050-9f03-04160a5eddc1 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:20.182542 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe82d4f-7ab0-4050-9f03-04160a5eddc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:20.182813 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe82d4f-7ab0-4050-9f03-04160a5eddc1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:20.184205 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe82d4f-7ab0-4050-9f03-04160a5eddc1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:20.185704 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe82d4f-7ab0-4050-9f03-04160a5eddc1 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:20.187546 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 29/56] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 16:17:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 16:17:20.193837 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a1b8ff-a280-4384-b730-2db15de1c36f None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:20.294088 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:17:20.300124 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a1b8ff-a280-4384-b730-2db15de1c36f None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:20.336987 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca47481b-ad00-4770-973d-142e4b875365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:20.337605 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca47481b-ad00-4770-973d-142e4b875365 None admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:20.337887 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca47481b-ad00-4770-973d-142e4b875365 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:20.338156 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca47481b-ad00-4770-973d-142e4b875365 None admin] PATH_INFO: `/v3/projects` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:20.338848 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca47481b-ad00-4770-973d-142e4b875365 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:20.340288 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca47481b-ad00-4770-973d-142e4b875365 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:20.367409 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 28/57] 10.222.0.27 () {60 vars in 1140 bytes} [Fri Sep 9 16:17:20 2022] POST /identity/v3/projects => generated 298 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:17:22.488828 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec58494-4a66-47a4-bf30-9ee8ce258359 None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:22.489456 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec58494-4a66-47a4-bf30-9ee8ce258359 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:22.489456 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec58494-4a66-47a4-bf30-9ee8ce258359 None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:22.490887 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 30/58] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:17:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:17:22.496220 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc2d745-e9cf-4148-a649-c7077212c939 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:22.496629 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc2d745-e9cf-4148-a649-c7077212c939 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:22.496944 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc2d745-e9cf-4148-a649-c7077212c939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:22.516595 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-ffc2d745-e9cf-4148-a649-c7077212c939 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:17:22.517795 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-ffc2d745-e9cf-4148-a649-c7077212c939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:17:22.582295 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 29/59] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:17:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 16:17:22.854008 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec58494-4a66-47a4-bf30-9ee8ce258359 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:22.952316 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec58494-4a66-47a4-bf30-9ee8ce258359 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:22.983928 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c28fcd-cd63-45e4-bb49-1b7176f04c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:22.984549 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c28fcd-cd63-45e4-bb49-1b7176f04c7a None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:22.984830 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c28fcd-cd63-45e4-bb49-1b7176f04c7a None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:22.985099 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c28fcd-cd63-45e4-bb49-1b7176f04c7a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:22.986196 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c28fcd-cd63-45e4-bb49-1b7176f04c7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:22.987681 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c28fcd-cd63-45e4-bb49-1b7176f04c7a None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:22.989217 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 31/60] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 16:17:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:17:22.994787 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc2d745-e9cf-4148-a649-c7077212c939 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:23.069402 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:17:23.091589 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc2d745-e9cf-4148-a649-c7077212c939 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:23.123366 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c4598b-4064-4b84-85a2-3370b5d40651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:23.123914 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c4598b-4064-4b84-85a2-3370b5d40651 None admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:23.124195 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c4598b-4064-4b84-85a2-3370b5d40651 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:23.124465 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c4598b-4064-4b84-85a2-3370b5d40651 None admin] PATH_INFO: `/v3/users` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:23.125110 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c4598b-4064-4b84-85a2-3370b5d40651 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:23.126578 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c4598b-4064-4b84-85a2-3370b5d40651 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:23.152397 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 30/61] 10.222.0.27 () {60 vars in 1132 bytes} [Fri Sep 9 16:17:22 2022] POST /identity/v3/users => generated 275 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:17:26.410813 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac91ec9-47d9-43a6-b593-c4c5f8395189 None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:26.411313 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac91ec9-47d9-43a6-b593-c4c5f8395189 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:26.411416 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac91ec9-47d9-43a6-b593-c4c5f8395189 None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:26.412744 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 32/62] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:17:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:17:26.429036 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26b4cc0-7c03-43b9-bba0-8a5628cf4603 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:26.429567 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26b4cc0-7c03-43b9-bba0-8a5628cf4603 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:26.429567 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26b4cc0-7c03-43b9-bba0-8a5628cf4603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:26.455400 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-d26b4cc0-7c03-43b9-bba0-8a5628cf4603 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:17:26.456640 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-d26b4cc0-7c03-43b9-bba0-8a5628cf4603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:17:26.551099 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 31/63] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:17:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 16:17:26.554411 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0c9fa3-17ec-4c97-a466-efa5e17719e1 None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:26.554938 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0c9fa3-17ec-4c97-a466-efa5e17719e1 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:26.555415 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0c9fa3-17ec-4c97-a466-efa5e17719e1 None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:26.556959 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 33/64] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:17:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:17:26.562592 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafd1c60-ff08-4a41-b383-eacd23a87a00 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:26.562881 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafd1c60-ff08-4a41-b383-eacd23a87a00 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:26.563157 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafd1c60-ff08-4a41-b383-eacd23a87a00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:26.590949 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-cafd1c60-ff08-4a41-b383-eacd23a87a00 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:17:26.592174 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-cafd1c60-ff08-4a41-b383-eacd23a87a00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:17:26.679474 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:17:26.692344 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 32/65] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:17:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 16:17:26.717310 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15d2de3-a9a7-4b29-b3e8-8e8e69250e5a None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:26.717911 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15d2de3-a9a7-4b29-b3e8-8e8e69250e5a None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:26.718444 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15d2de3-a9a7-4b29-b3e8-8e8e69250e5a None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:26.719987 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 34/66] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:17:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:17:26.725926 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2cec31-b95c-4ea1-aeb3-b5210044ee26 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:26.726216 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2cec31-b95c-4ea1-aeb3-b5210044ee26 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:26.726526 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2cec31-b95c-4ea1-aeb3-b5210044ee26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:26.755052 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-4b2cec31-b95c-4ea1-aeb3-b5210044ee26 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:17:26.756243 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-4b2cec31-b95c-4ea1-aeb3-b5210044ee26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:17:26.826037 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15d2de3-a9a7-4b29-b3e8-8e8e69250e5a None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:26.840909 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 33/67] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:17:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 16:17:26.885479 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:17:26.955954 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15d2de3-a9a7-4b29-b3e8-8e8e69250e5a None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:26.987081 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2cec31-b95c-4ea1-aeb3-b5210044ee26 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:27.001377 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38d3201-a47a-405b-9d8d-88f310870179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:27.002020 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38d3201-a47a-405b-9d8d-88f310870179 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:27.002317 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38d3201-a47a-405b-9d8d-88f310870179 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:27.002599 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38d3201-a47a-405b-9d8d-88f310870179 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:27.020198 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38d3201-a47a-405b-9d8d-88f310870179 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 16:17:27.025464 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-c38d3201-a47a-405b-9d8d-88f310870179 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 16:17:27.025464 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:17:27.025464 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:17:27.025464 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:17:27.025464 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:17:27.025464 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:17:27.025464 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:17:27.025464 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:17:27.025464 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:17:27.025464 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:17:27.025464 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:17:27.025464 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:17:27.025464 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 16:17:27.025464 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 16:17:27.025464 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 16:17:27.025464 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 16:17:27.026293 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 16:17:27.026293 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 16:17:27.026293 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 16:17:27.026293 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 16:17:27.026293 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:17:27.026293 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:17:27.026293 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:17:27.026293 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:17:27.026293 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:17:27.026293 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:17:27.026293 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:17:27.026293 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 16:17:27.026293 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:17:27.026293 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:17:27.026293 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:17:27.026293 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:17:27.027106 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:17:27.027106 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:17:27.027106 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:17:27.027106 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:17:27.027106 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 16:17:27.027106 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 16:17:27.027106 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 16:17:27.027106 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 16:17:27.027106 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 16:17:27.027106 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 16:17:27.027106 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 16:17:27.027106 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 16:17:27.027106 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 35/68] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Sep 9 16:17:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:17:27.035195 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38d3201-a47a-405b-9d8d-88f310870179 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:27.141220 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2cec31-b95c-4ea1-aeb3-b5210044ee26 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:27.167340 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:17:27.179935 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d078c6-1ede-4492-8b9a-cf86bdfb2ee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:27.180871 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d078c6-1ede-4492-8b9a-cf86bdfb2ee2 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:27.181362 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d078c6-1ede-4492-8b9a-cf86bdfb2ee2 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:27.181930 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d078c6-1ede-4492-8b9a-cf86bdfb2ee2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:27.194276 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d078c6-1ede-4492-8b9a-cf86bdfb2ee2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 16:17:27.199385 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-85d078c6-1ede-4492-8b9a-cf86bdfb2ee2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 16:17:27.199385 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:17:27.199385 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:17:27.199385 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:17:27.199385 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:17:27.199385 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:17:27.199385 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:17:27.199385 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:17:27.199385 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:17:27.199385 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:17:27.199385 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:17:27.199385 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:17:27.199385 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 16:17:27.199385 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 16:17:27.199385 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 16:17:27.199385 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 16:17:27.200265 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 16:17:27.200265 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 16:17:27.200265 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 16:17:27.200265 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 16:17:27.200265 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:17:27.200265 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:17:27.200265 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:17:27.200265 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:17:27.200265 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:17:27.200265 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:17:27.200265 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:17:27.200265 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Sep 09 16:17:27.200265 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:17:27.200265 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:17:27.200265 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:17:27.200265 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:17:27.201529 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:17:27.201529 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:17:27.201529 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:17:27.201529 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:17:27.201529 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 16:17:27.201529 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 16:17:27.201529 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 16:17:27.201529 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 16:17:27.201529 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 16:17:27.201529 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 16:17:27.201529 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 16:17:27.201529 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:17:27.201529 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 34/69] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Sep 9 16:17:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 16:17:27.201529 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d078c6-1ede-4492-8b9a-cf86bdfb2ee2 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:27.207997 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38d3201-a47a-405b-9d8d-88f310870179 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:27.210565 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:17:27.243930 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9a3557-d767-4f56-8435-4392972c7a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:27.244534 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9a3557-d767-4f56-8435-4392972c7a8a None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:27.244813 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9a3557-d767-4f56-8435-4392972c7a8a None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:27.245086 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9a3557-d767-4f56-8435-4392972c7a8a None admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:27.245743 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9a3557-d767-4f56-8435-4392972c7a8a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:17:27.246043 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9a3557-d767-4f56-8435-4392972c7a8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:27.247460 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9a3557-d767-4f56-8435-4392972c7a8a None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:27.262189 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 36/70] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Sep 9 16:17:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:17:27.262189 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75650809-4e21-4abb-a040-42590d7b8450 None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:27.262189 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75650809-4e21-4abb-a040-42590d7b8450 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:27.262189 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75650809-4e21-4abb-a040-42590d7b8450 None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:27.262189 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 37/71] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:17:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:17:27.262189 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75650809-4e21-4abb-a040-42590d7b8450 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:27.323012 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d078c6-1ede-4492-8b9a-cf86bdfb2ee2 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:27.359351 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbffbc0-da72-42cd-9197-8ed16730526c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:27.359988 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbffbc0-da72-42cd-9197-8ed16730526c None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:27.360272 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbffbc0-da72-42cd-9197-8ed16730526c None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:27.360548 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbffbc0-da72-42cd-9197-8ed16730526c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:27.371703 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbffbc0-da72-42cd-9197-8ed16730526c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 16:17:27.376565 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-7dbffbc0-da72-42cd-9197-8ed16730526c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 16:17:27.376565 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:17:27.376565 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:17:27.376565 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:17:27.376565 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:17:27.376565 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:17:27.376565 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:17:27.376565 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:17:27.376565 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:17:27.376565 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:17:27.376565 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:17:27.376565 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:17:27.376565 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 16:17:27.376565 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 16:17:27.376565 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 16:17:27.376565 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 16:17:27.377407 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 16:17:27.377407 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 16:17:27.377407 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 16:17:27.377407 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 16:17:27.377407 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:17:27.377407 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:17:27.377407 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:17:27.377407 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:17:27.377407 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:17:27.377407 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:17:27.377407 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:17:27.377407 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Sep 09 16:17:27.377407 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:17:27.377407 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:17:27.377407 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:17:27.377407 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:17:27.378204 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:17:27.378204 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:17:27.378204 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:17:27.378204 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:17:27.378204 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 16:17:27.378204 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 16:17:27.378204 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 16:17:27.378204 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 16:17:27.378204 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 16:17:27.378204 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 16:17:27.378204 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 16:17:27.378204 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:17:27.378204 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 35/72] 10.222.0.27 () {56 vars in 1114 bytes} [Fri Sep 9 16:17:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:17:27.378886 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbffbc0-da72-42cd-9197-8ed16730526c None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:27.389768 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75650809-4e21-4abb-a040-42590d7b8450 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:27.424496 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:17:27.424636 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d7a172-7bbc-451e-ab1d-03c2c1df57ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:27.425234 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d7a172-7bbc-451e-ab1d-03c2c1df57ec None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:27.425519 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d7a172-7bbc-451e-ab1d-03c2c1df57ec None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:27.425826 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d7a172-7bbc-451e-ab1d-03c2c1df57ec None admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:27.427077 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d7a172-7bbc-451e-ab1d-03c2c1df57ec None admin] RBAC: Adding query filter params (name=member) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:17:27.427401 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d7a172-7bbc-451e-ab1d-03c2c1df57ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:27.428781 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d7a172-7bbc-451e-ab1d-03c2c1df57ec None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:27.437004 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 38/73] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Sep 9 16:17:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:17:27.438147 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf41962-22f0-46c2-b7a5-3e1204356724 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:27.438472 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf41962-22f0-46c2-b7a5-3e1204356724 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:27.438748 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf41962-22f0-46c2-b7a5-3e1204356724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:27.455556 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-bbf41962-22f0-46c2-b7a5-3e1204356724 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:17:27.456753 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-bbf41962-22f0-46c2-b7a5-3e1204356724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:17:27.479320 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:17:27.479931 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbffbc0-da72-42cd-9197-8ed16730526c None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:27.515942 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ec5e57-70ca-4b68-80a7-30e2d1745f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:27.516575 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ec5e57-70ca-4b68-80a7-30e2d1745f7f None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:27.516855 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ec5e57-70ca-4b68-80a7-30e2d1745f7f None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:27.517128 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ec5e57-70ca-4b68-80a7-30e2d1745f7f None admin] PATH_INFO: `/v3/users/1a543813ca244c90b6fbbe30c16ad55b` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:27.518624 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ec5e57-70ca-4b68-80a7-30e2d1745f7f None admin] RBAC: Authorizing `identity:get_user(user_id=1a543813ca244c90b6fbbe30c16ad55b)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:27.520096 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ec5e57-70ca-4b68-80a7-30e2d1745f7f None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:27.522154 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 36/74] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Sep 9 16:17:27 2022] GET /identity/v3/users/1a543813ca244c90b6fbbe30c16ad55b => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:17:27.522488 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ec5e57-70ca-4b68-80a7-30e2d1745f7f None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:27.531328 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 39/75] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:17:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 16:17:27.532583 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3869713c-71bc-4a6c-ac35-1ce059f652ca None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:27.532867 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3869713c-71bc-4a6c-ac35-1ce059f652ca None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:27.533137 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3869713c-71bc-4a6c-ac35-1ce059f652ca None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:27.534374 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 40/76] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:17:27 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:17:27.535063 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3869713c-71bc-4a6c-ac35-1ce059f652ca None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:27.641430 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ec5e57-70ca-4b68-80a7-30e2d1745f7f None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:27.647220 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3869713c-71bc-4a6c-ac35-1ce059f652ca None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:27.656194 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:17:27.680730 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b8e953-4771-4722-bcad-2aec3f77c8e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:27.681217 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b8e953-4771-4722-bcad-2aec3f77c8e8 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:27.681501 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b8e953-4771-4722-bcad-2aec3f77c8e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:27.681776 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b8e953-4771-4722-bcad-2aec3f77c8e8 None admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:27.682459 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b8e953-4771-4722-bcad-2aec3f77c8e8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:17:27.682764 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b8e953-4771-4722-bcad-2aec3f77c8e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:27.683256 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cf8af1-4a11-485b-9990-c5fbe1ed2dc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:27.684127 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cf8af1-4a11-485b-9990-c5fbe1ed2dc0 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:27.684396 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b8e953-4771-4722-bcad-2aec3f77c8e8 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:27.684487 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cf8af1-4a11-485b-9990-c5fbe1ed2dc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:27.684674 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cf8af1-4a11-485b-9990-c5fbe1ed2dc0 None admin] PATH_INFO: `/v3/users/f918acce5260406e8053172ddbf5a1fc` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:27.693644 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 37/77] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Sep 9 16:17:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:17:27.694821 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b8e953-4771-4722-bcad-2aec3f77c8e8 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:27.699168 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cf8af1-4a11-485b-9990-c5fbe1ed2dc0 None admin] RBAC: Authorizing `identity:get_user(user_id=f918acce5260406e8053172ddbf5a1fc)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:27.701426 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cf8af1-4a11-485b-9990-c5fbe1ed2dc0 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:27.706050 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 41/78] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Sep 9 16:17:27 2022] GET /identity/v3/users/f918acce5260406e8053172ddbf5a1fc => generated 275 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:17:27.706050 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7343b7d5-2304-4d09-a7ba-60899042828e None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:27.706050 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7343b7d5-2304-4d09-a7ba-60899042828e None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:27.706050 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7343b7d5-2304-4d09-a7ba-60899042828e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:27.724424 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-7343b7d5-2304-4d09-a7ba-60899042828e None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:17:27.725609 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-7343b7d5-2304-4d09-a7ba-60899042828e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:17:27.736500 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:17:27.793595 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 42/79] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:17:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 16:17:27.794456 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7343b7d5-2304-4d09-a7ba-60899042828e None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:27.817929 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b8e953-4771-4722-bcad-2aec3f77c8e8 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:27.853019 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e3a73e-58b7-43cd-ac72-2d3679235a3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:27.853630 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e3a73e-58b7-43cd-ac72-2d3679235a3c None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:27.853915 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e3a73e-58b7-43cd-ac72-2d3679235a3c None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:27.854190 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e3a73e-58b7-43cd-ac72-2d3679235a3c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:27.901788 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:17:27.909715 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7343b7d5-2304-4d09-a7ba-60899042828e None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:27.930858 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e3a73e-58b7-43cd-ac72-2d3679235a3c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:27.932329 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e3a73e-58b7-43cd-ac72-2d3679235a3c None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:27.946456 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1f703a-9048-42ff-a5cb-3fb25c3a9bbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:27.947497 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1f703a-9048-42ff-a5cb-3fb25c3a9bbd None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:27.947995 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1f703a-9048-42ff-a5cb-3fb25c3a9bbd None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:27.948466 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1f703a-9048-42ff-a5cb-3fb25c3a9bbd None admin] PATH_INFO: `/v3/users/f918acce5260406e8053172ddbf5a1fc` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:27.951014 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1f703a-9048-42ff-a5cb-3fb25c3a9bbd None admin] RBAC: Authorizing `identity:get_user(user_id=f918acce5260406e8053172ddbf5a1fc)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:27.952543 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1f703a-9048-42ff-a5cb-3fb25c3a9bbd None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:27.954132 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 43/80] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Sep 9 16:17:27 2022] GET /identity/v3/users/f918acce5260406e8053172ddbf5a1fc => generated 275 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:17:27.954929 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1f703a-9048-42ff-a5cb-3fb25c3a9bbd None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:27.974519 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:17:28.043149 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 38/81] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Sep 9 16:17:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 16:17:28.044750 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e3a73e-58b7-43cd-ac72-2d3679235a3c None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:28.069854 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1f703a-9048-42ff-a5cb-3fb25c3a9bbd None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:28.102917 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917ad241-65c3-4f9c-96c7-a18879596977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:28.103520 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917ad241-65c3-4f9c-96c7-a18879596977 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:28.103797 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917ad241-65c3-4f9c-96c7-a18879596977 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:28.104077 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917ad241-65c3-4f9c-96c7-a18879596977 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:28.121509 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:17:28.146907 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e3a73e-58b7-43cd-ac72-2d3679235a3c None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:28.169588 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917ad241-65c3-4f9c-96c7-a18879596977 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:28.171091 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917ad241-65c3-4f9c-96c7-a18879596977 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:28.181358 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adafb88-ca67-4b84-8270-29bc3793058d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:28.181919 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adafb88-ca67-4b84-8270-29bc3793058d None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:28.182199 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adafb88-ca67-4b84-8270-29bc3793058d None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:28.182503 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adafb88-ca67-4b84-8270-29bc3793058d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:28.185992 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:17:28.193372 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adafb88-ca67-4b84-8270-29bc3793058d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 16:17:28.198187 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-2adafb88-ca67-4b84-8270-29bc3793058d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 16:17:28.198187 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:17:28.198187 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:17:28.198187 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:17:28.198187 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:17:28.198187 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:17:28.198187 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:17:28.198187 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:17:28.198187 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:17:28.198187 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:17:28.198187 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:17:28.198187 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:17:28.198187 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 16:17:28.198187 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 16:17:28.198187 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 16:17:28.198187 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 16:17:28.199228 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 16:17:28.199228 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 16:17:28.199228 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 16:17:28.199228 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 16:17:28.199228 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:17:28.199228 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:17:28.199228 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:17:28.199228 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:17:28.199228 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:17:28.199228 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:17:28.199228 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:17:28.199228 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Sep 09 16:17:28.199228 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:17:28.199228 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:17:28.199228 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:17:28.199228 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:17:28.200133 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:17:28.200133 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:17:28.200133 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:17:28.200133 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:17:28.200133 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 16:17:28.200133 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 16:17:28.200133 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 16:17:28.200133 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 16:17:28.200133 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 16:17:28.200133 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 16:17:28.200133 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 16:17:28.200133 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:17:28.200133 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 39/82] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Sep 9 16:17:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:17:28.200133 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adafb88-ca67-4b84-8270-29bc3793058d None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:28.271742 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 44/83] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Sep 9 16:17:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 16:17:28.272579 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917ad241-65c3-4f9c-96c7-a18879596977 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:28.303511 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adafb88-ca67-4b84-8270-29bc3793058d None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:28.337546 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be07f708-0869-4e52-90b5-377c3dc98004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:28.338148 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be07f708-0869-4e52-90b5-377c3dc98004 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:28.338469 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be07f708-0869-4e52-90b5-377c3dc98004 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:28.338745 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be07f708-0869-4e52-90b5-377c3dc98004 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:28.341310 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:17:28.373920 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917ad241-65c3-4f9c-96c7-a18879596977 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:28.388023 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:17:28.407844 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be07f708-0869-4e52-90b5-377c3dc98004 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:28.408431 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adffae6-d91a-409c-8494-806c7688cd6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:28.409054 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adffae6-d91a-409c-8494-806c7688cd6b None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:28.409334 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be07f708-0869-4e52-90b5-377c3dc98004 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:28.409448 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adffae6-d91a-409c-8494-806c7688cd6b None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:28.409604 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adffae6-d91a-409c-8494-806c7688cd6b None admin] PATH_INFO: `/v3/projects/adc7a18acd23477d80890d7a3477e7c9` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:28.411312 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adffae6-d91a-409c-8494-806c7688cd6b None admin] RBAC: Authorizing `identity:get_project(project_id=adc7a18acd23477d80890d7a3477e7c9)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:28.412754 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adffae6-d91a-409c-8494-806c7688cd6b None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:28.414388 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 45/84] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Sep 9 16:17:28 2022] GET /identity/v3/projects/adc7a18acd23477d80890d7a3477e7c9 => generated 298 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:17:28.415243 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adffae6-d91a-409c-8494-806c7688cd6b None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:28.506328 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 40/85] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Sep 9 16:17:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 16:17:28.507795 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be07f708-0869-4e52-90b5-377c3dc98004 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:28.519514 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adffae6-d91a-409c-8494-806c7688cd6b None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:28.540550 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:17:28.554167 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ae1c21-f6e1-4c8b-8ecb-4ccd3ec88bfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:28.554826 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ae1c21-f6e1-4c8b-8ecb-4ccd3ec88bfb None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:28.555109 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ae1c21-f6e1-4c8b-8ecb-4ccd3ec88bfb None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:28.555382 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ae1c21-f6e1-4c8b-8ecb-4ccd3ec88bfb None admin] PATH_INFO: `/v3/domains/default` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:28.556476 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ae1c21-f6e1-4c8b-8ecb-4ccd3ec88bfb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:28.557946 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ae1c21-f6e1-4c8b-8ecb-4ccd3ec88bfb None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:28.559872 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 46/86] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 16:17:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:17:28.560673 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ae1c21-f6e1-4c8b-8ecb-4ccd3ec88bfb None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:28.608877 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be07f708-0869-4e52-90b5-377c3dc98004 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:28.612815 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:17:28.642021 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affcc61d-74ff-4628-b78c-98cb32b69b94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:28.642659 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affcc61d-74ff-4628-b78c-98cb32b69b94 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:28.642941 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affcc61d-74ff-4628-b78c-98cb32b69b94 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:28.643216 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affcc61d-74ff-4628-b78c-98cb32b69b94 None admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:28.643868 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affcc61d-74ff-4628-b78c-98cb32b69b94 None admin] RBAC: Adding query filter params (name=member) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:17:28.644176 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affcc61d-74ff-4628-b78c-98cb32b69b94 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:28.646082 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affcc61d-74ff-4628-b78c-98cb32b69b94 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:28.653868 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 41/87] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Sep 9 16:17:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:17:28.659020 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affcc61d-74ff-4628-b78c-98cb32b69b94 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:28.662453 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ae1c21-f6e1-4c8b-8ecb-4ccd3ec88bfb None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:28.695872 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c44a551-0bc6-4edd-8801-55d64e664575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:28.696496 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c44a551-0bc6-4edd-8801-55d64e664575 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:28.696778 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c44a551-0bc6-4edd-8801-55d64e664575 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:28.697054 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c44a551-0bc6-4edd-8801-55d64e664575 None admin] PATH_INFO: `/v3/projects/adc7a18acd23477d80890d7a3477e7c9` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:28.698201 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c44a551-0bc6-4edd-8801-55d64e664575 None admin] RBAC: Authorizing `identity:get_project(project_id=adc7a18acd23477d80890d7a3477e7c9)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:28.699678 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c44a551-0bc6-4edd-8801-55d64e664575 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:28.701292 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 47/88] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Sep 9 16:17:28 2022] GET /identity/v3/projects/adc7a18acd23477d80890d7a3477e7c9 => generated 298 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:17:28.702053 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c44a551-0bc6-4edd-8801-55d64e664575 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:28.751846 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:17:28.758196 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affcc61d-74ff-4628-b78c-98cb32b69b94 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:28.792480 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbb389e-b422-4caa-8f0d-f37a0a47f4ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:28.793083 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbb389e-b422-4caa-8f0d-f37a0a47f4ee None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:28.793362 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbb389e-b422-4caa-8f0d-f37a0a47f4ee None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:28.793877 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbb389e-b422-4caa-8f0d-f37a0a47f4ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:28.794382 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbb389e-b422-4caa-8f0d-f37a0a47f4ee None admin] RBAC: Adding query filter params (role.id=0a36d1be416f4089be19be979943b731, scope.project.id=adc7a18acd23477d80890d7a3477e7c9, user.id=1a543813ca244c90b6fbbe30c16ad55b) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:17:28.794694 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbb389e-b422-4caa-8f0d-f37a0a47f4ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:28.796148 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbb389e-b422-4caa-8f0d-f37a0a47f4ee None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:28.802140 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 42/89] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Sep 9 16:17:28 2022] GET /identity/v3/role_assignments?user.id=1a543813ca244c90b6fbbe30c16ad55b&scope.project.id=adc7a18acd23477d80890d7a3477e7c9&role.id=0a36d1be416f4089be19be979943b731 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:17:28.802638 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c44a551-0bc6-4edd-8801-55d64e664575 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:28.802982 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbb389e-b422-4caa-8f0d-f37a0a47f4ee None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:28.834216 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:17:28.854167 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5d8fd2-9022-4f3c-809b-97c6de421361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:28.855260 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5d8fd2-9022-4f3c-809b-97c6de421361 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:28.855739 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5d8fd2-9022-4f3c-809b-97c6de421361 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:28.856164 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5d8fd2-9022-4f3c-809b-97c6de421361 None admin] PATH_INFO: `/v3/projects/adc7a18acd23477d80890d7a3477e7c9` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:28.857580 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5d8fd2-9022-4f3c-809b-97c6de421361 None admin] RBAC: Authorizing `identity:get_project(project_id=adc7a18acd23477d80890d7a3477e7c9)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:28.859119 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5d8fd2-9022-4f3c-809b-97c6de421361 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:28.866467 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 48/90] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Sep 9 16:17:28 2022] GET /identity/v3/projects/adc7a18acd23477d80890d7a3477e7c9 => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:17:28.866467 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5d8fd2-9022-4f3c-809b-97c6de421361 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:28.922525 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbb389e-b422-4caa-8f0d-f37a0a47f4ee None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:28.961612 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2a820e-6d81-4416-aaa5-b1dec4ec30f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:28.962235 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2a820e-6d81-4416-aaa5-b1dec4ec30f3 None admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:28.962547 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2a820e-6d81-4416-aaa5-b1dec4ec30f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:28.962851 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2a820e-6d81-4416-aaa5-b1dec4ec30f3 None admin] PATH_INFO: `/v3/users` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:28.963482 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2a820e-6d81-4416-aaa5-b1dec4ec30f3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:28.964943 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2a820e-6d81-4416-aaa5-b1dec4ec30f3 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:28.984093 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5d8fd2-9022-4f3c-809b-97c6de421361 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:28.989520 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 43/91] 10.222.0.27 () {60 vars in 1132 bytes} [Fri Sep 9 16:17:28 2022] POST /identity/v3/users => generated 289 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:17:28.991364 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2a820e-6d81-4416-aaa5-b1dec4ec30f3 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:29.013931 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:17:29.034839 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c68f35-381f-4f17-ada3-96dede6f9ceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:29.035586 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c68f35-381f-4f17-ada3-96dede6f9ceb None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:29.036642 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c68f35-381f-4f17-ada3-96dede6f9ceb None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:29.037086 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c68f35-381f-4f17-ada3-96dede6f9ceb None admin] PATH_INFO: `/v3/users/f918acce5260406e8053172ddbf5a1fc` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:29.039003 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c68f35-381f-4f17-ada3-96dede6f9ceb None admin] RBAC: Authorizing `identity:get_user(user_id=f918acce5260406e8053172ddbf5a1fc)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:29.040248 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c68f35-381f-4f17-ada3-96dede6f9ceb None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:29.042079 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 49/92] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Sep 9 16:17:28 2022] GET /identity/v3/users/f918acce5260406e8053172ddbf5a1fc => generated 275 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:17:29.042953 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c68f35-381f-4f17-ada3-96dede6f9ceb None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:29.107992 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:17:29.120470 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2a820e-6d81-4416-aaa5-b1dec4ec30f3 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:29.160559 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b302d0-efbf-4699-ae0f-eceb6bc0beb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:29.161748 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b302d0-efbf-4699-ae0f-eceb6bc0beb5 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:29.162037 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b302d0-efbf-4699-ae0f-eceb6bc0beb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:29.162332 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b302d0-efbf-4699-ae0f-eceb6bc0beb5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:29.163149 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b302d0-efbf-4699-ae0f-eceb6bc0beb5 None admin] RBAC: Adding query filter params (role.id=b38e84bf077846ee802e6bb1bad83522, scope.project.id=adc7a18acd23477d80890d7a3477e7c9, user.id=f918acce5260406e8053172ddbf5a1fc) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:17:29.163466 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b302d0-efbf-4699-ae0f-eceb6bc0beb5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:29.164726 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c68f35-381f-4f17-ada3-96dede6f9ceb None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:29.164968 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b302d0-efbf-4699-ae0f-eceb6bc0beb5 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:29.177222 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 44/93] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Sep 9 16:17:28 2022] GET /identity/v3/role_assignments?user.id=f918acce5260406e8053172ddbf5a1fc&scope.project.id=adc7a18acd23477d80890d7a3477e7c9&role.id=b38e84bf077846ee802e6bb1bad83522 => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:17:29.177222 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b302d0-efbf-4699-ae0f-eceb6bc0beb5 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:29.227408 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce5a33e-181d-458f-8481-f6f023df0758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:29.228059 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce5a33e-181d-458f-8481-f6f023df0758 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:29.228343 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce5a33e-181d-458f-8481-f6f023df0758 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:29.228619 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce5a33e-181d-458f-8481-f6f023df0758 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:29.229407 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce5a33e-181d-458f-8481-f6f023df0758 None admin] RBAC: Adding query filter params (role.id=9452afb4ffe54eb7b7b5b0aff7dd00ed, scope.project.id=adc7a18acd23477d80890d7a3477e7c9, user.id=f918acce5260406e8053172ddbf5a1fc) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:17:29.229717 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce5a33e-181d-458f-8481-f6f023df0758 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:29.231223 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce5a33e-181d-458f-8481-f6f023df0758 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:29.239180 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 50/94] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Sep 9 16:17:29 2022] GET /identity/v3/role_assignments?user.id=f918acce5260406e8053172ddbf5a1fc&scope.project.id=adc7a18acd23477d80890d7a3477e7c9&role.id=9452afb4ffe54eb7b7b5b0aff7dd00ed => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:17:29.297484 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:17:29.322255 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b302d0-efbf-4699-ae0f-eceb6bc0beb5 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:29.363537 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f4d38c-4e89-46ba-99b0-686933b3683c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:29.364232 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f4d38c-4e89-46ba-99b0-686933b3683c None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:29.364549 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f4d38c-4e89-46ba-99b0-686933b3683c None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:29.364803 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f4d38c-4e89-46ba-99b0-686933b3683c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:29.443130 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f4d38c-4e89-46ba-99b0-686933b3683c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:29.444730 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f4d38c-4e89-46ba-99b0-686933b3683c None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:29.531068 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:17:29.555274 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 45/95] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Sep 9 16:17:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 16:17:29.561174 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce5a33e-181d-458f-8481-f6f023df0758 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:29.691718 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce5a33e-181d-458f-8481-f6f023df0758 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:29.712994 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:17:29.732694 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29426b9f-08fb-4262-b978-2c0ecda57f31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:29.733334 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29426b9f-08fb-4262-b978-2c0ecda57f31 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:29.733615 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29426b9f-08fb-4262-b978-2c0ecda57f31 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:29.733898 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29426b9f-08fb-4262-b978-2c0ecda57f31 None admin] PATH_INFO: `/v3/projects/8291a701a38f4f9cb1ff7085d155aedb` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:29.735073 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29426b9f-08fb-4262-b978-2c0ecda57f31 None admin] RBAC: Authorizing `identity:get_project(project_id=8291a701a38f4f9cb1ff7085d155aedb)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:29.736555 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29426b9f-08fb-4262-b978-2c0ecda57f31 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:29.738208 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 51/96] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Sep 9 16:17:29 2022] GET /identity/v3/projects/8291a701a38f4f9cb1ff7085d155aedb => generated 312 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:17:29.744746 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f4d38c-4e89-46ba-99b0-686933b3683c None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:29.854410 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f4d38c-4e89-46ba-99b0-686933b3683c None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:29.891065 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f1dce0-7403-4014-b862-5896ee372892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:29.891828 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f1dce0-7403-4014-b862-5896ee372892 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:29.892113 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f1dce0-7403-4014-b862-5896ee372892 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:29.892388 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f1dce0-7403-4014-b862-5896ee372892 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:29.893112 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f1dce0-7403-4014-b862-5896ee372892 None admin] RBAC: Adding query filter params (role.id=b38e84bf077846ee802e6bb1bad83522, scope.project.id=8291a701a38f4f9cb1ff7085d155aedb, user.id=f918acce5260406e8053172ddbf5a1fc) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:17:29.893419 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f1dce0-7403-4014-b862-5896ee372892 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:29.894906 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f1dce0-7403-4014-b862-5896ee372892 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:29.901089 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 46/97] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Sep 9 16:17:29 2022] GET /identity/v3/role_assignments?user.id=f918acce5260406e8053172ddbf5a1fc&scope.project.id=8291a701a38f4f9cb1ff7085d155aedb&role.id=b38e84bf077846ee802e6bb1bad83522 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:17:31.963213 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec3be4a-f2aa-4836-b460-2f9060f35e0a None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:31.963743 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec3be4a-f2aa-4836-b460-2f9060f35e0a None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:31.963743 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec3be4a-f2aa-4836-b460-2f9060f35e0a None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:31.965390 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 52/98] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:17:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:17:31.970412 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d21d5c9-6896-41c8-97d3-8020f30d888d None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:31.970840 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d21d5c9-6896-41c8-97d3-8020f30d888d None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:31.971021 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d21d5c9-6896-41c8-97d3-8020f30d888d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:31.993507 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-0d21d5c9-6896-41c8-97d3-8020f30d888d None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:17:31.994767 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-0d21d5c9-6896-41c8-97d3-8020f30d888d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:17:32.047785 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:17:32.088855 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 47/99] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:17:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 16:17:32.105755 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146b2675-ee10-4b1a-b664-10312474bddb None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:32.106049 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146b2675-ee10-4b1a-b664-10312474bddb None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:32.106319 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146b2675-ee10-4b1a-b664-10312474bddb None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:32.107676 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 53/100] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:17:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:17:32.112909 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e791b53-04d1-41e4-804a-05d5112d7798 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:32.113204 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e791b53-04d1-41e4-804a-05d5112d7798 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:32.113485 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e791b53-04d1-41e4-804a-05d5112d7798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:32.131964 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-1e791b53-04d1-41e4-804a-05d5112d7798 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:17:32.133150 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-1e791b53-04d1-41e4-804a-05d5112d7798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:17:32.209683 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 48/101] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:17:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 16:17:32.352006 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462d8085-9216-4034-baa1-8909df737390 None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:32.352324 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462d8085-9216-4034-baa1-8909df737390 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:32.352568 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462d8085-9216-4034-baa1-8909df737390 None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:32.354057 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 54/102] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:17:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:17:32.359220 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8a4dfc-7aa8-422b-bdb6-20530cce20ee None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:32.359516 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8a4dfc-7aa8-422b-bdb6-20530cce20ee None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:32.359794 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8a4dfc-7aa8-422b-bdb6-20530cce20ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:32.384716 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-8c8a4dfc-7aa8-422b-bdb6-20530cce20ee None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:17:32.385907 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-8c8a4dfc-7aa8-422b-bdb6-20530cce20ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:17:32.467443 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 49/103] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:17:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 16:17:32.536379 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462d8085-9216-4034-baa1-8909df737390 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:32.596481 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8a4dfc-7aa8-422b-bdb6-20530cce20ee None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:32.652000 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:17:32.707675 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462d8085-9216-4034-baa1-8909df737390 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:32.728788 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8a4dfc-7aa8-422b-bdb6-20530cce20ee None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:32.773249 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2c28c8-0c28-4048-b57a-48bc1ead49d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:32.774135 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2c28c8-0c28-4048-b57a-48bc1ead49d3 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:32.774597 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2c28c8-0c28-4048-b57a-48bc1ead49d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:32.775014 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2c28c8-0c28-4048-b57a-48bc1ead49d3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:32.799092 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3550d775-ea7a-41f3-bc1f-cf567e525840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:32.799975 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3550d775-ea7a-41f3-bc1f-cf567e525840 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:32.800406 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3550d775-ea7a-41f3-bc1f-cf567e525840 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:32.800817 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3550d775-ea7a-41f3-bc1f-cf567e525840 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:32.803544 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2c28c8-0c28-4048-b57a-48bc1ead49d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 16:17:32.809477 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-ac2c28c8-0c28-4048-b57a-48bc1ead49d3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 16:17:32.809477 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:17:32.809477 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:17:32.809477 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:17:32.809477 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:17:32.809477 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:17:32.809477 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:17:32.809477 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:17:32.809477 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:17:32.809477 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:17:32.809477 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:17:32.809477 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:17:32.809477 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 16:17:32.809477 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 16:17:32.809477 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 16:17:32.809477 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 16:17:32.810544 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 16:17:32.810544 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 16:17:32.810544 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 16:17:32.810544 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 16:17:32.810544 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:17:32.810544 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:17:32.810544 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:17:32.810544 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:17:32.810544 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:17:32.810544 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:17:32.810544 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:17:32.810544 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 16:17:32.810544 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:17:32.810544 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:17:32.810544 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:17:32.810544 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:17:32.811487 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:17:32.811487 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:17:32.811487 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:17:32.811487 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:17:32.811487 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 16:17:32.811487 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 16:17:32.811487 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 16:17:32.811487 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 16:17:32.811487 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 16:17:32.811487 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 16:17:32.811487 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 16:17:32.811487 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 16:17:32.818641 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 55/104] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Sep 9 16:17:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:17:32.819273 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3550d775-ea7a-41f3-bc1f-cf567e525840 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 16:17:32.819851 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2c28c8-0c28-4048-b57a-48bc1ead49d3 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:32.824171 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-3550d775-ea7a-41f3-bc1f-cf567e525840 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 16:17:32.824171 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:17:32.824171 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:17:32.824171 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:17:32.824171 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:17:32.824171 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:17:32.824171 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:17:32.824171 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:17:32.824171 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:17:32.824171 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:17:32.824171 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:17:32.824171 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:17:32.824171 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 16:17:32.824171 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 16:17:32.824171 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 16:17:32.824171 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 16:17:32.825194 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 16:17:32.825194 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 16:17:32.825194 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 16:17:32.825194 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 16:17:32.825194 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:17:32.825194 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:17:32.825194 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:17:32.825194 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:17:32.825194 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:17:32.825194 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:17:32.825194 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:17:32.825194 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Sep 09 16:17:32.825194 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:17:32.825194 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:17:32.825194 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:17:32.825194 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:17:32.826123 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:17:32.826123 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:17:32.826123 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:17:32.826123 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:17:32.826123 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 16:17:32.826123 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 16:17:32.826123 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 16:17:32.826123 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 16:17:32.826123 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 16:17:32.826123 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 16:17:32.826123 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 16:17:32.826123 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:17:32.826123 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 50/105] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Sep 9 16:17:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 16:17:32.832690 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3550d775-ea7a-41f3-bc1f-cf567e525840 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:32.914039 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:17:32.944119 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:17:32.950777 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3550d775-ea7a-41f3-bc1f-cf567e525840 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:33.006701 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc30d8bb-492f-4c8c-93f4-58ab81881e67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:33.007330 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc30d8bb-492f-4c8c-93f4-58ab81881e67 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:33.007874 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc30d8bb-492f-4c8c-93f4-58ab81881e67 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:33.008159 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc30d8bb-492f-4c8c-93f4-58ab81881e67 None admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:33.008860 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc30d8bb-492f-4c8c-93f4-58ab81881e67 None admin] RBAC: Adding query filter params (name=member) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:17:33.009393 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc30d8bb-492f-4c8c-93f4-58ab81881e67 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:33.010886 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc30d8bb-492f-4c8c-93f4-58ab81881e67 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:33.030545 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 51/106] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Sep 9 16:17:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 16:17:33.031462 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc30d8bb-492f-4c8c-93f4-58ab81881e67 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:33.034965 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2c28c8-0c28-4048-b57a-48bc1ead49d3 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:33.103580 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8bc8c6-3d5c-4c98-947c-cdf5f29a0edc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:33.104120 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8bc8c6-3d5c-4c98-947c-cdf5f29a0edc None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:33.104406 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8bc8c6-3d5c-4c98-947c-cdf5f29a0edc None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:33.104683 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8bc8c6-3d5c-4c98-947c-cdf5f29a0edc None admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:33.105349 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8bc8c6-3d5c-4c98-947c-cdf5f29a0edc None admin] RBAC: Adding query filter params (name=admin) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:17:33.105653 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8bc8c6-3d5c-4c98-947c-cdf5f29a0edc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:33.109098 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8bc8c6-3d5c-4c98-947c-cdf5f29a0edc None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:33.127240 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 56/107] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Sep 9 16:17:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:17:33.128087 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8bc8c6-3d5c-4c98-947c-cdf5f29a0edc None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:33.214882 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc30d8bb-492f-4c8c-93f4-58ab81881e67 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:33.265276 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8900a15-8169-421f-8e2b-426c68186d3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:33.266135 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8900a15-8169-421f-8e2b-426c68186d3a None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:33.266614 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8900a15-8169-421f-8e2b-426c68186d3a None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:33.266900 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8900a15-8169-421f-8e2b-426c68186d3a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:33.285850 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8bc8c6-3d5c-4c98-947c-cdf5f29a0edc None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:33.288117 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8900a15-8169-421f-8e2b-426c68186d3a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 16:17:33.295408 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-c8900a15-8169-421f-8e2b-426c68186d3a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 16:17:33.295408 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:17:33.295408 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:17:33.295408 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:17:33.295408 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:17:33.295408 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:17:33.295408 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:17:33.295408 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:17:33.295408 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:17:33.295408 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:17:33.295408 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:17:33.295408 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:17:33.295408 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 16:17:33.295408 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 16:17:33.295408 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 16:17:33.295408 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 16:17:33.296342 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 16:17:33.296342 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 16:17:33.296342 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 16:17:33.296342 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 16:17:33.296342 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:17:33.296342 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:17:33.296342 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:17:33.296342 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:17:33.296342 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:17:33.296342 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:17:33.296342 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:17:33.296342 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Sep 09 16:17:33.296342 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:17:33.296342 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:17:33.296342 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:17:33.296342 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:17:33.297107 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:17:33.297107 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:17:33.297107 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:17:33.297107 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:17:33.297107 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 16:17:33.297107 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 16:17:33.297107 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 16:17:33.297107 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 16:17:33.297107 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 16:17:33.297107 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 16:17:33.297107 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 16:17:33.297107 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:17:33.297107 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 52/108] 10.222.0.27 () {56 vars in 1114 bytes} [Fri Sep 9 16:17:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:17:33.297741 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8900a15-8169-421f-8e2b-426c68186d3a None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:33.307204 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:17:33.320573 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:17:33.352299 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3308c3c0-0ffa-4d3a-88c7-c8824fa3f040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:33.353174 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3308c3c0-0ffa-4d3a-88c7-c8824fa3f040 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:33.353459 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3308c3c0-0ffa-4d3a-88c7-c8824fa3f040 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:33.353785 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3308c3c0-0ffa-4d3a-88c7-c8824fa3f040 None admin] PATH_INFO: `/v3/users/f918acce5260406e8053172ddbf5a1fc` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:33.354897 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3308c3c0-0ffa-4d3a-88c7-c8824fa3f040 None admin] RBAC: Authorizing `identity:get_user(user_id=f918acce5260406e8053172ddbf5a1fc)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:33.356464 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3308c3c0-0ffa-4d3a-88c7-c8824fa3f040 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:33.358194 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 57/109] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Sep 9 16:17:33 2022] GET /identity/v3/users/f918acce5260406e8053172ddbf5a1fc => generated 275 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:17:33.359193 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13bdd80-49d2-4f02-be6e-156adc79b87c None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:33.359699 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13bdd80-49d2-4f02-be6e-156adc79b87c None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:33.360326 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13bdd80-49d2-4f02-be6e-156adc79b87c None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:33.362605 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 58/110] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:17:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:17:33.363699 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13bdd80-49d2-4f02-be6e-156adc79b87c None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:33.415412 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8900a15-8169-421f-8e2b-426c68186d3a None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:33.448581 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15edef27-6f4a-40d5-add7-3185485b36fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:33.449215 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15edef27-6f4a-40d5-add7-3185485b36fe None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:33.449498 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15edef27-6f4a-40d5-add7-3185485b36fe None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:33.449777 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15edef27-6f4a-40d5-add7-3185485b36fe None admin] PATH_INFO: `/v3/users/1a543813ca244c90b6fbbe30c16ad55b` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:33.450919 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15edef27-6f4a-40d5-add7-3185485b36fe None admin] RBAC: Authorizing `identity:get_user(user_id=1a543813ca244c90b6fbbe30c16ad55b)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:33.452380 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15edef27-6f4a-40d5-add7-3185485b36fe None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:33.453946 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 53/111] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Sep 9 16:17:33 2022] GET /identity/v3/users/1a543813ca244c90b6fbbe30c16ad55b => generated 247 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:17:33.455162 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31957823-edd4-47c2-bcb5-13c7e9f205cd None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:33.455452 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31957823-edd4-47c2-bcb5-13c7e9f205cd None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:33.455733 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31957823-edd4-47c2-bcb5-13c7e9f205cd None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:33.456942 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 54/112] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:17:33 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:17:33.461573 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68380a6-6b9c-45db-8962-be42b9fd1cad None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:33.461573 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68380a6-6b9c-45db-8962-be42b9fd1cad None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:33.461573 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68380a6-6b9c-45db-8962-be42b9fd1cad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:33.472058 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13bdd80-49d2-4f02-be6e-156adc79b87c None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:33.477223 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-e68380a6-6b9c-45db-8962-be42b9fd1cad None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:17:33.478447 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-e68380a6-6b9c-45db-8962-be42b9fd1cad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:17:33.504848 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53558a5a-6328-4eee-b95d-ae72b32452f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:33.505445 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53558a5a-6328-4eee-b95d-ae72b32452f3 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:33.505725 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53558a5a-6328-4eee-b95d-ae72b32452f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:33.505996 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53558a5a-6328-4eee-b95d-ae72b32452f3 None admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:33.506670 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53558a5a-6328-4eee-b95d-ae72b32452f3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:17:33.506973 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53558a5a-6328-4eee-b95d-ae72b32452f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:33.508338 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53558a5a-6328-4eee-b95d-ae72b32452f3 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:33.516098 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 59/113] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Sep 9 16:17:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:17:33.517049 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53558a5a-6328-4eee-b95d-ae72b32452f3 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:33.546406 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 55/114] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:17:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 16:17:33.547635 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819b8f60-3b47-4b57-9af8-8975251ed2f1 None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:33.547927 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819b8f60-3b47-4b57-9af8-8975251ed2f1 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:33.548201 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819b8f60-3b47-4b57-9af8-8975251ed2f1 None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:33.549430 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 56/115] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:17:33 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:17:33.550131 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819b8f60-3b47-4b57-9af8-8975251ed2f1 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:33.565960 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:17:33.568226 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:17:33.634163 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53558a5a-6328-4eee-b95d-ae72b32452f3 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:33.663773 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819b8f60-3b47-4b57-9af8-8975251ed2f1 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:33.672197 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abe5d91-2fc4-4699-a15d-b8aaf63cf515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:33.672828 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abe5d91-2fc4-4699-a15d-b8aaf63cf515 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:33.673100 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abe5d91-2fc4-4699-a15d-b8aaf63cf515 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:33.673376 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abe5d91-2fc4-4699-a15d-b8aaf63cf515 None admin] PATH_INFO: `/v3/projects/adc7a18acd23477d80890d7a3477e7c9` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:33.674517 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abe5d91-2fc4-4699-a15d-b8aaf63cf515 None admin] RBAC: Authorizing `identity:get_project(project_id=adc7a18acd23477d80890d7a3477e7c9)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:33.676004 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abe5d91-2fc4-4699-a15d-b8aaf63cf515 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:33.678116 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 60/116] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Sep 9 16:17:33 2022] GET /identity/v3/projects/adc7a18acd23477d80890d7a3477e7c9 => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:17:33.679245 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3a9ad8-bc02-4df9-9dcf-d2e02dae6573 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:33.679527 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3a9ad8-bc02-4df9-9dcf-d2e02dae6573 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:33.679799 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3a9ad8-bc02-4df9-9dcf-d2e02dae6573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:33.700094 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-ab3a9ad8-bc02-4df9-9dcf-d2e02dae6573 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:17:33.701839 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-ab3a9ad8-bc02-4df9-9dcf-d2e02dae6573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:17:33.705481 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74ce7b2-e882-4178-860d-23b9afe2da3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:33.706124 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74ce7b2-e882-4178-860d-23b9afe2da3f None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:33.706434 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74ce7b2-e882-4178-860d-23b9afe2da3f None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:33.706727 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74ce7b2-e882-4178-860d-23b9afe2da3f None admin] PATH_INFO: `/v3/projects/adc7a18acd23477d80890d7a3477e7c9` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:33.707863 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74ce7b2-e882-4178-860d-23b9afe2da3f None admin] RBAC: Authorizing `identity:get_project(project_id=adc7a18acd23477d80890d7a3477e7c9)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:33.709319 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74ce7b2-e882-4178-860d-23b9afe2da3f None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:33.715854 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 57/117] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Sep 9 16:17:33 2022] GET /identity/v3/projects/adc7a18acd23477d80890d7a3477e7c9 => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:17:33.715854 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74ce7b2-e882-4178-860d-23b9afe2da3f None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:33.771799 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 61/118] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:17:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 16:17:33.773158 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d7ff5a-3d33-45f3-9642-6de325a6fb58 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:33.773452 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d7ff5a-3d33-45f3-9642-6de325a6fb58 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:33.773732 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d7ff5a-3d33-45f3-9642-6de325a6fb58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:33.791995 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-e9d7ff5a-3d33-45f3-9642-6de325a6fb58 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:17:33.793343 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-e9d7ff5a-3d33-45f3-9642-6de325a6fb58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:17:33.810146 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:17:33.827340 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:17:33.836337 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74ce7b2-e882-4178-860d-23b9afe2da3f None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:33.874328 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 62/119] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:17:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 16:17:33.874328 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d7ff5a-3d33-45f3-9642-6de325a6fb58 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:33.879144 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19d02fa-915a-47c0-a35a-31bbcce0714b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:33.880601 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19d02fa-915a-47c0-a35a-31bbcce0714b None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:33.880891 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19d02fa-915a-47c0-a35a-31bbcce0714b None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:33.881538 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19d02fa-915a-47c0-a35a-31bbcce0714b None admin] PATH_INFO: `/v3/users/f918acce5260406e8053172ddbf5a1fc` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:33.882966 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19d02fa-915a-47c0-a35a-31bbcce0714b None admin] RBAC: Authorizing `identity:get_user(user_id=f918acce5260406e8053172ddbf5a1fc)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:33.884929 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19d02fa-915a-47c0-a35a-31bbcce0714b None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:33.886625 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 58/120] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Sep 9 16:17:33 2022] GET /identity/v3/users/f918acce5260406e8053172ddbf5a1fc => generated 275 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:17:33.887770 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19d02fa-915a-47c0-a35a-31bbcce0714b None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:33.977906 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d7ff5a-3d33-45f3-9642-6de325a6fb58 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:34.012236 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19d02fa-915a-47c0-a35a-31bbcce0714b None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:34.032678 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6d1049-54e9-436e-b731-a9549679834c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:34.033964 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6d1049-54e9-436e-b731-a9549679834c None admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:34.034432 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6d1049-54e9-436e-b731-a9549679834c None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:34.034851 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6d1049-54e9-436e-b731-a9549679834c None admin] PATH_INFO: `/v3/projects/adc7a18acd23477d80890d7a3477e7c9/users/f918acce5260406e8053172ddbf5a1fc/roles/b38e84bf077846ee802e6bb1bad83522` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:34.038410 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6d1049-54e9-436e-b731-a9549679834c None admin] RBAC: Authorizing `identity:create_grant(project_id=adc7a18acd23477d80890d7a3477e7c9, user_id=f918acce5260406e8053172ddbf5a1fc, role_id=b38e84bf077846ee802e6bb1bad83522)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:34.041453 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6d1049-54e9-436e-b731-a9549679834c None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:34.053318 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35fb562-0db2-499f-9910-6600fe7dd16e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:34.053995 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35fb562-0db2-499f-9910-6600fe7dd16e None admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:34.054271 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35fb562-0db2-499f-9910-6600fe7dd16e None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:34.054577 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35fb562-0db2-499f-9910-6600fe7dd16e None admin] PATH_INFO: `/v3/projects/adc7a18acd23477d80890d7a3477e7c9/users/1a543813ca244c90b6fbbe30c16ad55b/roles/0a36d1be416f4089be19be979943b731` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:34.056485 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35fb562-0db2-499f-9910-6600fe7dd16e None admin] RBAC: Authorizing `identity:create_grant(project_id=adc7a18acd23477d80890d7a3477e7c9, user_id=1a543813ca244c90b6fbbe30c16ad55b, role_id=0a36d1be416f4089be19be979943b731)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:34.062687 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 63/121] 10.222.0.27 () {58 vars in 1439 bytes} [Fri Sep 9 16:17:33 2022] PUT /identity/v3/projects/adc7a18acd23477d80890d7a3477e7c9/users/f918acce5260406e8053172ddbf5a1fc/roles/b38e84bf077846ee802e6bb1bad83522 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:17:34.062847 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35fb562-0db2-499f-9910-6600fe7dd16e None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:34.062927 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6d1049-54e9-436e-b731-a9549679834c None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:34.077680 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 59/122] 10.222.0.27 () {58 vars in 1439 bytes} [Fri Sep 9 16:17:33 2022] PUT /identity/v3/projects/adc7a18acd23477d80890d7a3477e7c9/users/1a543813ca244c90b6fbbe30c16ad55b/roles/0a36d1be416f4089be19be979943b731 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:17:34.078904 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35fb562-0db2-499f-9910-6600fe7dd16e None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:34.097655 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:17:34.104124 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:17:34.236789 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6d1049-54e9-436e-b731-a9549679834c None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:34.255879 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35fb562-0db2-499f-9910-6600fe7dd16e None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:34.290859 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8170a2de-ce1f-4b64-bfa4-f8c986bcc9e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:34.291501 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8170a2de-ce1f-4b64-bfa4-f8c986bcc9e6 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:34.291784 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8170a2de-ce1f-4b64-bfa4-f8c986bcc9e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:34.292062 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8170a2de-ce1f-4b64-bfa4-f8c986bcc9e6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:34.293224 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8170a2de-ce1f-4b64-bfa4-f8c986bcc9e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:34.294328 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46a7d38-16a8-48f1-a3f7-8e38e39e62df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:34.294848 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8170a2de-ce1f-4b64-bfa4-f8c986bcc9e6 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:34.295439 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46a7d38-16a8-48f1-a3f7-8e38e39e62df None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:34.295913 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46a7d38-16a8-48f1-a3f7-8e38e39e62df None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:34.296395 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46a7d38-16a8-48f1-a3f7-8e38e39e62df None admin] PATH_INFO: `/v3/projects/adc7a18acd23477d80890d7a3477e7c9` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:34.296494 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 64/123] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 16:17:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:17:34.297213 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8170a2de-ce1f-4b64-bfa4-f8c986bcc9e6 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:34.297993 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46a7d38-16a8-48f1-a3f7-8e38e39e62df None admin] RBAC: Authorizing `identity:get_project(project_id=adc7a18acd23477d80890d7a3477e7c9)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:34.299487 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46a7d38-16a8-48f1-a3f7-8e38e39e62df None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:34.301228 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 60/124] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Sep 9 16:17:34 2022] GET /identity/v3/projects/adc7a18acd23477d80890d7a3477e7c9 => generated 298 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:17:34.302498 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46a7d38-16a8-48f1-a3f7-8e38e39e62df None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:34.403027 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:17:34.423325 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:17:34.432644 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8170a2de-ce1f-4b64-bfa4-f8c986bcc9e6 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:34.436669 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46a7d38-16a8-48f1-a3f7-8e38e39e62df None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:34.472613 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de34f50c-1a0a-4bd1-a1b3-7c64b97e8a3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:34.473428 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de34f50c-1a0a-4bd1-a1b3-7c64b97e8a3e None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:34.473753 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de34f50c-1a0a-4bd1-a1b3-7c64b97e8a3e None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:34.474129 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de34f50c-1a0a-4bd1-a1b3-7c64b97e8a3e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:34.479840 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d0204e-2e30-4843-ae9f-0318bc4ecac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:34.480516 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d0204e-2e30-4843-ae9f-0318bc4ecac2 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:34.480752 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d0204e-2e30-4843-ae9f-0318bc4ecac2 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:34.481026 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d0204e-2e30-4843-ae9f-0318bc4ecac2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:34.485472 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de34f50c-1a0a-4bd1-a1b3-7c64b97e8a3e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 16:17:34.491689 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-de34f50c-1a0a-4bd1-a1b3-7c64b97e8a3e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 16:17:34.491689 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:17:34.491689 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:17:34.491689 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:17:34.491689 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:17:34.491689 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:17:34.491689 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:17:34.491689 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:17:34.491689 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:17:34.491689 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:17:34.491689 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:17:34.491689 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:17:34.491689 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 16:17:34.491689 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 16:17:34.491689 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 16:17:34.491689 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 16:17:34.492539 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 16:17:34.492539 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 16:17:34.492539 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 16:17:34.492539 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 16:17:34.492539 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:17:34.492539 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:17:34.492539 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:17:34.492539 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:17:34.492539 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:17:34.492539 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:17:34.492539 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:17:34.492539 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 16:17:34.492539 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:17:34.492539 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:17:34.492539 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:17:34.492539 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:17:34.493936 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:17:34.493936 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:17:34.493936 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:17:34.493936 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:17:34.493936 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 16:17:34.493936 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 16:17:34.493936 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 16:17:34.493936 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 16:17:34.493936 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 16:17:34.493936 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 16:17:34.493936 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 16:17:34.493936 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 16:17:34.493936 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 65/125] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Sep 9 16:17:34 2022] GET /identity/v3/roles/reader => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:17:34.494785 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d0204e-2e30-4843-ae9f-0318bc4ecac2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 16:17:34.494855 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de34f50c-1a0a-4bd1-a1b3-7c64b97e8a3e None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:34.502912 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-16d0204e-2e30-4843-ae9f-0318bc4ecac2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 16:17:34.502912 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:17:34.502912 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:17:34.502912 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:17:34.502912 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:17:34.502912 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:17:34.502912 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:17:34.502912 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:17:34.502912 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:17:34.502912 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:17:34.502912 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:17:34.502912 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:17:34.502912 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 16:17:34.502912 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 16:17:34.502912 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 16:17:34.502912 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 16:17:34.505591 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 16:17:34.505591 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 16:17:34.505591 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 16:17:34.505591 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 16:17:34.505591 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:17:34.505591 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:17:34.505591 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:17:34.505591 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:17:34.505591 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:17:34.505591 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:17:34.505591 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:17:34.505591 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Sep 09 16:17:34.505591 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:17:34.505591 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:17:34.505591 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:17:34.505591 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:17:34.507727 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:17:34.507727 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:17:34.507727 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:17:34.507727 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:17:34.507727 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 16:17:34.507727 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 16:17:34.507727 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 16:17:34.507727 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 16:17:34.507727 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 16:17:34.507727 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 16:17:34.507727 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 16:17:34.507727 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:17:34.507727 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 61/126] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Sep 9 16:17:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:17:34.507727 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d0204e-2e30-4843-ae9f-0318bc4ecac2 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:34.607736 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de34f50c-1a0a-4bd1-a1b3-7c64b97e8a3e None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:34.616082 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d0204e-2e30-4843-ae9f-0318bc4ecac2 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:34.644602 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83409e56-80f3-4abe-8f94-0b82420c3f26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:34.645688 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83409e56-80f3-4abe-8f94-0b82420c3f26 None admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:34.646085 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83409e56-80f3-4abe-8f94-0b82420c3f26 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:34.646386 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83409e56-80f3-4abe-8f94-0b82420c3f26 None admin] PATH_INFO: `/v3/projects` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:34.647041 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83409e56-80f3-4abe-8f94-0b82420c3f26 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:34.649196 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83409e56-80f3-4abe-8f94-0b82420c3f26 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:34.652872 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fae9a5-f3bd-4a08-85ef-c5f33eb91730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:34.653672 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fae9a5-f3bd-4a08-85ef-c5f33eb91730 None admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:34.654201 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fae9a5-f3bd-4a08-85ef-c5f33eb91730 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:34.654453 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fae9a5-f3bd-4a08-85ef-c5f33eb91730 None admin] PATH_INFO: `/v3/projects/adc7a18acd23477d80890d7a3477e7c9/users/f918acce5260406e8053172ddbf5a1fc/roles/9452afb4ffe54eb7b7b5b0aff7dd00ed` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:34.656758 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fae9a5-f3bd-4a08-85ef-c5f33eb91730 None admin] RBAC: Authorizing `identity:create_grant(project_id=adc7a18acd23477d80890d7a3477e7c9, user_id=f918acce5260406e8053172ddbf5a1fc, role_id=9452afb4ffe54eb7b7b5b0aff7dd00ed)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:34.658408 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fae9a5-f3bd-4a08-85ef-c5f33eb91730 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:34.668197 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:17:34.674117 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 62/127] 10.222.0.27 () {58 vars in 1439 bytes} [Fri Sep 9 16:17:34 2022] PUT /identity/v3/projects/adc7a18acd23477d80890d7a3477e7c9/users/f918acce5260406e8053172ddbf5a1fc/roles/9452afb4ffe54eb7b7b5b0aff7dd00ed => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:17:34.679515 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fae9a5-f3bd-4a08-85ef-c5f33eb91730 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:34.698755 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 66/128] 10.222.0.27 () {60 vars in 1141 bytes} [Fri Sep 9 16:17:34 2022] POST /identity/v3/projects => generated 302 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:17:34.699699 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83409e56-80f3-4abe-8f94-0b82420c3f26 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:34.714787 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:17:34.840797 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83409e56-80f3-4abe-8f94-0b82420c3f26 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:34.896290 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63387273-4d42-4e47-9824-420e669315fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:34.896920 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63387273-4d42-4e47-9824-420e669315fb None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:34.897199 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63387273-4d42-4e47-9824-420e669315fb None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:34.897472 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63387273-4d42-4e47-9824-420e669315fb None admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:34.898152 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63387273-4d42-4e47-9824-420e669315fb None admin] RBAC: Adding query filter params (name=member) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:17:34.898482 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63387273-4d42-4e47-9824-420e669315fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:34.899906 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63387273-4d42-4e47-9824-420e669315fb None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:34.920081 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 67/129] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Sep 9 16:17:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:17:34.925990 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63387273-4d42-4e47-9824-420e669315fb None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:34.927966 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fae9a5-f3bd-4a08-85ef-c5f33eb91730 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:35.002692 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b33cbc-e69f-4985-8d29-b5c81e48266d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:35.003318 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b33cbc-e69f-4985-8d29-b5c81e48266d None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:35.003597 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b33cbc-e69f-4985-8d29-b5c81e48266d None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:35.003865 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b33cbc-e69f-4985-8d29-b5c81e48266d None admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:35.005727 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b33cbc-e69f-4985-8d29-b5c81e48266d None admin] RBAC: Adding query filter params (name=reader) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:17:35.005727 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b33cbc-e69f-4985-8d29-b5c81e48266d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:35.008012 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b33cbc-e69f-4985-8d29-b5c81e48266d None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:35.020210 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 63/130] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Sep 9 16:17:34 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:17:35.026518 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b33cbc-e69f-4985-8d29-b5c81e48266d None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:35.067596 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:17:35.130049 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63387273-4d42-4e47-9824-420e669315fb None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:35.135883 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:17:35.171744 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa4580b-07a2-4619-9ecd-31b97ef0db5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:35.172482 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa4580b-07a2-4619-9ecd-31b97ef0db5a None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:35.172832 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa4580b-07a2-4619-9ecd-31b97ef0db5a None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:35.173113 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa4580b-07a2-4619-9ecd-31b97ef0db5a None admin] PATH_INFO: `/v3/users/f918acce5260406e8053172ddbf5a1fc` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:35.174280 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa4580b-07a2-4619-9ecd-31b97ef0db5a None admin] RBAC: Authorizing `identity:get_user(user_id=f918acce5260406e8053172ddbf5a1fc)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:35.175770 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa4580b-07a2-4619-9ecd-31b97ef0db5a None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:35.177839 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 68/131] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Sep 9 16:17:34 2022] GET /identity/v3/users/f918acce5260406e8053172ddbf5a1fc => generated 275 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 16:17:35.183357 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa4580b-07a2-4619-9ecd-31b97ef0db5a None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:35.205530 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b33cbc-e69f-4985-8d29-b5c81e48266d None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:35.292456 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facbcb47-298f-4fe4-b8fb-8cce376178ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:35.293434 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facbcb47-298f-4fe4-b8fb-8cce376178ae None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:35.293938 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facbcb47-298f-4fe4-b8fb-8cce376178ae None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:35.294450 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facbcb47-298f-4fe4-b8fb-8cce376178ae None admin] PATH_INFO: `/v3/users/d8809ae0c3934322983d8c64c4590844` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:35.318649 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa4580b-07a2-4619-9ecd-31b97ef0db5a None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:35.338997 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facbcb47-298f-4fe4-b8fb-8cce376178ae None admin] RBAC: Authorizing `identity:get_user(user_id=d8809ae0c3934322983d8c64c4590844)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:35.340792 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facbcb47-298f-4fe4-b8fb-8cce376178ae None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:35.342834 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 64/132] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Sep 9 16:17:35 2022] GET /identity/v3/users/d8809ae0c3934322983d8c64c4590844 => generated 289 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 16:17:35.350070 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facbcb47-298f-4fe4-b8fb-8cce376178ae None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:35.380571 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b456f8-4529-4fd4-81e4-8365fb36da30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:35.381148 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b456f8-4529-4fd4-81e4-8365fb36da30 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:35.381568 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b456f8-4529-4fd4-81e4-8365fb36da30 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:35.381853 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b456f8-4529-4fd4-81e4-8365fb36da30 None admin] PATH_INFO: `/v3/projects/8291a701a38f4f9cb1ff7085d155aedb` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:35.383572 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b456f8-4529-4fd4-81e4-8365fb36da30 None admin] RBAC: Authorizing `identity:get_project(project_id=8291a701a38f4f9cb1ff7085d155aedb)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:35.385289 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b456f8-4529-4fd4-81e4-8365fb36da30 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:35.387136 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 69/133] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Sep 9 16:17:35 2022] GET /identity/v3/projects/8291a701a38f4f9cb1ff7085d155aedb => generated 312 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 16:17:35.393047 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b456f8-4529-4fd4-81e4-8365fb36da30 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:35.400976 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:17:35.575561 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b456f8-4529-4fd4-81e4-8365fb36da30 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:35.612206 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facbcb47-298f-4fe4-b8fb-8cce376178ae None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:35.635082 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381069ba-b45e-4fd6-a26a-09174cdd679d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:35.635673 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381069ba-b45e-4fd6-a26a-09174cdd679d None admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:35.635955 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381069ba-b45e-4fd6-a26a-09174cdd679d None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:35.636228 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381069ba-b45e-4fd6-a26a-09174cdd679d None admin] PATH_INFO: `/v3/projects/8291a701a38f4f9cb1ff7085d155aedb/users/f918acce5260406e8053172ddbf5a1fc/roles/b38e84bf077846ee802e6bb1bad83522` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:35.638298 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381069ba-b45e-4fd6-a26a-09174cdd679d None admin] RBAC: Authorizing `identity:create_grant(project_id=8291a701a38f4f9cb1ff7085d155aedb, user_id=f918acce5260406e8053172ddbf5a1fc, role_id=b38e84bf077846ee802e6bb1bad83522)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:35.639891 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381069ba-b45e-4fd6-a26a-09174cdd679d None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:35.651450 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:17:35.664759 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 70/134] 10.222.0.27 () {58 vars in 1439 bytes} [Fri Sep 9 16:17:35 2022] PUT /identity/v3/projects/8291a701a38f4f9cb1ff7085d155aedb/users/f918acce5260406e8053172ddbf5a1fc/roles/b38e84bf077846ee802e6bb1bad83522 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:17:35.688656 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc16f7fe-2b70-4cea-bc95-105d6bdc6edf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:35.689676 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc16f7fe-2b70-4cea-bc95-105d6bdc6edf None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:35.690160 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc16f7fe-2b70-4cea-bc95-105d6bdc6edf None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:35.690668 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc16f7fe-2b70-4cea-bc95-105d6bdc6edf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:35.780886 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc16f7fe-2b70-4cea-bc95-105d6bdc6edf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:35.782830 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc16f7fe-2b70-4cea-bc95-105d6bdc6edf None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:35.924447 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 65/135] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Sep 9 16:17:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 575 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 16:17:35.930535 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381069ba-b45e-4fd6-a26a-09174cdd679d None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:36.017739 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:17:36.073694 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381069ba-b45e-4fd6-a26a-09174cdd679d None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:36.109004 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104bc792-618f-457c-b042-8f349db0d238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:36.109708 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104bc792-618f-457c-b042-8f349db0d238 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:36.109997 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104bc792-618f-457c-b042-8f349db0d238 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:36.110276 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104bc792-618f-457c-b042-8f349db0d238 None admin] PATH_INFO: `/v3/projects/adc7a18acd23477d80890d7a3477e7c9` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:36.111505 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104bc792-618f-457c-b042-8f349db0d238 None admin] RBAC: Authorizing `identity:get_project(project_id=adc7a18acd23477d80890d7a3477e7c9)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:36.112981 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104bc792-618f-457c-b042-8f349db0d238 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:36.115191 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 71/136] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Sep 9 16:17:35 2022] GET /identity/v3/projects/adc7a18acd23477d80890d7a3477e7c9 => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:17:36.121295 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc16f7fe-2b70-4cea-bc95-105d6bdc6edf None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:36.142242 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:17:36.244650 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc16f7fe-2b70-4cea-bc95-105d6bdc6edf None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:36.299206 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071b1c36-66bc-4a6d-af4c-e6a9afde9d27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:36.300139 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071b1c36-66bc-4a6d-af4c-e6a9afde9d27 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:36.300632 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071b1c36-66bc-4a6d-af4c-e6a9afde9d27 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:36.301707 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071b1c36-66bc-4a6d-af4c-e6a9afde9d27 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:36.302684 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071b1c36-66bc-4a6d-af4c-e6a9afde9d27 None admin] RBAC: Adding query filter params (role.id=99ea656aad1b4b0c990db50b9b878b90, scope.project.id=adc7a18acd23477d80890d7a3477e7c9, user.id=d8809ae0c3934322983d8c64c4590844) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:17:36.303209 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071b1c36-66bc-4a6d-af4c-e6a9afde9d27 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:36.304870 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071b1c36-66bc-4a6d-af4c-e6a9afde9d27 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:36.314686 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 66/137] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Sep 9 16:17:36 2022] GET /identity/v3/role_assignments?user.id=d8809ae0c3934322983d8c64c4590844&scope.project.id=adc7a18acd23477d80890d7a3477e7c9&role.id=99ea656aad1b4b0c990db50b9b878b90 => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:17:36.873157 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6751fa8-2477-4ed1-b752-5c694046c5a9 None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:36.873441 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6751fa8-2477-4ed1-b752-5c694046c5a9 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:36.874014 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6751fa8-2477-4ed1-b752-5c694046c5a9 None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:36.875606 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 72/138] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:17:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:17:36.880952 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bced4632-698b-4f15-a127-9c31f88a42a9 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:36.881249 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bced4632-698b-4f15-a127-9c31f88a42a9 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:36.881532 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bced4632-698b-4f15-a127-9c31f88a42a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:36.911830 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-bced4632-698b-4f15-a127-9c31f88a42a9 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:17:36.913067 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-bced4632-698b-4f15-a127-9c31f88a42a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:17:37.000585 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 67/139] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:17:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 16:17:37.189890 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f04400b-d9d1-4b65-85fa-338d6d1b4d87 None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:37.190913 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f04400b-d9d1-4b65-85fa-338d6d1b4d87 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:37.191409 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f04400b-d9d1-4b65-85fa-338d6d1b4d87 None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:37.193472 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 73/140] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:17:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:17:37.199186 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c0cfb1-dc2a-4c06-8ef0-f2286c17a456 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:37.199601 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c0cfb1-dc2a-4c06-8ef0-f2286c17a456 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:37.199793 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c0cfb1-dc2a-4c06-8ef0-f2286c17a456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:37.220889 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-58c0cfb1-dc2a-4c06-8ef0-f2286c17a456 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:17:37.222092 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-58c0cfb1-dc2a-4c06-8ef0-f2286c17a456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:17:37.232362 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:17:37.316126 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 68/141] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:17:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 16:17:37.541611 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f04400b-d9d1-4b65-85fa-338d6d1b4d87 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:37.589255 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c0cfb1-dc2a-4c06-8ef0-f2286c17a456 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:37.706231 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f04400b-d9d1-4b65-85fa-338d6d1b4d87 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:37.760636 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:17:37.760842 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c0cfb1-dc2a-4c06-8ef0-f2286c17a456 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:37.764378 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9c8889-36e7-4e43-8b03-75a7c7c8999a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:37.765031 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9c8889-36e7-4e43-8b03-75a7c7c8999a None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:37.765322 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9c8889-36e7-4e43-8b03-75a7c7c8999a None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:37.765649 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9c8889-36e7-4e43-8b03-75a7c7c8999a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:37.791157 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9c8889-36e7-4e43-8b03-75a7c7c8999a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 16:17:37.796637 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-9a9c8889-36e7-4e43-8b03-75a7c7c8999a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 16:17:37.796637 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:17:37.796637 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:17:37.796637 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:17:37.796637 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:17:37.796637 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:17:37.796637 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:17:37.796637 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:17:37.796637 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:17:37.796637 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:17:37.796637 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:17:37.796637 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:17:37.796637 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 16:17:37.796637 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 16:17:37.796637 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 16:17:37.796637 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 16:17:37.797503 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 16:17:37.797503 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 16:17:37.797503 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 16:17:37.797503 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 16:17:37.797503 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:17:37.797503 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:17:37.797503 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:17:37.797503 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:17:37.797503 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:17:37.797503 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:17:37.797503 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:17:37.797503 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 16:17:37.797503 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:17:37.797503 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:17:37.797503 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:17:37.797503 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:17:37.798298 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:17:37.798298 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:17:37.798298 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:17:37.798298 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:17:37.798298 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 16:17:37.798298 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 16:17:37.798298 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 16:17:37.798298 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 16:17:37.798298 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 16:17:37.798298 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 16:17:37.798298 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 16:17:37.798298 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 16:17:37.798298 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 74/142] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Sep 9 16:17:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:17:37.803543 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b00e382-4a8d-4f6d-ae84-82948302cf89 None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:37.803543 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b00e382-4a8d-4f6d-ae84-82948302cf89 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:37.803667 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b00e382-4a8d-4f6d-ae84-82948302cf89 None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:37.805055 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 75/143] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:17:37 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:17:37.810811 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d533941c-0b65-47d7-9e8d-b875ae830fcb None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:37.811100 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d533941c-0b65-47d7-9e8d-b875ae830fcb None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:37.811376 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d533941c-0b65-47d7-9e8d-b875ae830fcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:37.817430 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c8b4ed-3169-4c1f-937b-0a721231307c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:37.818602 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c8b4ed-3169-4c1f-937b-0a721231307c None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:37.819944 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c8b4ed-3169-4c1f-937b-0a721231307c None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:37.820416 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c8b4ed-3169-4c1f-937b-0a721231307c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:37.829953 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-d533941c-0b65-47d7-9e8d-b875ae830fcb None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:17:37.834324 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-d533941c-0b65-47d7-9e8d-b875ae830fcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:17:37.843808 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c8b4ed-3169-4c1f-937b-0a721231307c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 16:17:37.853317 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-79c8b4ed-3169-4c1f-937b-0a721231307c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 16:17:37.853317 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:17:37.853317 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:17:37.853317 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:17:37.853317 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:17:37.853317 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:17:37.853317 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:17:37.853317 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:17:37.853317 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:17:37.853317 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:17:37.853317 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:17:37.853317 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:17:37.853317 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 16:17:37.853317 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 16:17:37.853317 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 16:17:37.853317 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 16:17:37.854178 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 16:17:37.854178 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 16:17:37.854178 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 16:17:37.854178 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 16:17:37.854178 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:17:37.854178 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:17:37.854178 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:17:37.854178 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:17:37.854178 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:17:37.854178 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:17:37.854178 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:17:37.854178 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Sep 09 16:17:37.854178 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:17:37.854178 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:17:37.854178 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:17:37.854178 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:17:37.854966 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:17:37.854966 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:17:37.854966 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:17:37.854966 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:17:37.854966 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 16:17:37.854966 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 16:17:37.854966 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 16:17:37.854966 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 16:17:37.854966 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 16:17:37.854966 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 16:17:37.854966 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 16:17:37.854966 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:17:37.854966 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 69/144] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Sep 9 16:17:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 16:17:37.855597 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c8b4ed-3169-4c1f-937b-0a721231307c None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:37.869980 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:17:37.965841 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 76/145] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:17:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 16:17:37.966833 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d533941c-0b65-47d7-9e8d-b875ae830fcb None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:38.059721 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c8b4ed-3169-4c1f-937b-0a721231307c None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:38.124079 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b77f7d-cdeb-41a5-9cbe-c2563f2e63e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:38.124693 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b77f7d-cdeb-41a5-9cbe-c2563f2e63e7 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:38.124974 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b77f7d-cdeb-41a5-9cbe-c2563f2e63e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:38.125248 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b77f7d-cdeb-41a5-9cbe-c2563f2e63e7 None admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:38.125906 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b77f7d-cdeb-41a5-9cbe-c2563f2e63e7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:17:38.126209 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b77f7d-cdeb-41a5-9cbe-c2563f2e63e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:38.127618 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b77f7d-cdeb-41a5-9cbe-c2563f2e63e7 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:38.143818 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 70/146] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Sep 9 16:17:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:17:38.151263 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b77f7d-cdeb-41a5-9cbe-c2563f2e63e7 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:38.162420 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d533941c-0b65-47d7-9e8d-b875ae830fcb None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:38.199265 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:17:38.221639 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a61e263-ae2d-4e47-8c3e-90ed949621e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:38.222600 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a61e263-ae2d-4e47-8c3e-90ed949621e0 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:38.223667 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a61e263-ae2d-4e47-8c3e-90ed949621e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:38.224106 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a61e263-ae2d-4e47-8c3e-90ed949621e0 None admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:38.224928 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a61e263-ae2d-4e47-8c3e-90ed949621e0 None admin] RBAC: Adding query filter params (name=member) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:17:38.225409 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a61e263-ae2d-4e47-8c3e-90ed949621e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:38.227000 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a61e263-ae2d-4e47-8c3e-90ed949621e0 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:38.245452 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 77/147] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Sep 9 16:17:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:17:38.251335 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a61e263-ae2d-4e47-8c3e-90ed949621e0 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:38.283985 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:17:38.333475 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b77f7d-cdeb-41a5-9cbe-c2563f2e63e7 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:38.388556 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e412501-5c6a-47c1-9c36-5264d8e5d2a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:38.389185 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e412501-5c6a-47c1-9c36-5264d8e5d2a5 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:38.389463 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e412501-5c6a-47c1-9c36-5264d8e5d2a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:38.389730 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e412501-5c6a-47c1-9c36-5264d8e5d2a5 None admin] PATH_INFO: `/v3/users/1a543813ca244c90b6fbbe30c16ad55b` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:38.393961 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e412501-5c6a-47c1-9c36-5264d8e5d2a5 None admin] RBAC: Authorizing `identity:get_user(user_id=1a543813ca244c90b6fbbe30c16ad55b)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:38.397139 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e412501-5c6a-47c1-9c36-5264d8e5d2a5 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:38.398765 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 71/148] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Sep 9 16:17:38 2022] GET /identity/v3/users/1a543813ca244c90b6fbbe30c16ad55b => generated 247 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:17:38.402801 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e412501-5c6a-47c1-9c36-5264d8e5d2a5 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:38.448964 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a61e263-ae2d-4e47-8c3e-90ed949621e0 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:38.497388 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642fc78f-5e68-4ab6-b3fe-9f47401fb9f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:38.498025 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642fc78f-5e68-4ab6-b3fe-9f47401fb9f0 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:38.498296 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642fc78f-5e68-4ab6-b3fe-9f47401fb9f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:38.498592 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642fc78f-5e68-4ab6-b3fe-9f47401fb9f0 None admin] PATH_INFO: `/v3/users/f918acce5260406e8053172ddbf5a1fc` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:38.502999 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642fc78f-5e68-4ab6-b3fe-9f47401fb9f0 None admin] RBAC: Authorizing `identity:get_user(user_id=f918acce5260406e8053172ddbf5a1fc)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:38.504999 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642fc78f-5e68-4ab6-b3fe-9f47401fb9f0 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:38.507064 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 78/149] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Sep 9 16:17:38 2022] GET /identity/v3/users/f918acce5260406e8053172ddbf5a1fc => generated 275 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 16:17:38.507909 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642fc78f-5e68-4ab6-b3fe-9f47401fb9f0 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:38.576957 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:17:38.590586 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e412501-5c6a-47c1-9c36-5264d8e5d2a5 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:38.627494 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:17:38.631256 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642fc78f-5e68-4ab6-b3fe-9f47401fb9f0 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:38.635407 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53d0996-7a94-415e-af0c-6f8df25cb1fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:38.636315 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53d0996-7a94-415e-af0c-6f8df25cb1fb None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:38.636792 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53d0996-7a94-415e-af0c-6f8df25cb1fb None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:38.637267 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53d0996-7a94-415e-af0c-6f8df25cb1fb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:38.650635 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53d0996-7a94-415e-af0c-6f8df25cb1fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 16:17:38.657349 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-d53d0996-7a94-415e-af0c-6f8df25cb1fb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 16:17:38.657349 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:17:38.657349 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:17:38.657349 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:17:38.657349 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:17:38.657349 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:17:38.657349 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:17:38.657349 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:17:38.657349 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:17:38.657349 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:17:38.657349 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:17:38.657349 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:17:38.657349 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 16:17:38.657349 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 16:17:38.657349 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 16:17:38.657349 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 16:17:38.658185 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 16:17:38.658185 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 16:17:38.658185 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 16:17:38.658185 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 16:17:38.658185 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:17:38.658185 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:17:38.658185 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:17:38.658185 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:17:38.658185 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:17:38.658185 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:17:38.658185 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:17:38.658185 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Sep 09 16:17:38.658185 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:17:38.658185 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:17:38.658185 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:17:38.658185 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:17:38.658987 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:17:38.658987 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:17:38.658987 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:17:38.658987 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:17:38.658987 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 16:17:38.658987 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 16:17:38.658987 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 16:17:38.658987 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 16:17:38.658987 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 16:17:38.658987 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 16:17:38.658987 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 16:17:38.658987 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:17:38.662509 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 72/150] 10.222.0.27 () {56 vars in 1114 bytes} [Fri Sep 9 16:17:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:17:38.663534 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53d0996-7a94-415e-af0c-6f8df25cb1fb None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:38.674801 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd77ca1-66f4-4015-a942-eabae27618f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:38.675747 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd77ca1-66f4-4015-a942-eabae27618f3 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:38.676862 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd77ca1-66f4-4015-a942-eabae27618f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:38.677345 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd77ca1-66f4-4015-a942-eabae27618f3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:38.771346 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd77ca1-66f4-4015-a942-eabae27618f3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:38.773176 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd77ca1-66f4-4015-a942-eabae27618f3 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:38.787655 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53d0996-7a94-415e-af0c-6f8df25cb1fb None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:38.823142 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42ebcd7-ea54-4462-ab8d-41409a4ff7e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:38.824105 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42ebcd7-ea54-4462-ab8d-41409a4ff7e2 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:38.824593 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42ebcd7-ea54-4462-ab8d-41409a4ff7e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:38.825060 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42ebcd7-ea54-4462-ab8d-41409a4ff7e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:38.839221 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:17:38.903547 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:17:38.915711 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 79/151] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Sep 9 16:17:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 16:17:38.915711 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56094d0d-e5ce-4da9-ac84-528a7ecb18d0 None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:38.915711 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56094d0d-e5ce-4da9-ac84-528a7ecb18d0 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:38.915711 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56094d0d-e5ce-4da9-ac84-528a7ecb18d0 None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:38.915711 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 80/152] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:17:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:17:38.915711 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56094d0d-e5ce-4da9-ac84-528a7ecb18d0 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:38.922126 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42ebcd7-ea54-4462-ab8d-41409a4ff7e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:38.923777 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42ebcd7-ea54-4462-ab8d-41409a4ff7e2 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:39.032769 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 73/153] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Sep 9 16:17:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 16:17:39.033942 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42ebcd7-ea54-4462-ab8d-41409a4ff7e2 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:39.040669 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56094d0d-e5ce-4da9-ac84-528a7ecb18d0 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:39.076114 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7d8813-60fa-4a67-b106-c96121ca174e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:39.076723 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7d8813-60fa-4a67-b106-c96121ca174e None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:39.077002 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7d8813-60fa-4a67-b106-c96121ca174e None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:39.077261 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7d8813-60fa-4a67-b106-c96121ca174e None admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:39.077918 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7d8813-60fa-4a67-b106-c96121ca174e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:17:39.078212 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7d8813-60fa-4a67-b106-c96121ca174e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:39.079638 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7d8813-60fa-4a67-b106-c96121ca174e None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:39.092978 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 81/154] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Sep 9 16:17:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:17:39.092978 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce76428-6568-44b3-be15-f2273ad8dd75 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:39.092978 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce76428-6568-44b3-be15-f2273ad8dd75 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:39.092978 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce76428-6568-44b3-be15-f2273ad8dd75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:39.108604 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-9ce76428-6568-44b3-be15-f2273ad8dd75 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:17:39.109777 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-9ce76428-6568-44b3-be15-f2273ad8dd75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:17:39.120305 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:17:39.134817 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:17:39.144628 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42ebcd7-ea54-4462-ab8d-41409a4ff7e2 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:39.179203 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 82/155] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:17:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 16:17:39.180447 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67447c8-50ee-4c49-8416-9d2bce10d5ea None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:39.180727 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67447c8-50ee-4c49-8416-9d2bce10d5ea None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:39.180991 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67447c8-50ee-4c49-8416-9d2bce10d5ea None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:39.186704 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 83/156] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:17:39 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:17:39.187463 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67447c8-50ee-4c49-8416-9d2bce10d5ea None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:39.187582 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a579af-3d58-4319-b78e-43ac6176c183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:39.188386 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a579af-3d58-4319-b78e-43ac6176c183 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:39.188805 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a579af-3d58-4319-b78e-43ac6176c183 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:39.189216 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a579af-3d58-4319-b78e-43ac6176c183 None admin] PATH_INFO: `/v3/projects/adc7a18acd23477d80890d7a3477e7c9` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:39.190702 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a579af-3d58-4319-b78e-43ac6176c183 None admin] RBAC: Authorizing `identity:get_project(project_id=adc7a18acd23477d80890d7a3477e7c9)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:39.193199 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a579af-3d58-4319-b78e-43ac6176c183 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:39.195056 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 74/157] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Sep 9 16:17:39 2022] GET /identity/v3/projects/adc7a18acd23477d80890d7a3477e7c9 => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:17:39.195951 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a579af-3d58-4319-b78e-43ac6176c183 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:39.311926 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67447c8-50ee-4c49-8416-9d2bce10d5ea None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:39.333305 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a579af-3d58-4319-b78e-43ac6176c183 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:39.351266 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235127cb-01a1-40ad-aab5-3d233bfbc00a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:39.351917 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235127cb-01a1-40ad-aab5-3d233bfbc00a None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:39.352194 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235127cb-01a1-40ad-aab5-3d233bfbc00a None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:39.352463 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235127cb-01a1-40ad-aab5-3d233bfbc00a None admin] PATH_INFO: `/v3/projects/adc7a18acd23477d80890d7a3477e7c9` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:39.353628 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235127cb-01a1-40ad-aab5-3d233bfbc00a None admin] RBAC: Authorizing `identity:get_project(project_id=adc7a18acd23477d80890d7a3477e7c9)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:39.355121 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235127cb-01a1-40ad-aab5-3d233bfbc00a None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:39.356843 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 84/158] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Sep 9 16:17:39 2022] GET /identity/v3/projects/adc7a18acd23477d80890d7a3477e7c9 => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:17:39.358004 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f22f21-af41-47f5-8be6-4cf899038982 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:39.358283 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f22f21-af41-47f5-8be6-4cf899038982 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:39.358570 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f22f21-af41-47f5-8be6-4cf899038982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:39.376440 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-60f22f21-af41-47f5-8be6-4cf899038982 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:17:39.377745 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-60f22f21-af41-47f5-8be6-4cf899038982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:17:39.381267 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870a0d6e-4eb5-4179-85ab-ec089f5942da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:39.382157 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870a0d6e-4eb5-4179-85ab-ec089f5942da None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:39.382706 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870a0d6e-4eb5-4179-85ab-ec089f5942da None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:39.383171 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870a0d6e-4eb5-4179-85ab-ec089f5942da None admin] PATH_INFO: `/v3/users/f918acce5260406e8053172ddbf5a1fc` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:39.384555 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870a0d6e-4eb5-4179-85ab-ec089f5942da None admin] RBAC: Authorizing `identity:get_user(user_id=f918acce5260406e8053172ddbf5a1fc)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:39.386060 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:17:39.386648 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870a0d6e-4eb5-4179-85ab-ec089f5942da None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:39.388809 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 75/159] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Sep 9 16:17:39 2022] GET /identity/v3/users/f918acce5260406e8053172ddbf5a1fc => generated 275 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:17:39.389939 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870a0d6e-4eb5-4179-85ab-ec089f5942da None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:39.425378 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:17:39.474501 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 85/160] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:17:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 16:17:39.474501 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f22f21-af41-47f5-8be6-4cf899038982 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:39.514926 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870a0d6e-4eb5-4179-85ab-ec089f5942da None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:39.550074 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326a6840-76d6-420c-abfb-086eaa19be00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:39.550699 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326a6840-76d6-420c-abfb-086eaa19be00 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:39.550996 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326a6840-76d6-420c-abfb-086eaa19be00 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:39.551264 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326a6840-76d6-420c-abfb-086eaa19be00 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:39.551967 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326a6840-76d6-420c-abfb-086eaa19be00 None admin] RBAC: Adding query filter params (role.id=0a36d1be416f4089be19be979943b731, scope.project.id=adc7a18acd23477d80890d7a3477e7c9, user.id=1a543813ca244c90b6fbbe30c16ad55b) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:17:39.552267 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326a6840-76d6-420c-abfb-086eaa19be00 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:39.553693 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326a6840-76d6-420c-abfb-086eaa19be00 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:39.559832 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 76/161] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Sep 9 16:17:39 2022] GET /identity/v3/role_assignments?user.id=1a543813ca244c90b6fbbe30c16ad55b&scope.project.id=adc7a18acd23477d80890d7a3477e7c9&role.id=0a36d1be416f4089be19be979943b731 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:17:39.565784 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326a6840-76d6-420c-abfb-086eaa19be00 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:39.595341 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f22f21-af41-47f5-8be6-4cf899038982 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:39.634098 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e8473f-20b4-4bed-be5f-9a6823511a7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:39.635087 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e8473f-20b4-4bed-be5f-9a6823511a7f None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:39.635595 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e8473f-20b4-4bed-be5f-9a6823511a7f None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:39.636076 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e8473f-20b4-4bed-be5f-9a6823511a7f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:39.637006 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e8473f-20b4-4bed-be5f-9a6823511a7f None admin] RBAC: Adding query filter params (role.id=b38e84bf077846ee802e6bb1bad83522, scope.project.id=adc7a18acd23477d80890d7a3477e7c9, user.id=f918acce5260406e8053172ddbf5a1fc) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:17:39.637512 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e8473f-20b4-4bed-be5f-9a6823511a7f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:39.639325 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e8473f-20b4-4bed-be5f-9a6823511a7f None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:39.647290 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 86/162] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Sep 9 16:17:39 2022] GET /identity/v3/role_assignments?user.id=f918acce5260406e8053172ddbf5a1fc&scope.project.id=adc7a18acd23477d80890d7a3477e7c9&role.id=b38e84bf077846ee802e6bb1bad83522 => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:17:39.649352 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ae4cd1-2e97-4b14-a8b8-8e3dfa511be8 None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:39.649941 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ae4cd1-2e97-4b14-a8b8-8e3dfa511be8 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:39.650593 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ae4cd1-2e97-4b14-a8b8-8e3dfa511be8 None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:39.652501 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 87/163] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:17:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:17:39.653865 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ae4cd1-2e97-4b14-a8b8-8e3dfa511be8 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:39.672311 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:17:39.727929 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:17:39.749572 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326a6840-76d6-420c-abfb-086eaa19be00 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:39.796022 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ae4cd1-2e97-4b14-a8b8-8e3dfa511be8 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:39.801467 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd48236-bcd0-40ce-9d7b-560de1ad567f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:39.802106 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd48236-bcd0-40ce-9d7b-560de1ad567f None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:39.803282 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd48236-bcd0-40ce-9d7b-560de1ad567f None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:39.803282 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd48236-bcd0-40ce-9d7b-560de1ad567f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:39.848670 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedf44c8-04a9-4207-9ef7-8935bc2fea42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:39.849688 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedf44c8-04a9-4207-9ef7-8935bc2fea42 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:39.853329 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedf44c8-04a9-4207-9ef7-8935bc2fea42 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:39.853329 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedf44c8-04a9-4207-9ef7-8935bc2fea42 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:39.854507 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedf44c8-04a9-4207-9ef7-8935bc2fea42 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:39.856026 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedf44c8-04a9-4207-9ef7-8935bc2fea42 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:39.858918 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 88/164] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 16:17:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:17:39.859082 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e681357-2077-40a0-96eb-33a31aec19d6 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:39.859894 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e681357-2077-40a0-96eb-33a31aec19d6 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:39.859894 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e681357-2077-40a0-96eb-33a31aec19d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:39.881557 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-5e681357-2077-40a0-96eb-33a31aec19d6 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:17:39.883556 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-5e681357-2077-40a0-96eb-33a31aec19d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:17:39.902436 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd48236-bcd0-40ce-9d7b-560de1ad567f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:39.903871 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd48236-bcd0-40ce-9d7b-560de1ad567f None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:39.959639 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 89/165] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:17:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 16:17:39.960926 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e681357-2077-40a0-96eb-33a31aec19d6 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:39.964140 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:17:40.016475 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:17:40.027696 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 77/166] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Sep 9 16:17:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 16:17:40.032718 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd48236-bcd0-40ce-9d7b-560de1ad567f None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:40.086491 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e681357-2077-40a0-96eb-33a31aec19d6 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:40.130110 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3820e41e-b8c8-42a3-93ea-ffdfa3b1b0d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:40.131024 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3820e41e-b8c8-42a3-93ea-ffdfa3b1b0d6 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:40.131440 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3820e41e-b8c8-42a3-93ea-ffdfa3b1b0d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:40.131949 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3820e41e-b8c8-42a3-93ea-ffdfa3b1b0d6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:40.135147 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd48236-bcd0-40ce-9d7b-560de1ad567f None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:40.142769 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3820e41e-b8c8-42a3-93ea-ffdfa3b1b0d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 16:17:40.148173 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-3820e41e-b8c8-42a3-93ea-ffdfa3b1b0d6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 16:17:40.148173 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:17:40.148173 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:17:40.148173 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:17:40.148173 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:17:40.148173 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:17:40.148173 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:17:40.148173 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:17:40.148173 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:17:40.148173 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:17:40.148173 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:17:40.148173 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:17:40.148173 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 16:17:40.148173 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 16:17:40.148173 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 16:17:40.148173 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 16:17:40.149419 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 16:17:40.149419 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 16:17:40.149419 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 16:17:40.149419 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 16:17:40.149419 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:17:40.149419 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:17:40.149419 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:17:40.149419 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:17:40.149419 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:17:40.149419 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:17:40.149419 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:17:40.149419 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 16:17:40.149419 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:17:40.149419 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:17:40.149419 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:17:40.149419 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:17:40.150333 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:17:40.150333 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:17:40.150333 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:17:40.150333 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:17:40.150333 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 16:17:40.150333 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 16:17:40.150333 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 16:17:40.150333 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 16:17:40.150333 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 16:17:40.150333 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 16:17:40.150333 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 16:17:40.150333 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 16:17:40.152341 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 90/167] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Sep 9 16:17:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:17:40.153421 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3820e41e-b8c8-42a3-93ea-ffdfa3b1b0d6 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:40.177546 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e86999-5786-418a-8b6b-af4bd9e836fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:40.178158 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e86999-5786-418a-8b6b-af4bd9e836fc None admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:40.178467 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e86999-5786-418a-8b6b-af4bd9e836fc None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:40.178740 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e86999-5786-418a-8b6b-af4bd9e836fc None admin] PATH_INFO: `/v3/users` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:40.179405 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e86999-5786-418a-8b6b-af4bd9e836fc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:40.180842 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e86999-5786-418a-8b6b-af4bd9e836fc None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:40.203839 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 78/168] 10.222.0.27 () {60 vars in 1132 bytes} [Fri Sep 9 16:17:40 2022] POST /identity/v3/users => generated 283 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:17:40.204684 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e86999-5786-418a-8b6b-af4bd9e836fc None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:40.237345 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:17:40.263733 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:17:40.281672 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3820e41e-b8c8-42a3-93ea-ffdfa3b1b0d6 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:40.323574 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29488f3-31cb-4368-8d6f-bec4865b2e8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:40.324227 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29488f3-31cb-4368-8d6f-bec4865b2e8d None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:40.324471 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29488f3-31cb-4368-8d6f-bec4865b2e8d None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:40.324743 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29488f3-31cb-4368-8d6f-bec4865b2e8d None admin] PATH_INFO: `/v3/projects/adc7a18acd23477d80890d7a3477e7c9` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:40.325852 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29488f3-31cb-4368-8d6f-bec4865b2e8d None admin] RBAC: Authorizing `identity:get_project(project_id=adc7a18acd23477d80890d7a3477e7c9)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:40.327332 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29488f3-31cb-4368-8d6f-bec4865b2e8d None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:40.329189 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 91/169] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Sep 9 16:17:40 2022] GET /identity/v3/projects/adc7a18acd23477d80890d7a3477e7c9 => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:17:40.334467 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e86999-5786-418a-8b6b-af4bd9e836fc None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:40.335412 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29488f3-31cb-4368-8d6f-bec4865b2e8d None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:40.374957 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b9a3e1-41a8-4f64-aed3-b824f397e802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:40.375965 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b9a3e1-41a8-4f64-aed3-b824f397e802 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:40.376468 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b9a3e1-41a8-4f64-aed3-b824f397e802 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:40.376939 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b9a3e1-41a8-4f64-aed3-b824f397e802 None admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:40.377909 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b9a3e1-41a8-4f64-aed3-b824f397e802 None admin] RBAC: Adding query filter params (name=member) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:17:40.378469 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b9a3e1-41a8-4f64-aed3-b824f397e802 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:40.380171 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b9a3e1-41a8-4f64-aed3-b824f397e802 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:40.391937 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 79/170] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Sep 9 16:17:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:17:40.392787 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b9a3e1-41a8-4f64-aed3-b824f397e802 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:40.452427 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29488f3-31cb-4368-8d6f-bec4865b2e8d None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:40.492556 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:17:40.499438 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b262c9dc-c6ea-45c8-a073-a117a2fa23f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:40.500113 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b262c9dc-c6ea-45c8-a073-a117a2fa23f9 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:40.500393 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b262c9dc-c6ea-45c8-a073-a117a2fa23f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:40.500666 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b262c9dc-c6ea-45c8-a073-a117a2fa23f9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:40.515438 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b262c9dc-c6ea-45c8-a073-a117a2fa23f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 16:17:40.515928 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b9a3e1-41a8-4f64-aed3-b824f397e802 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:40.520354 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-b262c9dc-c6ea-45c8-a073-a117a2fa23f9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 16:17:40.520354 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:17:40.520354 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:17:40.520354 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:17:40.520354 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:17:40.520354 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:17:40.520354 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:17:40.520354 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:17:40.520354 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:17:40.520354 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:17:40.520354 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:17:40.520354 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:17:40.520354 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 16:17:40.520354 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 16:17:40.520354 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 16:17:40.520354 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 16:17:40.521304 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 16:17:40.521304 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 16:17:40.521304 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 16:17:40.521304 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 16:17:40.521304 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:17:40.521304 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:17:40.521304 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:17:40.521304 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:17:40.521304 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:17:40.521304 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:17:40.521304 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:17:40.521304 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 16:17:40.521304 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:17:40.521304 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:17:40.521304 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:17:40.521304 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:17:40.522065 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:17:40.522065 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:17:40.522065 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:17:40.522065 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:17:40.522065 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 16:17:40.522065 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 16:17:40.522065 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 16:17:40.522065 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 16:17:40.522065 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 16:17:40.522065 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 16:17:40.522065 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 16:17:40.522065 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 16:17:40.522065 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 92/171] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Sep 9 16:17:40 2022] GET /identity/v3/roles/reader => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:17:40.523326 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b262c9dc-c6ea-45c8-a073-a117a2fa23f9 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:40.531900 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:17:40.559169 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379e3eb9-407a-420c-b947-d8d17ce94244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:40.559781 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379e3eb9-407a-420c-b947-d8d17ce94244 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:40.560063 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379e3eb9-407a-420c-b947-d8d17ce94244 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:40.560339 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379e3eb9-407a-420c-b947-d8d17ce94244 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:40.561062 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379e3eb9-407a-420c-b947-d8d17ce94244 None admin] RBAC: Adding query filter params (role.id=9452afb4ffe54eb7b7b5b0aff7dd00ed, scope.project.id=adc7a18acd23477d80890d7a3477e7c9, user.id=f918acce5260406e8053172ddbf5a1fc) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:17:40.561369 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379e3eb9-407a-420c-b947-d8d17ce94244 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:40.562862 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379e3eb9-407a-420c-b947-d8d17ce94244 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:40.571260 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 80/172] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Sep 9 16:17:40 2022] GET /identity/v3/role_assignments?user.id=f918acce5260406e8053172ddbf5a1fc&scope.project.id=adc7a18acd23477d80890d7a3477e7c9&role.id=9452afb4ffe54eb7b7b5b0aff7dd00ed => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:17:40.574539 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379e3eb9-407a-420c-b947-d8d17ce94244 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:40.669879 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b262c9dc-c6ea-45c8-a073-a117a2fa23f9 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:40.716276 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379e3eb9-407a-420c-b947-d8d17ce94244 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:40.722177 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d53b46c-515e-4be4-a1ea-f79b2ed56745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:40.722964 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d53b46c-515e-4be4-a1ea-f79b2ed56745 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:40.723294 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d53b46c-515e-4be4-a1ea-f79b2ed56745 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:40.724567 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d53b46c-515e-4be4-a1ea-f79b2ed56745 None admin] PATH_INFO: `/v3/users/f918acce5260406e8053172ddbf5a1fc` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:40.726040 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d53b46c-515e-4be4-a1ea-f79b2ed56745 None admin] RBAC: Authorizing `identity:get_user(user_id=f918acce5260406e8053172ddbf5a1fc)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:40.727603 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d53b46c-515e-4be4-a1ea-f79b2ed56745 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:40.729489 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 93/173] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Sep 9 16:17:40 2022] GET /identity/v3/users/f918acce5260406e8053172ddbf5a1fc => generated 275 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:17:40.734915 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d53b46c-515e-4be4-a1ea-f79b2ed56745 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:40.774280 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956e3f70-e7d7-4502-b57d-6bb661e20ca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:40.775233 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956e3f70-e7d7-4502-b57d-6bb661e20ca4 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:40.775761 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956e3f70-e7d7-4502-b57d-6bb661e20ca4 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:40.776371 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956e3f70-e7d7-4502-b57d-6bb661e20ca4 None admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:40.778052 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956e3f70-e7d7-4502-b57d-6bb661e20ca4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:17:40.778696 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956e3f70-e7d7-4502-b57d-6bb661e20ca4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:40.780389 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956e3f70-e7d7-4502-b57d-6bb661e20ca4 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:40.791997 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 81/174] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Sep 9 16:17:40 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:17:40.797779 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956e3f70-e7d7-4502-b57d-6bb661e20ca4 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:40.830810 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:17:40.853876 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:17:40.896414 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d53b46c-515e-4be4-a1ea-f79b2ed56745 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:40.937548 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956e3f70-e7d7-4502-b57d-6bb661e20ca4 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:40.947542 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e4b51a-3452-42f2-8ece-3b05777736e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:40.948902 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e4b51a-3452-42f2-8ece-3b05777736e8 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:40.949397 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e4b51a-3452-42f2-8ece-3b05777736e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:40.950157 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e4b51a-3452-42f2-8ece-3b05777736e8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:40.980690 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ce04ed-d103-49fa-a191-31cc9d3d2436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:40.981776 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ce04ed-d103-49fa-a191-31cc9d3d2436 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:40.982259 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ce04ed-d103-49fa-a191-31cc9d3d2436 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:40.982759 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ce04ed-d103-49fa-a191-31cc9d3d2436 None admin] PATH_INFO: `/v3/users/d8809ae0c3934322983d8c64c4590844` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:40.984296 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ce04ed-d103-49fa-a191-31cc9d3d2436 None admin] RBAC: Authorizing `identity:get_user(user_id=d8809ae0c3934322983d8c64c4590844)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:40.985943 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ce04ed-d103-49fa-a191-31cc9d3d2436 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:40.988388 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 82/175] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Sep 9 16:17:40 2022] GET /identity/v3/users/d8809ae0c3934322983d8c64c4590844 => generated 289 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 16:17:40.994776 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ce04ed-d103-49fa-a191-31cc9d3d2436 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:41.023836 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e4b51a-3452-42f2-8ece-3b05777736e8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:41.025491 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e4b51a-3452-42f2-8ece-3b05777736e8 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:41.099609 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:17:41.108084 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ce04ed-d103-49fa-a191-31cc9d3d2436 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:41.112352 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:17:41.146536 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5911ef-f5de-442f-9c0a-94c7f32d32f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:41.147524 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5911ef-f5de-442f-9c0a-94c7f32d32f3 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:41.148004 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5911ef-f5de-442f-9c0a-94c7f32d32f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:41.148476 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5911ef-f5de-442f-9c0a-94c7f32d32f3 None admin] PATH_INFO: `/v3/projects/adc7a18acd23477d80890d7a3477e7c9` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:41.149840 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5911ef-f5de-442f-9c0a-94c7f32d32f3 None admin] RBAC: Authorizing `identity:get_project(project_id=adc7a18acd23477d80890d7a3477e7c9)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:41.151841 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5911ef-f5de-442f-9c0a-94c7f32d32f3 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:41.154028 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 83/176] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Sep 9 16:17:40 2022] GET /identity/v3/projects/adc7a18acd23477d80890d7a3477e7c9 => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:17:41.160054 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5911ef-f5de-442f-9c0a-94c7f32d32f3 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:41.178290 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 94/177] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Sep 9 16:17:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 09 16:17:41.184318 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e4b51a-3452-42f2-8ece-3b05777736e8 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:41.270514 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5911ef-f5de-442f-9c0a-94c7f32d32f3 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:41.308713 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e4b51a-3452-42f2-8ece-3b05777736e8 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:41.311176 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7d4e1e-332e-44d0-a33c-e4628fc8fae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:41.312187 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7d4e1e-332e-44d0-a33c-e4628fc8fae4 None admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:41.312696 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7d4e1e-332e-44d0-a33c-e4628fc8fae4 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:41.313179 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7d4e1e-332e-44d0-a33c-e4628fc8fae4 None admin] PATH_INFO: `/v3/projects/adc7a18acd23477d80890d7a3477e7c9/users/d8809ae0c3934322983d8c64c4590844/roles/99ea656aad1b4b0c990db50b9b878b90` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:41.315380 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7d4e1e-332e-44d0-a33c-e4628fc8fae4 None admin] RBAC: Authorizing `identity:create_grant(project_id=adc7a18acd23477d80890d7a3477e7c9, user_id=d8809ae0c3934322983d8c64c4590844, role_id=99ea656aad1b4b0c990db50b9b878b90)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:41.317225 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7d4e1e-332e-44d0-a33c-e4628fc8fae4 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:41.350777 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 84/178] 10.222.0.27 () {58 vars in 1439 bytes} [Fri Sep 9 16:17:41 2022] PUT /identity/v3/projects/adc7a18acd23477d80890d7a3477e7c9/users/d8809ae0c3934322983d8c64c4590844/roles/99ea656aad1b4b0c990db50b9b878b90 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 16:17:41.367833 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcf13c7-d644-4847-b07f-d87f3719b180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:41.369904 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcf13c7-d644-4847-b07f-d87f3719b180 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:41.370436 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcf13c7-d644-4847-b07f-d87f3719b180 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:41.370959 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcf13c7-d644-4847-b07f-d87f3719b180 None admin] PATH_INFO: `/v3/projects/8291a701a38f4f9cb1ff7085d155aedb` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:41.372470 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcf13c7-d644-4847-b07f-d87f3719b180 None admin] RBAC: Authorizing `identity:get_project(project_id=8291a701a38f4f9cb1ff7085d155aedb)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:41.374290 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcf13c7-d644-4847-b07f-d87f3719b180 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:41.376304 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 95/179] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Sep 9 16:17:41 2022] GET /identity/v3/projects/8291a701a38f4f9cb1ff7085d155aedb => generated 312 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 16:17:41.385336 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7d4e1e-332e-44d0-a33c-e4628fc8fae4 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:41.442204 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:17:41.508152 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7d4e1e-332e-44d0-a33c-e4628fc8fae4 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:41.543969 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5994c47-1264-4583-9e5e-320032e94b55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:41.544597 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5994c47-1264-4583-9e5e-320032e94b55 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:41.544887 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5994c47-1264-4583-9e5e-320032e94b55 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:41.545212 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5994c47-1264-4583-9e5e-320032e94b55 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:41.546027 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5994c47-1264-4583-9e5e-320032e94b55 None admin] RBAC: Adding query filter params (role.id=b38e84bf077846ee802e6bb1bad83522, scope.project.id=8291a701a38f4f9cb1ff7085d155aedb, user.id=f918acce5260406e8053172ddbf5a1fc) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:17:41.546374 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5994c47-1264-4583-9e5e-320032e94b55 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:41.547947 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5994c47-1264-4583-9e5e-320032e94b55 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:41.555321 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 85/180] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Sep 9 16:17:41 2022] GET /identity/v3/role_assignments?user.id=f918acce5260406e8053172ddbf5a1fc&scope.project.id=8291a701a38f4f9cb1ff7085d155aedb&role.id=b38e84bf077846ee802e6bb1bad83522 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:17:42.751449 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc3ff28-c7eb-4e36-b1ba-27864f5b47bb None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:42.751992 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc3ff28-c7eb-4e36-b1ba-27864f5b47bb None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:42.751992 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc3ff28-c7eb-4e36-b1ba-27864f5b47bb None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:42.753576 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 96/181] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:17:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:17:42.759003 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05486857-23de-4e86-852f-d529745caf0b None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:42.759457 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05486857-23de-4e86-852f-d529745caf0b None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:42.759534 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05486857-23de-4e86-852f-d529745caf0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:42.783422 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-05486857-23de-4e86-852f-d529745caf0b None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:17:42.784620 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-05486857-23de-4e86-852f-d529745caf0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:17:42.855180 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 86/182] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:17:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 16:17:43.125512 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc3ff28-c7eb-4e36-b1ba-27864f5b47bb None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:43.156544 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:17:43.236349 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc3ff28-c7eb-4e36-b1ba-27864f5b47bb None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:43.247260 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a63cd64-e9da-4814-8e2d-f6f7f63c2e52 None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:43.247544 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a63cd64-e9da-4814-8e2d-f6f7f63c2e52 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:43.247822 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a63cd64-e9da-4814-8e2d-f6f7f63c2e52 None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:43.249154 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 87/183] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:17:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 16:17:43.254405 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11e7063-9f24-47ed-85ff-446e4e912ad4 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:43.254685 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11e7063-9f24-47ed-85ff-446e4e912ad4 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:43.254955 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11e7063-9f24-47ed-85ff-446e4e912ad4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:43.272490 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff58264-f5fb-45b3-99a7-caa7a99b1c64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:43.273468 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff58264-f5fb-45b3-99a7-caa7a99b1c64 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:43.273727 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-d11e7063-9f24-47ed-85ff-446e4e912ad4 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:17:43.274105 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff58264-f5fb-45b3-99a7-caa7a99b1c64 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:43.274574 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff58264-f5fb-45b3-99a7-caa7a99b1c64 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:43.275011 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-d11e7063-9f24-47ed-85ff-446e4e912ad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:17:43.293771 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff58264-f5fb-45b3-99a7-caa7a99b1c64 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 16:17:43.298659 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-2ff58264-f5fb-45b3-99a7-caa7a99b1c64 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 16:17:43.298659 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:17:43.298659 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:17:43.298659 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:17:43.298659 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:17:43.298659 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:17:43.298659 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:17:43.298659 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:17:43.298659 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:17:43.298659 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:17:43.298659 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:17:43.298659 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:17:43.298659 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 16:17:43.298659 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 16:17:43.298659 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 16:17:43.298659 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 16:17:43.299535 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 16:17:43.299535 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 16:17:43.299535 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 16:17:43.299535 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 16:17:43.299535 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:17:43.299535 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:17:43.299535 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:17:43.299535 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:17:43.299535 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:17:43.299535 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:17:43.299535 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:17:43.299535 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 16:17:43.299535 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:17:43.299535 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:17:43.299535 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:17:43.299535 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:17:43.300304 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:17:43.300304 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:17:43.300304 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:17:43.300304 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:17:43.300304 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 16:17:43.300304 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 16:17:43.300304 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 16:17:43.300304 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 16:17:43.300304 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 16:17:43.300304 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 16:17:43.300304 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 16:17:43.300304 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 16:17:43.300304 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 97/184] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Sep 9 16:17:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:17:43.302052 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9539af8b-7521-450c-84de-955db66cce2f None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:43.302052 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9539af8b-7521-450c-84de-955db66cce2f None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:43.302328 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9539af8b-7521-450c-84de-955db66cce2f None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:43.303726 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 98/185] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:17:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:17:43.305126 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:17:43.307148 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9539af8b-7521-450c-84de-955db66cce2f None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:43.355973 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 88/186] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:17:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 16:17:43.357222 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e64966-0a58-47b4-a918-76df64b2ad0c None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:43.357510 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e64966-0a58-47b4-a918-76df64b2ad0c None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:43.357787 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e64966-0a58-47b4-a918-76df64b2ad0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:43.376266 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-78e64966-0a58-47b4-a918-76df64b2ad0c None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:17:43.377422 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-78e64966-0a58-47b4-a918-76df64b2ad0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:17:43.412931 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:17:43.432847 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9539af8b-7521-450c-84de-955db66cce2f None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:43.447359 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 89/187] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:17:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 16:17:43.473642 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd1eb17-5a56-42cf-a7fe-884ab85d4042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:43.474628 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd1eb17-5a56-42cf-a7fe-884ab85d4042 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:43.475110 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd1eb17-5a56-42cf-a7fe-884ab85d4042 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:43.475586 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd1eb17-5a56-42cf-a7fe-884ab85d4042 None admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:43.476430 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd1eb17-5a56-42cf-a7fe-884ab85d4042 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:17:43.476943 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd1eb17-5a56-42cf-a7fe-884ab85d4042 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:43.478558 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd1eb17-5a56-42cf-a7fe-884ab85d4042 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:43.487218 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 99/188] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Sep 9 16:17:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:17:43.495700 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e64966-0a58-47b4-a918-76df64b2ad0c None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:43.581070 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:17:43.596314 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e64966-0a58-47b4-a918-76df64b2ad0c None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:43.630868 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1609f5a1-be4e-4a6d-aeaa-ce320e2027fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:43.631429 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1609f5a1-be4e-4a6d-aeaa-ce320e2027fc None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:43.631705 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1609f5a1-be4e-4a6d-aeaa-ce320e2027fc None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:43.631972 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1609f5a1-be4e-4a6d-aeaa-ce320e2027fc None admin] PATH_INFO: `/v3/users/d09a36ad33b04e669d6f3e59cefcc108` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:43.646107 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1609f5a1-be4e-4a6d-aeaa-ce320e2027fc None admin] RBAC: Authorizing `identity:get_user(user_id=d09a36ad33b04e669d6f3e59cefcc108)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:43.647608 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1609f5a1-be4e-4a6d-aeaa-ce320e2027fc None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:43.649399 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 90/189] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Sep 9 16:17:43 2022] GET /identity/v3/users/d09a36ad33b04e669d6f3e59cefcc108 => generated 283 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:17:43.650379 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd1eb17-5a56-42cf-a7fe-884ab85d4042 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:43.656961 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1609f5a1-be4e-4a6d-aeaa-ce320e2027fc None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:43.769354 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd1eb17-5a56-42cf-a7fe-884ab85d4042 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:43.791546 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1609f5a1-be4e-4a6d-aeaa-ce320e2027fc None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:43.803554 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75712c75-a8ce-4334-896c-d5f60202aa7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:43.804184 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75712c75-a8ce-4334-896c-d5f60202aa7e None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:43.804459 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75712c75-a8ce-4334-896c-d5f60202aa7e None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:43.804772 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75712c75-a8ce-4334-896c-d5f60202aa7e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:43.819996 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75712c75-a8ce-4334-896c-d5f60202aa7e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 16:17:43.825249 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-75712c75-a8ce-4334-896c-d5f60202aa7e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 16:17:43.825249 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:17:43.825249 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:17:43.825249 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:17:43.825249 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:17:43.825249 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:17:43.825249 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:17:43.825249 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:17:43.825249 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:17:43.825249 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:17:43.825249 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:17:43.825249 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:17:43.825249 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 16:17:43.825249 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 16:17:43.825249 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 16:17:43.825249 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 16:17:43.826127 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 16:17:43.826127 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 16:17:43.826127 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 16:17:43.826127 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 16:17:43.826127 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:17:43.826127 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:17:43.826127 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:17:43.826127 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:17:43.826127 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:17:43.826127 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:17:43.826127 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:17:43.826127 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 16:17:43.826127 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:17:43.826127 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:17:43.826127 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:17:43.826127 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:17:43.831315 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:17:43.831315 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:17:43.831315 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:17:43.831315 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:17:43.831315 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 16:17:43.831315 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 16:17:43.831315 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 16:17:43.831315 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 16:17:43.831315 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 16:17:43.831315 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 16:17:43.831315 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 16:17:43.831315 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 16:17:43.831315 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 100/190] 10.222.0.27 () {56 vars in 1114 bytes} [Fri Sep 9 16:17:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:17:43.831315 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75712c75-a8ce-4334-896c-d5f60202aa7e None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:43.836923 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9251f4c9-2527-4a8c-8fc7-dee289ba6efb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:43.837538 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9251f4c9-2527-4a8c-8fc7-dee289ba6efb None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:43.837811 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9251f4c9-2527-4a8c-8fc7-dee289ba6efb None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:43.838076 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9251f4c9-2527-4a8c-8fc7-dee289ba6efb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:43.843908 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:17:43.853978 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:17:43.906110 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9251f4c9-2527-4a8c-8fc7-dee289ba6efb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:43.907526 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9251f4c9-2527-4a8c-8fc7-dee289ba6efb None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:43.932431 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75712c75-a8ce-4334-896c-d5f60202aa7e None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:43.965673 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a0e2db-99dd-45d8-87b6-1f04041a273f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:43.966312 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a0e2db-99dd-45d8-87b6-1f04041a273f None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:43.966608 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a0e2db-99dd-45d8-87b6-1f04041a273f None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:43.966885 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a0e2db-99dd-45d8-87b6-1f04041a273f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:43.967998 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a0e2db-99dd-45d8-87b6-1f04041a273f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:43.969430 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a0e2db-99dd-45d8-87b6-1f04041a273f None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:43.971008 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 101/191] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 16:17:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:17:43.971765 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a0e2db-99dd-45d8-87b6-1f04041a273f None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:44.015221 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 91/192] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Sep 9 16:17:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 09 16:17:44.015221 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c971f85-a3aa-4a2c-bf99-76d8c299f2a4 None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:44.015221 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c971f85-a3aa-4a2c-bf99-76d8c299f2a4 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:44.015221 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c971f85-a3aa-4a2c-bf99-76d8c299f2a4 None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:44.015221 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 92/193] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:17:44 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:17:44.015221 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c971f85-a3aa-4a2c-bf99-76d8c299f2a4 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:44.049909 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:17:44.061136 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:17:44.072435 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a0e2db-99dd-45d8-87b6-1f04041a273f None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:44.106367 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94107be0-2dd8-495f-9ec0-6f1c8ad26835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:44.106970 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94107be0-2dd8-495f-9ec0-6f1c8ad26835 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:44.107240 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94107be0-2dd8-495f-9ec0-6f1c8ad26835 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:44.107505 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94107be0-2dd8-495f-9ec0-6f1c8ad26835 None admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:44.108152 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94107be0-2dd8-495f-9ec0-6f1c8ad26835 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:17:44.108448 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94107be0-2dd8-495f-9ec0-6f1c8ad26835 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:44.109821 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94107be0-2dd8-495f-9ec0-6f1c8ad26835 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:44.117527 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 102/194] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Sep 9 16:17:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:17:44.118409 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94107be0-2dd8-495f-9ec0-6f1c8ad26835 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:44.119631 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c971f85-a3aa-4a2c-bf99-76d8c299f2a4 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:44.153773 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583d8ccb-8f7d-42e7-bf84-a9ff187548f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:44.154396 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583d8ccb-8f7d-42e7-bf84-a9ff187548f3 None admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:44.154667 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583d8ccb-8f7d-42e7-bf84-a9ff187548f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:44.154933 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583d8ccb-8f7d-42e7-bf84-a9ff187548f3 None admin] PATH_INFO: `/v3/users` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:44.155565 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583d8ccb-8f7d-42e7-bf84-a9ff187548f3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:44.157034 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583d8ccb-8f7d-42e7-bf84-a9ff187548f3 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:44.178166 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 93/195] 10.222.0.27 () {60 vars in 1132 bytes} [Fri Sep 9 16:17:44 2022] POST /identity/v3/users => generated 297 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:17:44.179620 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f51839f-6fe0-4ae6-a98c-e7e3b5229d3e None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:44.179903 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f51839f-6fe0-4ae6-a98c-e7e3b5229d3e None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:44.180171 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f51839f-6fe0-4ae6-a98c-e7e3b5229d3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:44.200159 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-7f51839f-6fe0-4ae6-a98c-e7e3b5229d3e None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:17:44.201372 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-7f51839f-6fe0-4ae6-a98c-e7e3b5229d3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:17:44.229381 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94107be0-2dd8-495f-9ec0-6f1c8ad26835 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:44.269453 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625b6d26-c14c-42cf-8464-441c16310f0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:44.270231 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625b6d26-c14c-42cf-8464-441c16310f0c None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:44.270592 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625b6d26-c14c-42cf-8464-441c16310f0c None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:44.270868 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625b6d26-c14c-42cf-8464-441c16310f0c None admin] PATH_INFO: `/v3/projects/b42bed1e233c4e71a1ec8ca3ae42c433` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:44.272332 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625b6d26-c14c-42cf-8464-441c16310f0c None admin] RBAC: Authorizing `identity:get_project(project_id=b42bed1e233c4e71a1ec8ca3ae42c433)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:44.273609 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625b6d26-c14c-42cf-8464-441c16310f0c None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:44.280819 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 103/196] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Sep 9 16:17:44 2022] GET /identity/v3/projects/b42bed1e233c4e71a1ec8ca3ae42c433 => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:17:44.280819 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625b6d26-c14c-42cf-8464-441c16310f0c None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:44.281080 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 94/197] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:17:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 16:17:44.281647 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f51839f-6fe0-4ae6-a98c-e7e3b5229d3e None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:44.303167 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:17:44.334293 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:17:44.413860 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625b6d26-c14c-42cf-8464-441c16310f0c None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:44.422229 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f51839f-6fe0-4ae6-a98c-e7e3b5229d3e None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:44.459051 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab808fbe-4a44-41a9-a863-07f93da429e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:44.459797 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab808fbe-4a44-41a9-a863-07f93da429e9 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:44.460077 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab808fbe-4a44-41a9-a863-07f93da429e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:44.460349 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab808fbe-4a44-41a9-a863-07f93da429e9 None admin] PATH_INFO: `/v3/users/d09a36ad33b04e669d6f3e59cefcc108` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:44.461666 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab808fbe-4a44-41a9-a863-07f93da429e9 None admin] RBAC: Authorizing `identity:get_user(user_id=d09a36ad33b04e669d6f3e59cefcc108)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:44.463543 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab808fbe-4a44-41a9-a863-07f93da429e9 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:44.463799 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8e5c55-df4c-44d3-9cfb-579c496dc0e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:44.464404 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8e5c55-df4c-44d3-9cfb-579c496dc0e6 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:44.464679 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8e5c55-df4c-44d3-9cfb-579c496dc0e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:44.464949 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8e5c55-df4c-44d3-9cfb-579c496dc0e6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:44.465664 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8e5c55-df4c-44d3-9cfb-579c496dc0e6 None admin] RBAC: Adding query filter params (role.id=0a36d1be416f4089be19be979943b731, scope.project.id=b42bed1e233c4e71a1ec8ca3ae42c433, user.id=d09a36ad33b04e669d6f3e59cefcc108) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:17:44.465965 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8e5c55-df4c-44d3-9cfb-579c496dc0e6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:44.466530 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 104/198] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Sep 9 16:17:44 2022] GET /identity/v3/users/d09a36ad33b04e669d6f3e59cefcc108 => generated 283 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:17:44.467477 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8e5c55-df4c-44d3-9cfb-579c496dc0e6 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:44.472476 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab808fbe-4a44-41a9-a863-07f93da429e9 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:44.473843 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 95/199] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Sep 9 16:17:44 2022] GET /identity/v3/role_assignments?user.id=d09a36ad33b04e669d6f3e59cefcc108&scope.project.id=b42bed1e233c4e71a1ec8ca3ae42c433&role.id=0a36d1be416f4089be19be979943b731 => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:17:44.562823 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8e5c55-df4c-44d3-9cfb-579c496dc0e6 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:44.571498 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:17:44.606800 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab808fbe-4a44-41a9-a863-07f93da429e9 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:44.653709 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9763ee-3e9c-4df9-b408-73dcbec570fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:44.654342 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9763ee-3e9c-4df9-b408-73dcbec570fc None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:44.654624 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9763ee-3e9c-4df9-b408-73dcbec570fc None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:44.654985 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9763ee-3e9c-4df9-b408-73dcbec570fc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:44.690971 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:17:44.698050 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8e5c55-df4c-44d3-9cfb-579c496dc0e6 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:44.732799 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9763ee-3e9c-4df9-b408-73dcbec570fc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:44.734281 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9763ee-3e9c-4df9-b408-73dcbec570fc None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:44.734427 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9dcf29-7130-4e23-b684-e795cb26f611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:44.734995 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9dcf29-7130-4e23-b684-e795cb26f611 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:44.735268 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9dcf29-7130-4e23-b684-e795cb26f611 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:44.735531 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9dcf29-7130-4e23-b684-e795cb26f611 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:44.749252 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9dcf29-7130-4e23-b684-e795cb26f611 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 16:17:44.754850 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-de9dcf29-7130-4e23-b684-e795cb26f611 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 16:17:44.754850 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:17:44.754850 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:17:44.754850 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:17:44.754850 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:17:44.754850 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:17:44.754850 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:17:44.754850 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:17:44.754850 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:17:44.754850 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:17:44.754850 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:17:44.754850 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:17:44.754850 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 16:17:44.754850 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 16:17:44.754850 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 16:17:44.754850 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 16:17:44.755759 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 16:17:44.755759 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 16:17:44.755759 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 16:17:44.755759 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 16:17:44.755759 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:17:44.755759 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:17:44.755759 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:17:44.755759 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:17:44.755759 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:17:44.755759 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:17:44.755759 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:17:44.755759 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Sep 09 16:17:44.755759 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:17:44.755759 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:17:44.755759 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:17:44.755759 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:17:44.756548 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:17:44.756548 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:17:44.756548 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:17:44.756548 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:17:44.756548 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 16:17:44.756548 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 16:17:44.756548 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 16:17:44.756548 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 16:17:44.756548 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 16:17:44.756548 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 16:17:44.756548 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 16:17:44.756548 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:17:44.756548 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 96/200] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Sep 9 16:17:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 16:17:44.762909 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9dcf29-7130-4e23-b684-e795cb26f611 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:44.822777 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:17:44.849715 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 105/201] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Sep 9 16:17:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 16:17:44.853241 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9763ee-3e9c-4df9-b408-73dcbec570fc None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:44.875113 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9dcf29-7130-4e23-b684-e795cb26f611 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:44.913530 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07abbea2-fbc2-4d43-be60-fee5e42dfe5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:44.914141 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07abbea2-fbc2-4d43-be60-fee5e42dfe5e None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:44.914535 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07abbea2-fbc2-4d43-be60-fee5e42dfe5e None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:44.914804 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07abbea2-fbc2-4d43-be60-fee5e42dfe5e None admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:44.915558 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07abbea2-fbc2-4d43-be60-fee5e42dfe5e None admin] RBAC: Adding query filter params (name=reader) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:17:44.915859 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07abbea2-fbc2-4d43-be60-fee5e42dfe5e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:44.917542 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07abbea2-fbc2-4d43-be60-fee5e42dfe5e None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:44.928571 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 97/202] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Sep 9 16:17:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 16:17:44.935511 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07abbea2-fbc2-4d43-be60-fee5e42dfe5e None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:44.958119 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:17:44.960089 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9763ee-3e9c-4df9-b408-73dcbec570fc None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:45.015624 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b11bf13-5e0b-42fe-b3be-65d924ceaa36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:45.016264 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b11bf13-5e0b-42fe-b3be-65d924ceaa36 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:45.016536 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b11bf13-5e0b-42fe-b3be-65d924ceaa36 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:45.016798 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b11bf13-5e0b-42fe-b3be-65d924ceaa36 None admin] PATH_INFO: `/v3/projects/b42bed1e233c4e71a1ec8ca3ae42c433` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:45.018550 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b11bf13-5e0b-42fe-b3be-65d924ceaa36 None admin] RBAC: Authorizing `identity:get_project(project_id=b42bed1e233c4e71a1ec8ca3ae42c433)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:45.020552 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b11bf13-5e0b-42fe-b3be-65d924ceaa36 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:45.022171 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 106/203] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Sep 9 16:17:44 2022] GET /identity/v3/projects/b42bed1e233c4e71a1ec8ca3ae42c433 => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 16:17:45.031652 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b11bf13-5e0b-42fe-b3be-65d924ceaa36 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:45.087829 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:17:45.140876 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b11bf13-5e0b-42fe-b3be-65d924ceaa36 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:45.152481 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07abbea2-fbc2-4d43-be60-fee5e42dfe5e None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:45.180096 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f9610e-93cc-44b1-93f6-ac841d4771bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:45.180948 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f9610e-93cc-44b1-93f6-ac841d4771bd None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:45.181223 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f9610e-93cc-44b1-93f6-ac841d4771bd None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:45.181488 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f9610e-93cc-44b1-93f6-ac841d4771bd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:45.182216 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f9610e-93cc-44b1-93f6-ac841d4771bd None admin] RBAC: Adding query filter params (role.id=9452afb4ffe54eb7b7b5b0aff7dd00ed, scope.project.id=b42bed1e233c4e71a1ec8ca3ae42c433, user.id=d09a36ad33b04e669d6f3e59cefcc108) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:17:45.183380 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f9610e-93cc-44b1-93f6-ac841d4771bd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:45.185097 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f9610e-93cc-44b1-93f6-ac841d4771bd None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:45.196857 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 107/204] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Sep 9 16:17:45 2022] GET /identity/v3/role_assignments?user.id=d09a36ad33b04e669d6f3e59cefcc108&scope.project.id=b42bed1e233c4e71a1ec8ca3ae42c433&role.id=9452afb4ffe54eb7b7b5b0aff7dd00ed => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 16:17:45.221221 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab714cc7-5b92-4cec-9a54-c331c797b836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:45.221798 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab714cc7-5b92-4cec-9a54-c331c797b836 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:45.222070 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab714cc7-5b92-4cec-9a54-c331c797b836 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:45.222354 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab714cc7-5b92-4cec-9a54-c331c797b836 None admin] PATH_INFO: `/v3/users/d8809ae0c3934322983d8c64c4590844` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:45.224308 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab714cc7-5b92-4cec-9a54-c331c797b836 None admin] RBAC: Authorizing `identity:get_user(user_id=d8809ae0c3934322983d8c64c4590844)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:45.225804 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab714cc7-5b92-4cec-9a54-c331c797b836 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:45.228407 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 98/205] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Sep 9 16:17:44 2022] GET /identity/v3/users/d8809ae0c3934322983d8c64c4590844 => generated 289 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:17:45.233079 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f9610e-93cc-44b1-93f6-ac841d4771bd None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:45.355971 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f9610e-93cc-44b1-93f6-ac841d4771bd None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:45.366722 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:17:45.396051 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072fe157-f224-4865-9ed1-4c07e698abd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:45.396685 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072fe157-f224-4865-9ed1-4c07e698abd2 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:45.396958 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072fe157-f224-4865-9ed1-4c07e698abd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:45.397222 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072fe157-f224-4865-9ed1-4c07e698abd2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:45.470855 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072fe157-f224-4865-9ed1-4c07e698abd2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:45.472467 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072fe157-f224-4865-9ed1-4c07e698abd2 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:45.581055 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 108/206] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Sep 9 16:17:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 16:17:45.590453 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab714cc7-5b92-4cec-9a54-c331c797b836 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:45.685383 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:17:45.707813 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab714cc7-5b92-4cec-9a54-c331c797b836 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:45.747920 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df31555c-28f8-4af3-aab8-92aa93e35cfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:45.748551 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df31555c-28f8-4af3-aab8-92aa93e35cfc None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:45.748837 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df31555c-28f8-4af3-aab8-92aa93e35cfc None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:45.749115 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df31555c-28f8-4af3-aab8-92aa93e35cfc None admin] PATH_INFO: `/v3/projects/adc7a18acd23477d80890d7a3477e7c9` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:45.750378 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df31555c-28f8-4af3-aab8-92aa93e35cfc None admin] RBAC: Authorizing `identity:get_project(project_id=adc7a18acd23477d80890d7a3477e7c9)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:45.751880 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df31555c-28f8-4af3-aab8-92aa93e35cfc None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:45.754525 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 99/207] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Sep 9 16:17:45 2022] GET /identity/v3/projects/adc7a18acd23477d80890d7a3477e7c9 => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:17:45.760280 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072fe157-f224-4865-9ed1-4c07e698abd2 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:45.786698 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:17:45.907360 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072fe157-f224-4865-9ed1-4c07e698abd2 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:45.946431 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e27c45-73ec-48ff-98b9-3ebb88434815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:45.947039 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e27c45-73ec-48ff-98b9-3ebb88434815 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:45.947311 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e27c45-73ec-48ff-98b9-3ebb88434815 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:45.947577 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e27c45-73ec-48ff-98b9-3ebb88434815 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:45.948286 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e27c45-73ec-48ff-98b9-3ebb88434815 None admin] RBAC: Adding query filter params (role.id=99ea656aad1b4b0c990db50b9b878b90, scope.project.id=adc7a18acd23477d80890d7a3477e7c9, user.id=d8809ae0c3934322983d8c64c4590844) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:17:45.948585 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e27c45-73ec-48ff-98b9-3ebb88434815 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:45.950012 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e27c45-73ec-48ff-98b9-3ebb88434815 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:45.959110 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 109/208] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Sep 9 16:17:45 2022] GET /identity/v3/role_assignments?user.id=d8809ae0c3934322983d8c64c4590844&scope.project.id=adc7a18acd23477d80890d7a3477e7c9&role.id=99ea656aad1b4b0c990db50b9b878b90 => generated 608 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:17:46.868016 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da4d3f1-9a9d-4429-baee-35068527cc02 None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:46.868729 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da4d3f1-9a9d-4429-baee-35068527cc02 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:46.868729 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da4d3f1-9a9d-4429-baee-35068527cc02 None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:46.869901 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 100/209] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:17:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:17:46.875310 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba95fba2-3376-4cd3-b7af-21ca2899daf3 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:46.875834 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba95fba2-3376-4cd3-b7af-21ca2899daf3 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:46.876328 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba95fba2-3376-4cd3-b7af-21ca2899daf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:46.894659 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-ba95fba2-3376-4cd3-b7af-21ca2899daf3 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:17:46.896215 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-ba95fba2-3376-4cd3-b7af-21ca2899daf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:17:46.911334 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6bef4d-23bc-4daa-86c9-68e06fb5ea37 None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:46.911922 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6bef4d-23bc-4daa-86c9-68e06fb5ea37 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:46.912428 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6bef4d-23bc-4daa-86c9-68e06fb5ea37 None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:46.914149 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 101/210] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:17:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 16:17:46.919809 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ece00c-746d-4dee-b2a1-a4dab9f83a11 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:46.920355 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ece00c-746d-4dee-b2a1-a4dab9f83a11 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:46.920850 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ece00c-746d-4dee-b2a1-a4dab9f83a11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:46.943766 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-89ece00c-746d-4dee-b2a1-a4dab9f83a11 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:17:46.945378 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-89ece00c-746d-4dee-b2a1-a4dab9f83a11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:17:46.982337 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 110/211] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:17:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 16:17:47.022986 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 102/212] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:17:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 16:17:47.205408 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9933d20d-3d28-47f4-8b56-caca1c9ff73a None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:47.206079 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9933d20d-3d28-47f4-8b56-caca1c9ff73a None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:47.206633 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9933d20d-3d28-47f4-8b56-caca1c9ff73a None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:47.208801 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 111/213] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:17:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:17:47.214264 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facdffc7-d3e7-4218-96e0-f71e93efa6fc None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:47.214584 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facdffc7-d3e7-4218-96e0-f71e93efa6fc None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:47.214859 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facdffc7-d3e7-4218-96e0-f71e93efa6fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:47.234703 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-facdffc7-d3e7-4218-96e0-f71e93efa6fc None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:17:47.236161 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-facdffc7-d3e7-4218-96e0-f71e93efa6fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:17:47.250861 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9933d20d-3d28-47f4-8b56-caca1c9ff73a None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:47.253715 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:17:47.316190 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 103/214] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:17:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 16:17:47.317136 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facdffc7-d3e7-4218-96e0-f71e93efa6fc None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:47.338555 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:17:47.382726 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9933d20d-3d28-47f4-8b56-caca1c9ff73a None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:47.431432 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3798ab04-6970-4828-9018-7c48ad6687fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:47.432464 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3798ab04-6970-4828-9018-7c48ad6687fa None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:47.432965 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3798ab04-6970-4828-9018-7c48ad6687fa None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:47.433435 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3798ab04-6970-4828-9018-7c48ad6687fa None admin] PATH_INFO: `/v3/roles/member` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:47.445244 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facdffc7-d3e7-4218-96e0-f71e93efa6fc None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:47.445925 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3798ab04-6970-4828-9018-7c48ad6687fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 16:17:47.451286 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-3798ab04-6970-4828-9018-7c48ad6687fa None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 16:17:47.451286 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:17:47.451286 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:17:47.451286 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:17:47.451286 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:17:47.451286 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:17:47.451286 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:17:47.451286 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:17:47.451286 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:17:47.451286 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:17:47.451286 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:17:47.451286 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:17:47.451286 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 16:17:47.451286 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 16:17:47.451286 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 16:17:47.451286 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 16:17:47.452157 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 16:17:47.452157 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 16:17:47.452157 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 16:17:47.452157 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 16:17:47.452157 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:17:47.452157 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:17:47.452157 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:17:47.452157 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:17:47.452157 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:17:47.452157 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:17:47.452157 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:17:47.452157 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 16:17:47.452157 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:17:47.452157 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:17:47.452157 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:17:47.452157 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:17:47.452941 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:17:47.452941 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:17:47.452941 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:17:47.452941 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:17:47.452941 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 16:17:47.452941 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 16:17:47.452941 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 16:17:47.452941 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 16:17:47.452941 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 16:17:47.452941 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 16:17:47.452941 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 16:17:47.452941 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 16:17:47.455404 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 112/215] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Sep 9 16:17:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 16:17:47.461924 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3798ab04-6970-4828-9018-7c48ad6687fa None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:47.492840 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4590fd75-74cb-49cf-b6a8-da8da77b4a4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:47.493943 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4590fd75-74cb-49cf-b6a8-da8da77b4a4a None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:47.494476 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4590fd75-74cb-49cf-b6a8-da8da77b4a4a None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:47.495008 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4590fd75-74cb-49cf-b6a8-da8da77b4a4a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:47.507007 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4590fd75-74cb-49cf-b6a8-da8da77b4a4a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 16:17:47.512477 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-4590fd75-74cb-49cf-b6a8-da8da77b4a4a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 16:17:47.512477 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:17:47.512477 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:17:47.512477 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:17:47.512477 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:17:47.512477 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:17:47.512477 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:17:47.512477 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:17:47.512477 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:17:47.512477 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:17:47.512477 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:17:47.512477 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:17:47.512477 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 16:17:47.512477 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 16:17:47.512477 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 16:17:47.512477 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 16:17:47.513351 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 16:17:47.513351 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 16:17:47.513351 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 16:17:47.513351 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 16:17:47.513351 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:17:47.513351 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:17:47.513351 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:17:47.513351 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:17:47.513351 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:17:47.513351 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:17:47.513351 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:17:47.513351 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Sep 09 16:17:47.513351 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:17:47.513351 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:17:47.513351 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:17:47.513351 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:17:47.514138 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:17:47.514138 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:17:47.514138 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:17:47.514138 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:17:47.514138 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 16:17:47.514138 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 16:17:47.514138 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 16:17:47.514138 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 16:17:47.514138 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 16:17:47.514138 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 16:17:47.514138 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 16:17:47.514138 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:17:47.516517 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 104/216] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Sep 9 16:17:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:17:47.523099 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4590fd75-74cb-49cf-b6a8-da8da77b4a4a None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:47.531544 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:17:47.584276 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3798ab04-6970-4828-9018-7c48ad6687fa None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:47.607689 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:17:47.628316 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68996591-9860-4c51-b702-5151e11faf9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:47.629111 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68996591-9860-4c51-b702-5151e11faf9a None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:47.629394 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68996591-9860-4c51-b702-5151e11faf9a None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:47.629665 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68996591-9860-4c51-b702-5151e11faf9a None admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:47.630346 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68996591-9860-4c51-b702-5151e11faf9a None admin] RBAC: Adding query filter params (name=member) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:17:47.630652 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68996591-9860-4c51-b702-5151e11faf9a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:47.632046 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68996591-9860-4c51-b702-5151e11faf9a None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:47.639524 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4590fd75-74cb-49cf-b6a8-da8da77b4a4a None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:47.642366 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 113/217] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Sep 9 16:17:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 16:17:47.642366 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68996591-9860-4c51-b702-5151e11faf9a None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:47.679106 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d0a4cc-b921-48be-95af-bd49a32031ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:47.679713 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d0a4cc-b921-48be-95af-bd49a32031ae None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:47.679988 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d0a4cc-b921-48be-95af-bd49a32031ae None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:47.680251 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d0a4cc-b921-48be-95af-bd49a32031ae None admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:47.680893 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d0a4cc-b921-48be-95af-bd49a32031ae None admin] RBAC: Adding query filter params (name=admin) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:17:47.681184 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d0a4cc-b921-48be-95af-bd49a32031ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:47.682574 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d0a4cc-b921-48be-95af-bd49a32031ae None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:47.691536 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 105/218] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Sep 9 16:17:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 16:17:47.695752 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d0a4cc-b921-48be-95af-bd49a32031ae None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:47.750606 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68996591-9860-4c51-b702-5151e11faf9a None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:47.775856 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:17:47.787454 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690b5dc1-f975-40b2-a626-2f26defb3ef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:47.788082 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690b5dc1-f975-40b2-a626-2f26defb3ef5 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:47.788361 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690b5dc1-f975-40b2-a626-2f26defb3ef5 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:47.788635 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690b5dc1-f975-40b2-a626-2f26defb3ef5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:47.789734 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690b5dc1-f975-40b2-a626-2f26defb3ef5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:47.791227 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690b5dc1-f975-40b2-a626-2f26defb3ef5 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:47.792794 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 114/219] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 16:17:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:17:47.795418 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690b5dc1-f975-40b2-a626-2f26defb3ef5 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:47.807261 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d0a4cc-b921-48be-95af-bd49a32031ae None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:47.843441 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa149b64-9f78-4008-9c59-a3bd6478728e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:47.844076 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa149b64-9f78-4008-9c59-a3bd6478728e None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:47.844354 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa149b64-9f78-4008-9c59-a3bd6478728e None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:47.844633 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa149b64-9f78-4008-9c59-a3bd6478728e None admin] PATH_INFO: `/v3/users/6712ee5dd44e4bef989b7054c2c7a0a6` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:47.846596 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:17:47.860356 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa149b64-9f78-4008-9c59-a3bd6478728e None admin] RBAC: Authorizing `identity:get_user(user_id=6712ee5dd44e4bef989b7054c2c7a0a6)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:47.861817 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa149b64-9f78-4008-9c59-a3bd6478728e None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:47.864100 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 106/220] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Sep 9 16:17:47 2022] GET /identity/v3/users/6712ee5dd44e4bef989b7054c2c7a0a6 => generated 297 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:17:47.864966 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa149b64-9f78-4008-9c59-a3bd6478728e None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:47.905212 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690b5dc1-f975-40b2-a626-2f26defb3ef5 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:47.938697 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e6344a-eb09-4727-87f8-314badb905c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:47.939314 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e6344a-eb09-4727-87f8-314badb905c5 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:47.939587 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e6344a-eb09-4727-87f8-314badb905c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:47.939851 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e6344a-eb09-4727-87f8-314badb905c5 None admin] PATH_INFO: `/v3/users/d09a36ad33b04e669d6f3e59cefcc108` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:47.940953 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e6344a-eb09-4727-87f8-314badb905c5 None admin] RBAC: Authorizing `identity:get_user(user_id=d09a36ad33b04e669d6f3e59cefcc108)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:47.942444 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e6344a-eb09-4727-87f8-314badb905c5 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:47.943996 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 115/221] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Sep 9 16:17:47 2022] GET /identity/v3/users/d09a36ad33b04e669d6f3e59cefcc108 => generated 283 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:17:47.945268 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdd35d1-bc39-428f-b97c-38293e6bb054 None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:47.945534 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdd35d1-bc39-428f-b97c-38293e6bb054 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:47.945802 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdd35d1-bc39-428f-b97c-38293e6bb054 None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:47.947155 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 116/222] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:17:47 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:17:47.947746 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdd35d1-bc39-428f-b97c-38293e6bb054 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:47.969811 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa149b64-9f78-4008-9c59-a3bd6478728e None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:48.002582 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712e5f30-ce2a-445d-a26a-2a80a79c53e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:48.003105 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712e5f30-ce2a-445d-a26a-2a80a79c53e2 None admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:48.003383 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712e5f30-ce2a-445d-a26a-2a80a79c53e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:48.003641 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712e5f30-ce2a-445d-a26a-2a80a79c53e2 None admin] PATH_INFO: `/v3/users` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:48.004297 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712e5f30-ce2a-445d-a26a-2a80a79c53e2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:48.005717 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712e5f30-ce2a-445d-a26a-2a80a79c53e2 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:48.006074 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:17:48.026751 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 107/223] 10.222.0.27 () {60 vars in 1132 bytes} [Fri Sep 9 16:17:47 2022] POST /identity/v3/users => generated 297 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:17:48.027590 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712e5f30-ce2a-445d-a26a-2a80a79c53e2 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:48.051701 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdd35d1-bc39-428f-b97c-38293e6bb054 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:48.094446 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:17:48.096005 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0496ac-c031-4d2a-9524-e6dcb6b3d0d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:48.096451 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0496ac-c031-4d2a-9524-e6dcb6b3d0d2 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:48.096751 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0496ac-c031-4d2a-9524-e6dcb6b3d0d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:48.097019 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0496ac-c031-4d2a-9524-e6dcb6b3d0d2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:48.165427 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712e5f30-ce2a-445d-a26a-2a80a79c53e2 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:48.180487 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0496ac-c031-4d2a-9524-e6dcb6b3d0d2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:48.181981 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0496ac-c031-4d2a-9524-e6dcb6b3d0d2 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:48.213772 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a1a7b3-22aa-4eae-9744-415fe0e4e9dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:48.214565 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a1a7b3-22aa-4eae-9744-415fe0e4e9dd None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:48.215616 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a1a7b3-22aa-4eae-9744-415fe0e4e9dd None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:48.215616 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a1a7b3-22aa-4eae-9744-415fe0e4e9dd None admin] PATH_INFO: `/v3/projects/b42bed1e233c4e71a1ec8ca3ae42c433` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:48.216347 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a1a7b3-22aa-4eae-9744-415fe0e4e9dd None admin] RBAC: Authorizing `identity:get_project(project_id=b42bed1e233c4e71a1ec8ca3ae42c433)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:48.217829 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a1a7b3-22aa-4eae-9744-415fe0e4e9dd None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:48.221323 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 108/224] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Sep 9 16:17:48 2022] GET /identity/v3/projects/b42bed1e233c4e71a1ec8ca3ae42c433 => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:17:48.221586 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b146df-6b30-4419-a6ec-3000d98c3c42 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:48.221866 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b146df-6b30-4419-a6ec-3000d98c3c42 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:48.222135 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b146df-6b30-4419-a6ec-3000d98c3c42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:48.247513 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-48b146df-6b30-4419-a6ec-3000d98c3c42 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:17:48.248525 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:17:48.248730 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-48b146df-6b30-4419-a6ec-3000d98c3c42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:17:48.306854 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 117/225] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Sep 9 16:17:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 16:17:48.307754 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0496ac-c031-4d2a-9524-e6dcb6b3d0d2 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:48.341047 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 109/226] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:17:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 16:17:48.341861 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b146df-6b30-4419-a6ec-3000d98c3c42 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:48.402041 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:17:48.438657 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0496ac-c031-4d2a-9524-e6dcb6b3d0d2 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:48.466274 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b146df-6b30-4419-a6ec-3000d98c3c42 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:48.480179 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3a45cb-e9cf-44f8-90b9-3d94619ca506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:48.480968 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3a45cb-e9cf-44f8-90b9-3d94619ca506 None admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:48.481253 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3a45cb-e9cf-44f8-90b9-3d94619ca506 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:48.481526 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3a45cb-e9cf-44f8-90b9-3d94619ca506 None admin] PATH_INFO: `/v3/projects/b42bed1e233c4e71a1ec8ca3ae42c433/users/d09a36ad33b04e669d6f3e59cefcc108/roles/0a36d1be416f4089be19be979943b731` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:48.483502 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3a45cb-e9cf-44f8-90b9-3d94619ca506 None admin] RBAC: Authorizing `identity:create_grant(project_id=b42bed1e233c4e71a1ec8ca3ae42c433, user_id=d09a36ad33b04e669d6f3e59cefcc108, role_id=0a36d1be416f4089be19be979943b731)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:48.485075 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3a45cb-e9cf-44f8-90b9-3d94619ca506 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:48.500707 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 118/227] 10.222.0.27 () {58 vars in 1439 bytes} [Fri Sep 9 16:17:48 2022] PUT /identity/v3/projects/b42bed1e233c4e71a1ec8ca3ae42c433/users/d09a36ad33b04e669d6f3e59cefcc108/roles/0a36d1be416f4089be19be979943b731 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:17:48.512524 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05592c02-308e-4134-8c49-bbe5e3d18e39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:48.513514 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05592c02-308e-4134-8c49-bbe5e3d18e39 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:48.513961 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05592c02-308e-4134-8c49-bbe5e3d18e39 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:48.514430 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05592c02-308e-4134-8c49-bbe5e3d18e39 None admin] PATH_INFO: `/v3/projects/b42bed1e233c4e71a1ec8ca3ae42c433` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:48.515937 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05592c02-308e-4134-8c49-bbe5e3d18e39 None admin] RBAC: Authorizing `identity:get_project(project_id=b42bed1e233c4e71a1ec8ca3ae42c433)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:48.517736 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05592c02-308e-4134-8c49-bbe5e3d18e39 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:48.520708 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 110/228] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Sep 9 16:17:48 2022] GET /identity/v3/projects/b42bed1e233c4e71a1ec8ca3ae42c433 => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:17:48.530343 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3a45cb-e9cf-44f8-90b9-3d94619ca506 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:48.556801 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:17:48.645931 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05592c02-308e-4134-8c49-bbe5e3d18e39 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:48.673206 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3a45cb-e9cf-44f8-90b9-3d94619ca506 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:48.733763 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81316f64-b851-458c-a831-b59dab1058ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:48.734750 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81316f64-b851-458c-a831-b59dab1058ad None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:48.735561 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81316f64-b851-458c-a831-b59dab1058ad None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:48.736033 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81316f64-b851-458c-a831-b59dab1058ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:48.737240 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81316f64-b851-458c-a831-b59dab1058ad None admin] RBAC: Adding query filter params (role.id=b38e84bf077846ee802e6bb1bad83522, scope.project.id=b42bed1e233c4e71a1ec8ca3ae42c433, user.id=6712ee5dd44e4bef989b7054c2c7a0a6) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:17:48.737973 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81316f64-b851-458c-a831-b59dab1058ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:48.739852 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81316f64-b851-458c-a831-b59dab1058ad None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:48.748012 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 119/229] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Sep 9 16:17:48 2022] GET /identity/v3/role_assignments?user.id=6712ee5dd44e4bef989b7054c2c7a0a6&scope.project.id=b42bed1e233c4e71a1ec8ca3ae42c433&role.id=b38e84bf077846ee802e6bb1bad83522 => generated 259 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:17:48.765296 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05592c02-308e-4134-8c49-bbe5e3d18e39 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:48.784450 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:17:48.809122 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335dec4c-e789-4365-8dda-b54496779c76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:48.809732 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335dec4c-e789-4365-8dda-b54496779c76 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:48.810008 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335dec4c-e789-4365-8dda-b54496779c76 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:48.810277 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335dec4c-e789-4365-8dda-b54496779c76 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:48.823100 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335dec4c-e789-4365-8dda-b54496779c76 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 16:17:48.828176 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-335dec4c-e789-4365-8dda-b54496779c76 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 16:17:48.828176 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:17:48.828176 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:17:48.828176 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:17:48.828176 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:17:48.828176 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:17:48.828176 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:17:48.828176 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:17:48.828176 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:17:48.828176 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:17:48.828176 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:17:48.828176 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:17:48.828176 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 16:17:48.828176 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 16:17:48.828176 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 16:17:48.828176 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 16:17:48.829083 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 16:17:48.829083 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 16:17:48.829083 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 16:17:48.829083 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 16:17:48.829083 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:17:48.829083 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:17:48.829083 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:17:48.829083 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:17:48.829083 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:17:48.829083 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:17:48.829083 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:17:48.829083 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Sep 09 16:17:48.829083 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:17:48.829083 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:17:48.829083 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:17:48.829083 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:17:48.829876 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:17:48.829876 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:17:48.829876 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:17:48.829876 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:17:48.829876 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 16:17:48.829876 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 16:17:48.829876 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 16:17:48.829876 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 16:17:48.829876 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 16:17:48.829876 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 16:17:48.829876 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 16:17:48.829876 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:17:48.829876 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 111/230] 10.222.0.27 () {56 vars in 1114 bytes} [Fri Sep 9 16:17:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 16:17:48.836230 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81316f64-b851-458c-a831-b59dab1058ad None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:48.947082 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:17:48.964105 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81316f64-b851-458c-a831-b59dab1058ad None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:49.012886 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8abc740-9924-4cad-89f5-52e307b09377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:49.013494 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8abc740-9924-4cad-89f5-52e307b09377 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:49.013766 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8abc740-9924-4cad-89f5-52e307b09377 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:49.014032 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8abc740-9924-4cad-89f5-52e307b09377 None admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:49.014721 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8abc740-9924-4cad-89f5-52e307b09377 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:17:49.015016 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8abc740-9924-4cad-89f5-52e307b09377 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:49.016479 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8abc740-9924-4cad-89f5-52e307b09377 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:49.026135 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 120/231] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Sep 9 16:17:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:17:49.031589 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335dec4c-e789-4365-8dda-b54496779c76 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:49.173003 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335dec4c-e789-4365-8dda-b54496779c76 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:49.223620 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f29f1e0-2355-4c27-a2a3-4e5220a016b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:49.224258 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f29f1e0-2355-4c27-a2a3-4e5220a016b5 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:49.224536 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f29f1e0-2355-4c27-a2a3-4e5220a016b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:49.224806 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f29f1e0-2355-4c27-a2a3-4e5220a016b5 None admin] PATH_INFO: `/v3/users/d09a36ad33b04e669d6f3e59cefcc108` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:49.225983 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f29f1e0-2355-4c27-a2a3-4e5220a016b5 None admin] RBAC: Authorizing `identity:get_user(user_id=d09a36ad33b04e669d6f3e59cefcc108)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:49.227487 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f29f1e0-2355-4c27-a2a3-4e5220a016b5 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:49.229420 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 112/232] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Sep 9 16:17:49 2022] GET /identity/v3/users/d09a36ad33b04e669d6f3e59cefcc108 => generated 283 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:17:49.234890 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8abc740-9924-4cad-89f5-52e307b09377 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:49.418195 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8abc740-9924-4cad-89f5-52e307b09377 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:49.468736 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b14045-35b3-49ed-93fc-da6ab7657205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:49.469302 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b14045-35b3-49ed-93fc-da6ab7657205 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:49.469580 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b14045-35b3-49ed-93fc-da6ab7657205 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:49.469850 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b14045-35b3-49ed-93fc-da6ab7657205 None admin] PATH_INFO: `/v3/projects/b42bed1e233c4e71a1ec8ca3ae42c433` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:49.471029 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b14045-35b3-49ed-93fc-da6ab7657205 None admin] RBAC: Authorizing `identity:get_project(project_id=b42bed1e233c4e71a1ec8ca3ae42c433)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:49.472510 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b14045-35b3-49ed-93fc-da6ab7657205 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:49.474336 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 121/233] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Sep 9 16:17:49 2022] GET /identity/v3/projects/b42bed1e233c4e71a1ec8ca3ae42c433 => generated 302 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:17:49.480090 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f29f1e0-2355-4c27-a2a3-4e5220a016b5 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:49.554499 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:17:49.629655 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f29f1e0-2355-4c27-a2a3-4e5220a016b5 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:49.664358 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06440a3e-6b60-4960-a8b8-61483380bd2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:49.665019 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06440a3e-6b60-4960-a8b8-61483380bd2d None admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:49.665299 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06440a3e-6b60-4960-a8b8-61483380bd2d None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:49.665575 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06440a3e-6b60-4960-a8b8-61483380bd2d None admin] PATH_INFO: `/v3/projects/b42bed1e233c4e71a1ec8ca3ae42c433/users/d09a36ad33b04e669d6f3e59cefcc108/roles/9452afb4ffe54eb7b7b5b0aff7dd00ed` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:49.667802 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06440a3e-6b60-4960-a8b8-61483380bd2d None admin] RBAC: Authorizing `identity:create_grant(project_id=b42bed1e233c4e71a1ec8ca3ae42c433, user_id=d09a36ad33b04e669d6f3e59cefcc108, role_id=9452afb4ffe54eb7b7b5b0aff7dd00ed)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:49.669246 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06440a3e-6b60-4960-a8b8-61483380bd2d None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:49.694372 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 113/234] 10.222.0.27 () {58 vars in 1439 bytes} [Fri Sep 9 16:17:49 2022] PUT /identity/v3/projects/b42bed1e233c4e71a1ec8ca3ae42c433/users/d09a36ad33b04e669d6f3e59cefcc108/roles/9452afb4ffe54eb7b7b5b0aff7dd00ed => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:17:50.805946 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df91aa7-55b7-4659-bcc5-aa7297d172fe None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:50.806480 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df91aa7-55b7-4659-bcc5-aa7297d172fe None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:50.806556 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df91aa7-55b7-4659-bcc5-aa7297d172fe None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:50.808198 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 122/235] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:17:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:17:50.813982 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59491efb-3e94-42af-96c3-a7b6c89828de None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:50.814443 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59491efb-3e94-42af-96c3-a7b6c89828de None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:50.814646 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59491efb-3e94-42af-96c3-a7b6c89828de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:50.842875 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-59491efb-3e94-42af-96c3-a7b6c89828de None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:17:50.844088 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-59491efb-3e94-42af-96c3-a7b6c89828de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:17:50.946423 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 114/236] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:17:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 16:17:50.985023 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4d9d20-770b-478d-baf2-abc28d44bc06 None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:50.985359 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4d9d20-770b-478d-baf2-abc28d44bc06 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:50.985576 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4d9d20-770b-478d-baf2-abc28d44bc06 None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:50.987095 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 123/237] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:17:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:17:50.992603 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc81239-c640-4249-a649-f8e79b65f123 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:50.992895 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc81239-c640-4249-a649-f8e79b65f123 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:50.993177 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc81239-c640-4249-a649-f8e79b65f123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:51.019314 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-9dc81239-c640-4249-a649-f8e79b65f123 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:17:51.020591 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-9dc81239-c640-4249-a649-f8e79b65f123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:17:51.052608 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:17:51.097377 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 115/238] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:17:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 16:17:51.431351 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6d65fd-78dd-42a3-928a-55fc8a7fd800 None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:51.431841 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6d65fd-78dd-42a3-928a-55fc8a7fd800 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:51.432348 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6d65fd-78dd-42a3-928a-55fc8a7fd800 None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:51.434453 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 124/239] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:17:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:17:51.439378 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc60461a-115e-4745-bf19-c41c53c5256d None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:51.439907 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc60461a-115e-4745-bf19-c41c53c5256d None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:51.440384 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc60461a-115e-4745-bf19-c41c53c5256d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:51.462126 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6d65fd-78dd-42a3-928a-55fc8a7fd800 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:51.463385 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-cc60461a-115e-4745-bf19-c41c53c5256d None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:17:51.464960 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-cc60461a-115e-4745-bf19-c41c53c5256d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:17:51.490105 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:17:51.547545 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 116/240] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:17:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 16:17:51.548916 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c726ac9e-53a7-4e70-9a53-d09a7746f761 None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:51.549206 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c726ac9e-53a7-4e70-9a53-d09a7746f761 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:51.549479 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c726ac9e-53a7-4e70-9a53-d09a7746f761 None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:51.551513 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 117/241] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:17:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:17:51.552155 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c726ac9e-53a7-4e70-9a53-d09a7746f761 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:51.587430 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6d65fd-78dd-42a3-928a-55fc8a7fd800 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:51.630806 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eb0980-2ce7-4694-93a5-55c959df4d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:51.631906 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eb0980-2ce7-4694-93a5-55c959df4d22 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:51.632445 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eb0980-2ce7-4694-93a5-55c959df4d22 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:51.632724 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eb0980-2ce7-4694-93a5-55c959df4d22 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:51.646811 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1eb0980-2ce7-4694-93a5-55c959df4d22 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 16:17:51.654445 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-e1eb0980-2ce7-4694-93a5-55c959df4d22 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 16:17:51.654445 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:17:51.654445 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:17:51.654445 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:17:51.654445 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:17:51.654445 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:17:51.654445 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:17:51.654445 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:17:51.654445 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:17:51.654445 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:17:51.654445 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:17:51.654445 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:17:51.654445 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 16:17:51.654445 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 16:17:51.654445 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 16:17:51.654445 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 16:17:51.655314 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 16:17:51.655314 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 16:17:51.655314 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 16:17:51.655314 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 16:17:51.655314 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:17:51.655314 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:17:51.655314 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:17:51.655314 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:17:51.655314 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:17:51.655314 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:17:51.655314 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:17:51.655314 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 16:17:51.655314 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:17:51.655314 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:17:51.655314 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:17:51.655314 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:17:51.656087 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:17:51.656087 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:17:51.656087 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:17:51.656087 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:17:51.656087 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 16:17:51.656087 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 16:17:51.656087 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 16:17:51.656087 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 16:17:51.656087 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 16:17:51.656087 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 16:17:51.656087 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 16:17:51.656087 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 16:17:51.662185 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 125/242] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Sep 9 16:17:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:17:51.663745 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebb8a00-edc3-44e8-92d1-02e4da4480a5 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:51.664031 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebb8a00-edc3-44e8-92d1-02e4da4480a5 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:51.664560 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebb8a00-edc3-44e8-92d1-02e4da4480a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:51.665568 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:17:51.678022 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c726ac9e-53a7-4e70-9a53-d09a7746f761 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:51.688861 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-2ebb8a00-edc3-44e8-92d1-02e4da4480a5 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:17:51.690493 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-2ebb8a00-edc3-44e8-92d1-02e4da4480a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:17:51.720668 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f577c9df-8954-44ba-aea7-bbed1e1907a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:51.721391 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f577c9df-8954-44ba-aea7-bbed1e1907a0 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:51.721838 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f577c9df-8954-44ba-aea7-bbed1e1907a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:51.722119 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f577c9df-8954-44ba-aea7-bbed1e1907a0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:51.724917 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f577c9df-8954-44ba-aea7-bbed1e1907a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:51.726548 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f577c9df-8954-44ba-aea7-bbed1e1907a0 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:51.728613 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 118/243] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 16:17:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:17:51.729863 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f577c9df-8954-44ba-aea7-bbed1e1907a0 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:51.778559 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 126/244] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:17:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 16:17:51.779529 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebb8a00-edc3-44e8-92d1-02e4da4480a5 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:51.782710 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:17:51.846070 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f577c9df-8954-44ba-aea7-bbed1e1907a0 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:51.884695 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebb8a00-edc3-44e8-92d1-02e4da4480a5 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:51.885221 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c56d9fc-584c-4494-8d84-6ecb756ff715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:51.885446 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c56d9fc-584c-4494-8d84-6ecb756ff715 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:51.885725 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c56d9fc-584c-4494-8d84-6ecb756ff715 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:51.885993 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c56d9fc-584c-4494-8d84-6ecb756ff715 None admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:51.886793 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c56d9fc-584c-4494-8d84-6ecb756ff715 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:17:51.887384 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c56d9fc-584c-4494-8d84-6ecb756ff715 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:51.889759 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c56d9fc-584c-4494-8d84-6ecb756ff715 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:51.899785 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 119/245] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Sep 9 16:17:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:17:51.905229 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c56d9fc-584c-4494-8d84-6ecb756ff715 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:51.923015 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935468b3-84b0-4495-ad71-00e7f01380f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:51.923722 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935468b3-84b0-4495-ad71-00e7f01380f2 None admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:51.924010 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935468b3-84b0-4495-ad71-00e7f01380f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:51.924286 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935468b3-84b0-4495-ad71-00e7f01380f2 None admin] PATH_INFO: `/v3/users` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:51.924989 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935468b3-84b0-4495-ad71-00e7f01380f2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:51.926744 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935468b3-84b0-4495-ad71-00e7f01380f2 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:51.931477 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:17:51.960800 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 127/246] 10.222.0.27 () {60 vars in 1132 bytes} [Fri Sep 9 16:17:51 2022] POST /identity/v3/users => generated 293 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:17:51.961768 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935468b3-84b0-4495-ad71-00e7f01380f2 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:52.015302 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c56d9fc-584c-4494-8d84-6ecb756ff715 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:52.034701 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:17:52.053311 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7751177a-af25-450b-bceb-738dff59ee2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:52.053953 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7751177a-af25-450b-bceb-738dff59ee2c None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:52.054231 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7751177a-af25-450b-bceb-738dff59ee2c None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:52.054532 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7751177a-af25-450b-bceb-738dff59ee2c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:52.074579 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7751177a-af25-450b-bceb-738dff59ee2c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 16:17:52.081537 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-7751177a-af25-450b-bceb-738dff59ee2c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 16:17:52.081537 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:17:52.081537 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:17:52.081537 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:17:52.081537 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:17:52.081537 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:17:52.081537 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:17:52.081537 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:17:52.081537 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:17:52.081537 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:17:52.081537 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:17:52.081537 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:17:52.081537 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 16:17:52.081537 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 16:17:52.081537 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 16:17:52.081537 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 16:17:52.083144 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 16:17:52.083144 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 16:17:52.083144 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 16:17:52.083144 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 16:17:52.083144 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:17:52.083144 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:17:52.083144 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:17:52.083144 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:17:52.083144 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:17:52.083144 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:17:52.083144 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:17:52.083144 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Sep 09 16:17:52.083144 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:17:52.083144 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:17:52.083144 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:17:52.083144 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:17:52.083921 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:17:52.083921 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:17:52.083921 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:17:52.083921 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:17:52.083921 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 16:17:52.083921 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 16:17:52.083921 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 16:17:52.083921 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 16:17:52.083921 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 16:17:52.083921 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 16:17:52.083921 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 16:17:52.083921 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:17:52.083921 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 120/247] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Sep 9 16:17:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:17:52.095435 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7751177a-af25-450b-bceb-738dff59ee2c None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:52.109613 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935468b3-84b0-4495-ad71-00e7f01380f2 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:52.158431 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa5682c-9f20-48e2-ae67-8dc363ba650e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:52.159539 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa5682c-9f20-48e2-ae67-8dc363ba650e None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:52.160032 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa5682c-9f20-48e2-ae67-8dc363ba650e None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:52.160473 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa5682c-9f20-48e2-ae67-8dc363ba650e None admin] PATH_INFO: `/v3/users/0e880ec0a0604a3d917e5ee944adcd99` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:52.176669 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa5682c-9f20-48e2-ae67-8dc363ba650e None admin] RBAC: Authorizing `identity:get_user(user_id=0e880ec0a0604a3d917e5ee944adcd99)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:52.178628 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa5682c-9f20-48e2-ae67-8dc363ba650e None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:52.180678 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 128/248] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Sep 9 16:17:51 2022] GET /identity/v3/users/0e880ec0a0604a3d917e5ee944adcd99 => generated 297 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:17:52.181659 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa5682c-9f20-48e2-ae67-8dc363ba650e None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:52.201927 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:17:52.224755 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7751177a-af25-450b-bceb-738dff59ee2c None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:52.265395 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d74eee-13e8-4d86-849f-da405fb85962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:52.266010 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d74eee-13e8-4d86-849f-da405fb85962 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:52.266295 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d74eee-13e8-4d86-849f-da405fb85962 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:52.266590 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d74eee-13e8-4d86-849f-da405fb85962 None admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:52.267241 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d74eee-13e8-4d86-849f-da405fb85962 None admin] RBAC: Adding query filter params (name=member) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:17:52.267539 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d74eee-13e8-4d86-849f-da405fb85962 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:52.268918 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d74eee-13e8-4d86-849f-da405fb85962 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:52.279814 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 121/249] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Sep 9 16:17:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:17:52.280534 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d74eee-13e8-4d86-849f-da405fb85962 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:52.322371 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa5682c-9f20-48e2-ae67-8dc363ba650e None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:52.344803 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:17:52.365304 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d4a495-aa86-4a5a-80d8-474f4eaf83b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:52.366451 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d4a495-aa86-4a5a-80d8-474f4eaf83b0 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:52.366924 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d4a495-aa86-4a5a-80d8-474f4eaf83b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:52.367680 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d4a495-aa86-4a5a-80d8-474f4eaf83b0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:52.381310 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d4a495-aa86-4a5a-80d8-474f4eaf83b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 16:17:52.386334 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-e2d4a495-aa86-4a5a-80d8-474f4eaf83b0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 16:17:52.386334 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:17:52.386334 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:17:52.386334 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:17:52.386334 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:17:52.386334 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:17:52.386334 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:17:52.386334 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:17:52.386334 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:17:52.386334 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:17:52.386334 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:17:52.386334 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:17:52.386334 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 16:17:52.386334 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 16:17:52.386334 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 16:17:52.386334 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 16:17:52.387380 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 16:17:52.387380 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 16:17:52.387380 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 16:17:52.387380 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 16:17:52.387380 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:17:52.387380 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:17:52.387380 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:17:52.387380 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:17:52.387380 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:17:52.387380 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:17:52.387380 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:17:52.387380 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 16:17:52.387380 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:17:52.387380 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:17:52.387380 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:17:52.387380 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:17:52.388347 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:17:52.388347 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:17:52.388347 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:17:52.388347 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:17:52.388347 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 16:17:52.388347 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 16:17:52.388347 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 16:17:52.388347 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 16:17:52.388347 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 16:17:52.388347 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 16:17:52.388347 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 16:17:52.388347 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 16:17:52.388347 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 129/250] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Sep 9 16:17:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:17:52.389133 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d4a495-aa86-4a5a-80d8-474f4eaf83b0 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:52.421962 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d74eee-13e8-4d86-849f-da405fb85962 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:52.464371 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ac2b65-ec76-44f0-a9fa-3f715de27156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:52.465332 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ac2b65-ec76-44f0-a9fa-3f715de27156 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:52.465614 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ac2b65-ec76-44f0-a9fa-3f715de27156 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:52.465883 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ac2b65-ec76-44f0-a9fa-3f715de27156 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:52.482360 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:17:52.510390 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d4a495-aa86-4a5a-80d8-474f4eaf83b0 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:52.559547 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ac2b65-ec76-44f0-a9fa-3f715de27156 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:52.561356 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ac2b65-ec76-44f0-a9fa-3f715de27156 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:52.570726 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a80d0b-9813-443e-b6be-eb2e04b70c54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:52.571657 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a80d0b-9813-443e-b6be-eb2e04b70c54 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:52.572156 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a80d0b-9813-443e-b6be-eb2e04b70c54 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:52.573122 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a80d0b-9813-443e-b6be-eb2e04b70c54 None admin] PATH_INFO: `/v3/users/6712ee5dd44e4bef989b7054c2c7a0a6` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:52.574860 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a80d0b-9813-443e-b6be-eb2e04b70c54 None admin] RBAC: Authorizing `identity:get_user(user_id=6712ee5dd44e4bef989b7054c2c7a0a6)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:52.577032 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a80d0b-9813-443e-b6be-eb2e04b70c54 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:52.579612 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 130/251] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Sep 9 16:17:52 2022] GET /identity/v3/users/6712ee5dd44e4bef989b7054c2c7a0a6 => generated 297 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:17:52.580841 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a80d0b-9813-443e-b6be-eb2e04b70c54 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:52.643202 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:17:52.684543 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 122/252] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Sep 9 16:17:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 16:17:52.685640 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333b1d99-8ae2-4100-b5ff-4be9527c56e6 None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:52.685927 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333b1d99-8ae2-4100-b5ff-4be9527c56e6 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:52.686201 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333b1d99-8ae2-4100-b5ff-4be9527c56e6 None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:52.693021 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 123/253] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:17:52 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:17:52.694121 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333b1d99-8ae2-4100-b5ff-4be9527c56e6 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:52.715759 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a80d0b-9813-443e-b6be-eb2e04b70c54 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:52.752242 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:17:52.761003 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3325856-5dbb-45cc-bcf0-a2b982d32793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:52.763100 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3325856-5dbb-45cc-bcf0-a2b982d32793 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:52.763835 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3325856-5dbb-45cc-bcf0-a2b982d32793 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:52.764305 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3325856-5dbb-45cc-bcf0-a2b982d32793 None admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:52.765429 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3325856-5dbb-45cc-bcf0-a2b982d32793 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:17:52.766287 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3325856-5dbb-45cc-bcf0-a2b982d32793 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:52.768460 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3325856-5dbb-45cc-bcf0-a2b982d32793 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:52.785846 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 131/254] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Sep 9 16:17:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:17:52.785846 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3325856-5dbb-45cc-bcf0-a2b982d32793 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:52.823460 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333b1d99-8ae2-4100-b5ff-4be9527c56e6 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:52.863602 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41fe08a-192a-4ab9-abe8-e9dd41ff1f95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:52.864247 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41fe08a-192a-4ab9-abe8-e9dd41ff1f95 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:52.864494 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41fe08a-192a-4ab9-abe8-e9dd41ff1f95 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:52.864769 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41fe08a-192a-4ab9-abe8-e9dd41ff1f95 None admin] PATH_INFO: `/v3/projects/b42bed1e233c4e71a1ec8ca3ae42c433` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:52.865891 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41fe08a-192a-4ab9-abe8-e9dd41ff1f95 None admin] RBAC: Authorizing `identity:get_project(project_id=b42bed1e233c4e71a1ec8ca3ae42c433)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:52.867374 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41fe08a-192a-4ab9-abe8-e9dd41ff1f95 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:52.869336 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 124/255] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Sep 9 16:17:52 2022] GET /identity/v3/projects/b42bed1e233c4e71a1ec8ca3ae42c433 => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:17:52.874901 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930019d0-bb97-4103-9bdd-d48d2b799ba4 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:52.875186 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930019d0-bb97-4103-9bdd-d48d2b799ba4 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:52.875461 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930019d0-bb97-4103-9bdd-d48d2b799ba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:52.893996 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-930019d0-bb97-4103-9bdd-d48d2b799ba4 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:17:52.895823 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-930019d0-bb97-4103-9bdd-d48d2b799ba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:17:52.925708 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3325856-5dbb-45cc-bcf0-a2b982d32793 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:52.937702 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:17:52.970038 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 125/256] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:17:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 16:17:52.971852 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f9cd3e-9576-44b9-bcd8-f5e160b803d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:52.972735 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f9cd3e-9576-44b9-bcd8-f5e160b803d3 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:52.973228 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f9cd3e-9576-44b9-bcd8-f5e160b803d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:52.973705 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f9cd3e-9576-44b9-bcd8-f5e160b803d3 None admin] PATH_INFO: `/v3/projects/b42bed1e233c4e71a1ec8ca3ae42c433` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:52.975068 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f9cd3e-9576-44b9-bcd8-f5e160b803d3 None admin] RBAC: Authorizing `identity:get_project(project_id=b42bed1e233c4e71a1ec8ca3ae42c433)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:52.975174 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930019d0-bb97-4103-9bdd-d48d2b799ba4 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:52.976850 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f9cd3e-9576-44b9-bcd8-f5e160b803d3 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:52.979126 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 132/257] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Sep 9 16:17:52 2022] GET /identity/v3/projects/b42bed1e233c4e71a1ec8ca3ae42c433 => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:17:52.980079 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f9cd3e-9576-44b9-bcd8-f5e160b803d3 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:53.064041 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:17:53.156453 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f9cd3e-9576-44b9-bcd8-f5e160b803d3 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:53.165570 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930019d0-bb97-4103-9bdd-d48d2b799ba4 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:53.206323 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b29bb8d-1e6f-44e9-b684-45e228ba65d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:53.209650 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b29bb8d-1e6f-44e9-b684-45e228ba65d0 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:53.209931 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b29bb8d-1e6f-44e9-b684-45e228ba65d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:53.210204 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b29bb8d-1e6f-44e9-b684-45e228ba65d0 None admin] PATH_INFO: `/v3/users/d09a36ad33b04e669d6f3e59cefcc108` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:53.211638 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b29bb8d-1e6f-44e9-b684-45e228ba65d0 None admin] RBAC: Authorizing `identity:get_user(user_id=d09a36ad33b04e669d6f3e59cefcc108)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:53.213111 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b29bb8d-1e6f-44e9-b684-45e228ba65d0 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:53.216337 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 126/258] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Sep 9 16:17:52 2022] GET /identity/v3/users/d09a36ad33b04e669d6f3e59cefcc108 => generated 283 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:17:53.217175 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b29bb8d-1e6f-44e9-b684-45e228ba65d0 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:53.246250 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d349e5a6-91f6-434f-88b4-bf7808d6a1ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:53.246940 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d349e5a6-91f6-434f-88b4-bf7808d6a1ef None admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:53.247508 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d349e5a6-91f6-434f-88b4-bf7808d6a1ef None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:53.247787 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d349e5a6-91f6-434f-88b4-bf7808d6a1ef None admin] PATH_INFO: `/v3/projects/b42bed1e233c4e71a1ec8ca3ae42c433/users/6712ee5dd44e4bef989b7054c2c7a0a6/roles/b38e84bf077846ee802e6bb1bad83522` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:53.251605 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d349e5a6-91f6-434f-88b4-bf7808d6a1ef None admin] RBAC: Authorizing `identity:create_grant(project_id=b42bed1e233c4e71a1ec8ca3ae42c433, user_id=6712ee5dd44e4bef989b7054c2c7a0a6, role_id=b38e84bf077846ee802e6bb1bad83522)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:53.253054 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d349e5a6-91f6-434f-88b4-bf7808d6a1ef None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:53.278594 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 133/259] 10.222.0.27 () {58 vars in 1439 bytes} [Fri Sep 9 16:17:52 2022] PUT /identity/v3/projects/b42bed1e233c4e71a1ec8ca3ae42c433/users/6712ee5dd44e4bef989b7054c2c7a0a6/roles/b38e84bf077846ee802e6bb1bad83522 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:17:53.279493 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d349e5a6-91f6-434f-88b4-bf7808d6a1ef None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:53.320395 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:17:53.390498 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b29bb8d-1e6f-44e9-b684-45e228ba65d0 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:53.405641 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:17:53.434842 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1b98f8-f1d8-46a1-aaf1-bfb34d8b895a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:53.436321 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1b98f8-f1d8-46a1-aaf1-bfb34d8b895a None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:53.436787 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1b98f8-f1d8-46a1-aaf1-bfb34d8b895a None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:53.437192 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1b98f8-f1d8-46a1-aaf1-bfb34d8b895a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:53.438047 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1b98f8-f1d8-46a1-aaf1-bfb34d8b895a None admin] RBAC: Adding query filter params (role.id=99ea656aad1b4b0c990db50b9b878b90, scope.project.id=b42bed1e233c4e71a1ec8ca3ae42c433, user.id=0e880ec0a0604a3d917e5ee944adcd99) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:17:53.438522 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1b98f8-f1d8-46a1-aaf1-bfb34d8b895a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:53.440684 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1b98f8-f1d8-46a1-aaf1-bfb34d8b895a None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:53.447717 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 127/260] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Sep 9 16:17:53 2022] GET /identity/v3/role_assignments?user.id=0e880ec0a0604a3d917e5ee944adcd99&scope.project.id=b42bed1e233c4e71a1ec8ca3ae42c433&role.id=99ea656aad1b4b0c990db50b9b878b90 => generated 259 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:17:53.450347 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1b98f8-f1d8-46a1-aaf1-bfb34d8b895a None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:53.473515 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d349e5a6-91f6-434f-88b4-bf7808d6a1ef None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:53.602888 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597a1bb9-601f-4db0-a60d-70151138eb1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:53.603614 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597a1bb9-601f-4db0-a60d-70151138eb1c None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:53.603988 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597a1bb9-601f-4db0-a60d-70151138eb1c None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:53.604354 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597a1bb9-601f-4db0-a60d-70151138eb1c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:53.613772 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1b98f8-f1d8-46a1-aaf1-bfb34d8b895a None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:53.658035 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64097eeb-0830-4e81-af09-3a5d7a3e8c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:53.658952 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64097eeb-0830-4e81-af09-3a5d7a3e8c52 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:53.660585 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64097eeb-0830-4e81-af09-3a5d7a3e8c52 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:53.661223 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64097eeb-0830-4e81-af09-3a5d7a3e8c52 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:53.676605 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64097eeb-0830-4e81-af09-3a5d7a3e8c52 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 16:17:53.682615 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-64097eeb-0830-4e81-af09-3a5d7a3e8c52 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 16:17:53.682615 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:17:53.682615 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:17:53.682615 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:17:53.682615 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:17:53.682615 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:17:53.682615 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:17:53.682615 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:17:53.682615 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:17:53.682615 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:17:53.682615 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:17:53.682615 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:17:53.682615 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 16:17:53.682615 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 16:17:53.682615 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 16:17:53.682615 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 16:17:53.683707 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 16:17:53.683707 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 16:17:53.683707 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 16:17:53.683707 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 16:17:53.683707 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:17:53.683707 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:17:53.683707 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:17:53.683707 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:17:53.683707 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:17:53.683707 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:17:53.683707 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:17:53.683707 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Sep 09 16:17:53.683707 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:17:53.683707 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:17:53.683707 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:17:53.683707 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:17:53.684939 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:17:53.684939 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:17:53.684939 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:17:53.684939 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:17:53.684939 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 16:17:53.684939 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 16:17:53.684939 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 16:17:53.684939 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 16:17:53.684939 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 16:17:53.684939 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 16:17:53.684939 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 16:17:53.684939 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:17:53.686979 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 128/261] 10.222.0.27 () {56 vars in 1114 bytes} [Fri Sep 9 16:17:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:17:53.693881 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64097eeb-0830-4e81-af09-3a5d7a3e8c52 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:53.737599 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:17:53.743964 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597a1bb9-601f-4db0-a60d-70151138eb1c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:53.745452 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597a1bb9-601f-4db0-a60d-70151138eb1c None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:53.817043 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:17:53.861440 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64097eeb-0830-4e81-af09-3a5d7a3e8c52 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:53.923237 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b26538-55f2-49d7-9242-436cdaa4df06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:53.923843 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b26538-55f2-49d7-9242-436cdaa4df06 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:53.924111 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b26538-55f2-49d7-9242-436cdaa4df06 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:53.924383 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b26538-55f2-49d7-9242-436cdaa4df06 None admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:53.925035 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b26538-55f2-49d7-9242-436cdaa4df06 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:17:53.925335 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b26538-55f2-49d7-9242-436cdaa4df06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:53.927350 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b26538-55f2-49d7-9242-436cdaa4df06 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:53.933532 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 134/262] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Sep 9 16:17:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 654 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 16:17:53.940678 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597a1bb9-601f-4db0-a60d-70151138eb1c None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:53.950027 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 129/263] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Sep 9 16:17:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 16:17:53.963346 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b26538-55f2-49d7-9242-436cdaa4df06 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:54.125875 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:17:54.136603 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b26538-55f2-49d7-9242-436cdaa4df06 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:54.148091 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597a1bb9-601f-4db0-a60d-70151138eb1c None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:54.199642 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584f553e-a7d0-419e-8613-39e72be45cb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:54.200269 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584f553e-a7d0-419e-8613-39e72be45cb4 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:54.200547 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584f553e-a7d0-419e-8613-39e72be45cb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:54.201129 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584f553e-a7d0-419e-8613-39e72be45cb4 None admin] PATH_INFO: `/v3/projects/b42bed1e233c4e71a1ec8ca3ae42c433` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:54.202244 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584f553e-a7d0-419e-8613-39e72be45cb4 None admin] RBAC: Authorizing `identity:get_project(project_id=b42bed1e233c4e71a1ec8ca3ae42c433)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:54.203846 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584f553e-a7d0-419e-8613-39e72be45cb4 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:54.205928 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 135/264] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Sep 9 16:17:53 2022] GET /identity/v3/projects/b42bed1e233c4e71a1ec8ca3ae42c433 => generated 302 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 16:17:54.210844 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed30dcb-377b-44bf-96bd-ac60d3004c94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:54.211483 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed30dcb-377b-44bf-96bd-ac60d3004c94 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:54.211896 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed30dcb-377b-44bf-96bd-ac60d3004c94 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:54.212384 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed30dcb-377b-44bf-96bd-ac60d3004c94 None admin] PATH_INFO: `/v3/users/d09a36ad33b04e669d6f3e59cefcc108` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:54.212984 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584f553e-a7d0-419e-8613-39e72be45cb4 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:54.213540 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed30dcb-377b-44bf-96bd-ac60d3004c94 None admin] RBAC: Authorizing `identity:get_user(user_id=d09a36ad33b04e669d6f3e59cefcc108)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:54.215100 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed30dcb-377b-44bf-96bd-ac60d3004c94 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:54.216757 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 130/265] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Sep 9 16:17:53 2022] GET /identity/v3/users/d09a36ad33b04e669d6f3e59cefcc108 => generated 283 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:17:54.222291 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed30dcb-377b-44bf-96bd-ac60d3004c94 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:54.226031 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:17:54.413462 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed30dcb-377b-44bf-96bd-ac60d3004c94 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:54.424662 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584f553e-a7d0-419e-8613-39e72be45cb4 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:54.479706 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a740402-65e3-4435-ae2b-692f2536206c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:54.480314 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a740402-65e3-4435-ae2b-692f2536206c None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:54.480593 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a740402-65e3-4435-ae2b-692f2536206c None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:54.480863 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a740402-65e3-4435-ae2b-692f2536206c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:54.481588 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a740402-65e3-4435-ae2b-692f2536206c None admin] RBAC: Adding query filter params (role.id=0a36d1be416f4089be19be979943b731, scope.project.id=b42bed1e233c4e71a1ec8ca3ae42c433, user.id=d09a36ad33b04e669d6f3e59cefcc108) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:17:54.481898 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a740402-65e3-4435-ae2b-692f2536206c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:54.482616 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c748a0e9-543e-4304-b455-1ae3144c656e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:54.483424 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c748a0e9-543e-4304-b455-1ae3144c656e None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:54.483543 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a740402-65e3-4435-ae2b-692f2536206c None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:54.483991 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c748a0e9-543e-4304-b455-1ae3144c656e None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:54.484434 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c748a0e9-543e-4304-b455-1ae3144c656e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:54.490336 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 136/266] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Sep 9 16:17:54 2022] GET /identity/v3/role_assignments?user.id=d09a36ad33b04e669d6f3e59cefcc108&scope.project.id=b42bed1e233c4e71a1ec8ca3ae42c433&role.id=0a36d1be416f4089be19be979943b731 => generated 608 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 16:17:54.542791 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:17:54.585610 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c748a0e9-543e-4304-b455-1ae3144c656e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:54.587258 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c748a0e9-543e-4304-b455-1ae3144c656e None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:54.730477 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 131/267] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Sep 9 16:17:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 509 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 09 16:17:54.733560 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a740402-65e3-4435-ae2b-692f2536206c None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:54.746538 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d422ae1d-3ece-4574-a405-f3a3b21f9cda None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:54.746829 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d422ae1d-3ece-4574-a405-f3a3b21f9cda None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:54.747087 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d422ae1d-3ece-4574-a405-f3a3b21f9cda None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:54.749041 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 132/268] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:17:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 16:17:54.754925 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dbeaa3-c308-4a37-b226-3cdff99fb835 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:54.755201 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dbeaa3-c308-4a37-b226-3cdff99fb835 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:54.755472 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dbeaa3-c308-4a37-b226-3cdff99fb835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:54.777361 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-01dbeaa3-c308-4a37-b226-3cdff99fb835 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:17:54.778948 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-01dbeaa3-c308-4a37-b226-3cdff99fb835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:17:54.837294 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:17:54.856642 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:17:54.870764 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 133/269] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:17:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 16:17:54.891773 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a740402-65e3-4435-ae2b-692f2536206c None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:54.947391 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3493656e-0083-4e23-a814-2b05054e8945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:54.948834 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3493656e-0083-4e23-a814-2b05054e8945 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:54.949315 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3493656e-0083-4e23-a814-2b05054e8945 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:54.949786 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3493656e-0083-4e23-a814-2b05054e8945 None admin] PATH_INFO: `/v3/projects/b42bed1e233c4e71a1ec8ca3ae42c433` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:54.954985 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3493656e-0083-4e23-a814-2b05054e8945 None admin] RBAC: Authorizing `identity:get_project(project_id=b42bed1e233c4e71a1ec8ca3ae42c433)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:54.957237 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3493656e-0083-4e23-a814-2b05054e8945 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:54.959120 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 137/270] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Sep 9 16:17:54 2022] GET /identity/v3/projects/b42bed1e233c4e71a1ec8ca3ae42c433 => generated 302 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:17:54.965333 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dbeaa3-c308-4a37-b226-3cdff99fb835 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:55.058011 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c7efa7-a1a2-4938-92a4-5c34937652df None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:55.058194 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c7efa7-a1a2-4938-92a4-5c34937652df None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:55.058510 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c7efa7-a1a2-4938-92a4-5c34937652df None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:55.061803 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 138/271] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:17:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:17:55.068009 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae9c2df-63e8-4b54-9a62-df26b92badbb None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:55.068294 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae9c2df-63e8-4b54-9a62-df26b92badbb None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:55.068570 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae9c2df-63e8-4b54-9a62-df26b92badbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:55.100216 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-cae9c2df-63e8-4b54-9a62-df26b92badbb None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:17:55.101418 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-cae9c2df-63e8-4b54-9a62-df26b92badbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:17:55.106889 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dbeaa3-c308-4a37-b226-3cdff99fb835 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:55.152293 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1665d76e-c4cc-4f2e-a3ac-4a663a6b5ea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:55.152905 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1665d76e-c4cc-4f2e-a3ac-4a663a6b5ea3 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:55.153180 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1665d76e-c4cc-4f2e-a3ac-4a663a6b5ea3 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:55.153443 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1665d76e-c4cc-4f2e-a3ac-4a663a6b5ea3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:55.154162 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1665d76e-c4cc-4f2e-a3ac-4a663a6b5ea3 None admin] RBAC: Adding query filter params (role.id=9452afb4ffe54eb7b7b5b0aff7dd00ed, scope.project.id=b42bed1e233c4e71a1ec8ca3ae42c433, user.id=d09a36ad33b04e669d6f3e59cefcc108) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:17:55.154501 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1665d76e-c4cc-4f2e-a3ac-4a663a6b5ea3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:55.155945 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1665d76e-c4cc-4f2e-a3ac-4a663a6b5ea3 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:55.166553 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 134/272] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Sep 9 16:17:54 2022] GET /identity/v3/role_assignments?user.id=d09a36ad33b04e669d6f3e59cefcc108&scope.project.id=b42bed1e233c4e71a1ec8ca3ae42c433&role.id=9452afb4ffe54eb7b7b5b0aff7dd00ed => generated 608 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:17:55.213194 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 139/273] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:17:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 16:17:55.245883 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1665d76e-c4cc-4f2e-a3ac-4a663a6b5ea3 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:55.361406 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:17:55.421923 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1665d76e-c4cc-4f2e-a3ac-4a663a6b5ea3 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:55.460905 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40233e67-9b14-4aff-b65c-d359be33291b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:55.461874 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40233e67-9b14-4aff-b65c-d359be33291b None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:55.462383 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40233e67-9b14-4aff-b65c-d359be33291b None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:55.462891 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40233e67-9b14-4aff-b65c-d359be33291b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:55.464203 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40233e67-9b14-4aff-b65c-d359be33291b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:55.465863 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40233e67-9b14-4aff-b65c-d359be33291b None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:55.468041 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 135/274] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 16:17:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:17:55.474381 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae9c2df-63e8-4b54-9a62-df26b92badbb None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:55.541189 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40233e67-9b14-4aff-b65c-d359be33291b None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:55.556590 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:17:55.615406 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae9c2df-63e8-4b54-9a62-df26b92badbb None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:55.651586 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba14c18f-687a-4521-8804-e02c23d3df82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:55.652189 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba14c18f-687a-4521-8804-e02c23d3df82 None admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:55.652295 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40233e67-9b14-4aff-b65c-d359be33291b None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:55.652454 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba14c18f-687a-4521-8804-e02c23d3df82 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:55.652728 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba14c18f-687a-4521-8804-e02c23d3df82 None admin] PATH_INFO: `/v3/users` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:55.653362 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba14c18f-687a-4521-8804-e02c23d3df82 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:55.654907 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba14c18f-687a-4521-8804-e02c23d3df82 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:55.680865 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:17:55.686511 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 140/275] 10.222.0.27 () {60 vars in 1132 bytes} [Fri Sep 9 16:17:55 2022] POST /identity/v3/users => generated 293 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:17:55.691081 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e167a0c-61c8-48a4-9a95-aad7304c49ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:55.691736 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e167a0c-61c8-48a4-9a95-aad7304c49ce None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:55.692015 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e167a0c-61c8-48a4-9a95-aad7304c49ce None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:55.692286 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e167a0c-61c8-48a4-9a95-aad7304c49ce None admin] PATH_INFO: `/v3/roles/member` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:55.705094 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e167a0c-61c8-48a4-9a95-aad7304c49ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 16:17:55.711470 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-4e167a0c-61c8-48a4-9a95-aad7304c49ce None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 16:17:55.711470 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:17:55.711470 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:17:55.711470 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:17:55.711470 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:17:55.711470 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:17:55.711470 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:17:55.711470 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:17:55.711470 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:17:55.711470 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:17:55.711470 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:17:55.711470 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:17:55.711470 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 16:17:55.711470 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 16:17:55.711470 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 16:17:55.711470 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 16:17:55.712436 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 16:17:55.712436 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 16:17:55.712436 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 16:17:55.712436 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 16:17:55.712436 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:17:55.712436 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:17:55.712436 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:17:55.712436 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:17:55.712436 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:17:55.712436 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:17:55.712436 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:17:55.712436 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Sep 09 16:17:55.712436 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:17:55.712436 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:17:55.712436 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:17:55.712436 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:17:55.713510 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:17:55.713510 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:17:55.713510 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:17:55.713510 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:17:55.713510 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 16:17:55.713510 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 16:17:55.713510 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 16:17:55.713510 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 16:17:55.713510 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 16:17:55.713510 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 16:17:55.713510 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 16:17:55.713510 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:17:55.713510 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 136/276] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Sep 9 16:17:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 16:17:55.720552 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba14c18f-687a-4521-8804-e02c23d3df82 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:55.839999 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba14c18f-687a-4521-8804-e02c23d3df82 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:55.866158 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:17:55.879940 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caadb4b-a00b-47ea-b184-07b84ca0b16b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:55.880580 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caadb4b-a00b-47ea-b184-07b84ca0b16b None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:55.881035 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caadb4b-a00b-47ea-b184-07b84ca0b16b None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:55.881483 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caadb4b-a00b-47ea-b184-07b84ca0b16b None admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:55.882461 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caadb4b-a00b-47ea-b184-07b84ca0b16b None admin] RBAC: Adding query filter params (name=member) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:17:55.882766 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caadb4b-a00b-47ea-b184-07b84ca0b16b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:55.884243 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caadb4b-a00b-47ea-b184-07b84ca0b16b None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:55.893326 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 141/277] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Sep 9 16:17:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:17:55.899697 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e167a0c-61c8-48a4-9a95-aad7304c49ce None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:56.009561 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e167a0c-61c8-48a4-9a95-aad7304c49ce None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:56.045198 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdff82b-703d-4c2b-8492-1b03a44b62e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:56.045831 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdff82b-703d-4c2b-8492-1b03a44b62e7 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:56.046109 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdff82b-703d-4c2b-8492-1b03a44b62e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:56.046425 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdff82b-703d-4c2b-8492-1b03a44b62e7 None admin] PATH_INFO: `/v3/users/ca0e01f2d6c1443198bbe23e815515be` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:56.062811 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdff82b-703d-4c2b-8492-1b03a44b62e7 None admin] RBAC: Authorizing `identity:get_user(user_id=ca0e01f2d6c1443198bbe23e815515be)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:56.064306 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdff82b-703d-4c2b-8492-1b03a44b62e7 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:56.066673 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 137/278] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Sep 9 16:17:55 2022] GET /identity/v3/users/ca0e01f2d6c1443198bbe23e815515be => generated 293 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:17:56.072835 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caadb4b-a00b-47ea-b184-07b84ca0b16b None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:56.196060 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caadb4b-a00b-47ea-b184-07b84ca0b16b None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:56.233466 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553365f7-694e-49bf-b5b4-295f867a75da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:56.234475 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553365f7-694e-49bf-b5b4-295f867a75da None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:56.234966 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553365f7-694e-49bf-b5b4-295f867a75da None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:56.235426 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553365f7-694e-49bf-b5b4-295f867a75da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:56.236329 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553365f7-694e-49bf-b5b4-295f867a75da None admin] RBAC: Adding query filter params (role.id=b38e84bf077846ee802e6bb1bad83522, user.id=ca0e01f2d6c1443198bbe23e815515be, scope.system=all) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:17:56.236835 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553365f7-694e-49bf-b5b4-295f867a75da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:56.238565 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553365f7-694e-49bf-b5b4-295f867a75da None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:56.244064 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 142/279] 10.222.0.27 () {56 vars in 1308 bytes} [Fri Sep 9 16:17:56 2022] GET /identity/v3/role_assignments?user.id=ca0e01f2d6c1443198bbe23e815515be&scope.system=all&role.id=b38e84bf077846ee802e6bb1bad83522 => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:17:56.254344 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3edfa7a-4b91-41e4-9ea3-b9d4d883ccfa None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:56.254344 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3edfa7a-4b91-41e4-9ea3-b9d4d883ccfa None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:56.254344 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3edfa7a-4b91-41e4-9ea3-b9d4d883ccfa None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:56.254344 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 138/280] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:17:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:17:56.259402 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7202ed-de56-40cb-a29b-324911c4ae56 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:56.259692 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7202ed-de56-40cb-a29b-324911c4ae56 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:56.259968 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7202ed-de56-40cb-a29b-324911c4ae56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:56.279787 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-cd7202ed-de56-40cb-a29b-324911c4ae56 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:17:56.281007 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-cd7202ed-de56-40cb-a29b-324911c4ae56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:17:56.330741 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:17:56.379388 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 143/281] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:17:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 16:17:56.718357 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3edfa7a-4b91-41e4-9ea3-b9d4d883ccfa None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:56.724034 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f03432-9595-436d-948a-7508f254521e None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:56.724320 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f03432-9595-436d-948a-7508f254521e None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:56.724588 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f03432-9595-436d-948a-7508f254521e None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:56.726204 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 144/282] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:17:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:17:56.731399 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f95c29-9d07-4742-ba6a-58c4ea779daa None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:56.731674 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f95c29-9d07-4742-ba6a-58c4ea779daa None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:56.731937 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f95c29-9d07-4742-ba6a-58c4ea779daa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:56.759381 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-b3f95c29-9d07-4742-ba6a-58c4ea779daa None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:17:56.760669 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-b3f95c29-9d07-4742-ba6a-58c4ea779daa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:17:56.797373 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:17:56.856708 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3edfa7a-4b91-41e4-9ea3-b9d4d883ccfa None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:56.881100 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 145/283] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:17:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 16:17:56.892335 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9436af3f-9463-4478-887d-819084b538dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:56.892968 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9436af3f-9463-4478-887d-819084b538dd None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:56.893293 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9436af3f-9463-4478-887d-819084b538dd None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:56.893564 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9436af3f-9463-4478-887d-819084b538dd None admin] PATH_INFO: `/v3/roles/member` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:56.904595 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9436af3f-9463-4478-887d-819084b538dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 16:17:56.909617 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-9436af3f-9463-4478-887d-819084b538dd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 16:17:56.909617 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:17:56.909617 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:17:56.909617 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:17:56.909617 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:17:56.909617 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:17:56.909617 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:17:56.909617 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:17:56.909617 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:17:56.909617 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:17:56.909617 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:17:56.909617 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:17:56.909617 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 16:17:56.909617 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 16:17:56.909617 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 16:17:56.909617 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 16:17:56.910539 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 16:17:56.910539 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 16:17:56.910539 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 16:17:56.910539 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 16:17:56.910539 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:17:56.910539 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:17:56.910539 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:17:56.910539 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:17:56.910539 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:17:56.910539 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:17:56.910539 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:17:56.910539 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Sep 09 16:17:56.910539 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:17:56.910539 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:17:56.910539 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:17:56.910539 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:17:56.911319 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:17:56.911319 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:17:56.911319 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:17:56.911319 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:17:56.911319 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 16:17:56.911319 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 16:17:56.911319 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 16:17:56.911319 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 16:17:56.911319 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 16:17:56.911319 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 16:17:56.911319 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 16:17:56.911319 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:17:56.912558 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 139/284] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Sep 9 16:17:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:17:56.917770 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f95c29-9d07-4742-ba6a-58c4ea779daa None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:57.077973 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f95c29-9d07-4742-ba6a-58c4ea779daa None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:57.089574 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:17:57.125732 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef99e17-f240-4167-94bd-dc90953b1466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:57.126359 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef99e17-f240-4167-94bd-dc90953b1466 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:57.126639 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef99e17-f240-4167-94bd-dc90953b1466 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:57.126910 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef99e17-f240-4167-94bd-dc90953b1466 None admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:57.127568 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef99e17-f240-4167-94bd-dc90953b1466 None admin] RBAC: Adding query filter params (name=member) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:17:57.127869 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef99e17-f240-4167-94bd-dc90953b1466 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:57.129799 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef99e17-f240-4167-94bd-dc90953b1466 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:57.141700 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 146/285] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Sep 9 16:17:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:17:57.148814 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9436af3f-9463-4478-887d-819084b538dd None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:57.188304 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef99e17-f240-4167-94bd-dc90953b1466 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:57.338507 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef99e17-f240-4167-94bd-dc90953b1466 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:57.354950 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9436af3f-9463-4478-887d-819084b538dd None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:57.358326 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:17:57.388691 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29dbf61-63af-4926-8e9a-b136102992f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:57.390002 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29dbf61-63af-4926-8e9a-b136102992f1 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:57.390578 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29dbf61-63af-4926-8e9a-b136102992f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:57.391048 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29dbf61-63af-4926-8e9a-b136102992f1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:57.403343 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29dbf61-63af-4926-8e9a-b136102992f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 16:17:57.410729 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-f29dbf61-63af-4926-8e9a-b136102992f1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 16:17:57.410729 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:17:57.410729 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:17:57.410729 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:17:57.410729 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:17:57.410729 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:17:57.410729 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:17:57.410729 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:17:57.410729 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:17:57.410729 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:17:57.410729 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:17:57.410729 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:17:57.410729 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 16:17:57.410729 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 16:17:57.410729 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 16:17:57.410729 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 16:17:57.411622 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 16:17:57.411622 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 16:17:57.411622 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 16:17:57.411622 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 16:17:57.411622 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:17:57.411622 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:17:57.411622 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:17:57.411622 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:17:57.411622 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:17:57.411622 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:17:57.411622 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:17:57.411622 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 16:17:57.411622 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:17:57.411622 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:17:57.411622 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:17:57.411622 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:17:57.412412 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:17:57.412412 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:17:57.412412 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:17:57.412412 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:17:57.412412 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 16:17:57.412412 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 16:17:57.412412 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 16:17:57.412412 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 16:17:57.412412 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 16:17:57.412412 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 16:17:57.412412 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 16:17:57.412412 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 16:17:57.420299 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 147/286] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Sep 9 16:17:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 16:17:57.421791 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29dbf61-63af-4926-8e9a-b136102992f1 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:57.439597 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2bc4d2-90a2-4c86-8d55-e662e46c6c0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:57.440362 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2bc4d2-90a2-4c86-8d55-e662e46c6c0a None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:57.440641 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2bc4d2-90a2-4c86-8d55-e662e46c6c0a None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:57.440908 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2bc4d2-90a2-4c86-8d55-e662e46c6c0a None admin] PATH_INFO: `/v3/users/6712ee5dd44e4bef989b7054c2c7a0a6` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:57.442978 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2bc4d2-90a2-4c86-8d55-e662e46c6c0a None admin] RBAC: Authorizing `identity:get_user(user_id=6712ee5dd44e4bef989b7054c2c7a0a6)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:57.444669 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2bc4d2-90a2-4c86-8d55-e662e46c6c0a None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:57.446587 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 140/287] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Sep 9 16:17:57 2022] GET /identity/v3/users/6712ee5dd44e4bef989b7054c2c7a0a6 => generated 297 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:17:57.451943 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2bc4d2-90a2-4c86-8d55-e662e46c6c0a None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:57.458700 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:17:57.568306 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29dbf61-63af-4926-8e9a-b136102992f1 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:57.637974 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7aa486-3d22-4abe-849f-b19fa9b23877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:57.641529 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7aa486-3d22-4abe-849f-b19fa9b23877 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:57.642289 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7aa486-3d22-4abe-849f-b19fa9b23877 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:57.642986 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7aa486-3d22-4abe-849f-b19fa9b23877 None admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:57.646724 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2bc4d2-90a2-4c86-8d55-e662e46c6c0a None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:57.647971 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7aa486-3d22-4abe-849f-b19fa9b23877 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:17:57.648670 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7aa486-3d22-4abe-849f-b19fa9b23877 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:57.651076 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7aa486-3d22-4abe-849f-b19fa9b23877 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:57.681261 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 148/288] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Sep 9 16:17:57 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:17:57.695932 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7aa486-3d22-4abe-849f-b19fa9b23877 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:57.735009 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573833af-7496-4f9f-97df-ea5aadc82036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:57.735631 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573833af-7496-4f9f-97df-ea5aadc82036 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:57.735908 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573833af-7496-4f9f-97df-ea5aadc82036 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:57.736178 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573833af-7496-4f9f-97df-ea5aadc82036 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:57.824605 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:17:57.835100 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:17:57.846834 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7aa486-3d22-4abe-849f-b19fa9b23877 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:57.890100 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad24483-b466-4bbd-ae0f-b9224e8c48b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:57.890682 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad24483-b466-4bbd-ae0f-b9224e8c48b5 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:57.890954 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad24483-b466-4bbd-ae0f-b9224e8c48b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:57.891222 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad24483-b466-4bbd-ae0f-b9224e8c48b5 None admin] PATH_INFO: `/v3/users/0e880ec0a0604a3d917e5ee944adcd99` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:57.895241 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad24483-b466-4bbd-ae0f-b9224e8c48b5 None admin] RBAC: Authorizing `identity:get_user(user_id=0e880ec0a0604a3d917e5ee944adcd99)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:57.897396 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573833af-7496-4f9f-97df-ea5aadc82036 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:57.898893 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573833af-7496-4f9f-97df-ea5aadc82036 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:57.901153 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad24483-b466-4bbd-ae0f-b9224e8c48b5 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:57.902768 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 149/289] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Sep 9 16:17:57 2022] GET /identity/v3/users/0e880ec0a0604a3d917e5ee944adcd99 => generated 297 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 16:17:57.908469 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad24483-b466-4bbd-ae0f-b9224e8c48b5 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:58.023759 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad24483-b466-4bbd-ae0f-b9224e8c48b5 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:58.074446 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65f7cc2-f828-4ab8-bd17-38d4c622b415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:58.075084 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65f7cc2-f828-4ab8-bd17-38d4c622b415 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:58.075361 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65f7cc2-f828-4ab8-bd17-38d4c622b415 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:58.075629 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65f7cc2-f828-4ab8-bd17-38d4c622b415 None admin] PATH_INFO: `/v3/projects/b42bed1e233c4e71a1ec8ca3ae42c433` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:58.077398 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65f7cc2-f828-4ab8-bd17-38d4c622b415 None admin] RBAC: Authorizing `identity:get_project(project_id=b42bed1e233c4e71a1ec8ca3ae42c433)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:58.078892 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65f7cc2-f828-4ab8-bd17-38d4c622b415 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:58.080507 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 150/290] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Sep 9 16:17:57 2022] GET /identity/v3/projects/b42bed1e233c4e71a1ec8ca3ae42c433 => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 16:17:58.088115 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65f7cc2-f828-4ab8-bd17-38d4c622b415 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:58.112084 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 141/291] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Sep 9 16:17:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 660 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 16:17:58.123325 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573833af-7496-4f9f-97df-ea5aadc82036 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:58.129602 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:17:58.209849 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65f7cc2-f828-4ab8-bd17-38d4c622b415 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:58.217743 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:17:58.249112 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bbee7b-f8d9-4e3c-9c1e-bada3659a164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:58.249774 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bbee7b-f8d9-4e3c-9c1e-bada3659a164 None admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:58.250052 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bbee7b-f8d9-4e3c-9c1e-bada3659a164 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:58.250338 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bbee7b-f8d9-4e3c-9c1e-bada3659a164 None admin] PATH_INFO: `/v3/projects/b42bed1e233c4e71a1ec8ca3ae42c433/users/0e880ec0a0604a3d917e5ee944adcd99/roles/99ea656aad1b4b0c990db50b9b878b90` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:58.252368 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bbee7b-f8d9-4e3c-9c1e-bada3659a164 None admin] RBAC: Authorizing `identity:create_grant(project_id=b42bed1e233c4e71a1ec8ca3ae42c433, user_id=0e880ec0a0604a3d917e5ee944adcd99, role_id=99ea656aad1b4b0c990db50b9b878b90)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:58.254340 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bbee7b-f8d9-4e3c-9c1e-bada3659a164 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:58.271390 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573833af-7496-4f9f-97df-ea5aadc82036 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:58.275207 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 151/292] 10.222.0.27 () {58 vars in 1439 bytes} [Fri Sep 9 16:17:58 2022] PUT /identity/v3/projects/b42bed1e233c4e71a1ec8ca3ae42c433/users/0e880ec0a0604a3d917e5ee944adcd99/roles/99ea656aad1b4b0c990db50b9b878b90 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:17:58.345700 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d47d07-dbf2-473d-8c67-8a2d6fc9b7b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:58.346659 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d47d07-dbf2-473d-8c67-8a2d6fc9b7b0 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:58.346937 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d47d07-dbf2-473d-8c67-8a2d6fc9b7b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:58.347241 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d47d07-dbf2-473d-8c67-8a2d6fc9b7b0 None admin] PATH_INFO: `/v3/projects/b42bed1e233c4e71a1ec8ca3ae42c433` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:58.355236 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d47d07-dbf2-473d-8c67-8a2d6fc9b7b0 None admin] RBAC: Authorizing `identity:get_project(project_id=b42bed1e233c4e71a1ec8ca3ae42c433)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:58.356784 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d47d07-dbf2-473d-8c67-8a2d6fc9b7b0 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:58.358892 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 142/293] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Sep 9 16:17:58 2022] GET /identity/v3/projects/b42bed1e233c4e71a1ec8ca3ae42c433 => generated 302 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:17:58.365245 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bbee7b-f8d9-4e3c-9c1e-bada3659a164 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:58.497077 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:17:58.514389 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bbee7b-f8d9-4e3c-9c1e-bada3659a164 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:58.554163 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962d3c00-fe8d-416f-8a99-ec09d4586171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:58.555171 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962d3c00-fe8d-416f-8a99-ec09d4586171 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:58.555649 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962d3c00-fe8d-416f-8a99-ec09d4586171 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:58.556142 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962d3c00-fe8d-416f-8a99-ec09d4586171 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:58.557085 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962d3c00-fe8d-416f-8a99-ec09d4586171 None admin] RBAC: Adding query filter params (role.id=b38e84bf077846ee802e6bb1bad83522, scope.project.id=b42bed1e233c4e71a1ec8ca3ae42c433, user.id=6712ee5dd44e4bef989b7054c2c7a0a6) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:17:58.557603 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962d3c00-fe8d-416f-8a99-ec09d4586171 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:58.559613 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962d3c00-fe8d-416f-8a99-ec09d4586171 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:58.567221 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 152/294] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Sep 9 16:17:58 2022] GET /identity/v3/role_assignments?user.id=6712ee5dd44e4bef989b7054c2c7a0a6&scope.project.id=b42bed1e233c4e71a1ec8ca3ae42c433&role.id=b38e84bf077846ee802e6bb1bad83522 => generated 608 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:17:58.686851 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d9fdf6-0055-4424-850e-10d34f6faccf None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:58.687516 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d9fdf6-0055-4424-850e-10d34f6faccf None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:58.688004 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d9fdf6-0055-4424-850e-10d34f6faccf None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:58.689603 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 143/295] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:17:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:17:58.693426 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0da528-17ce-43e1-945b-1a5fed0ec965 None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:58.693845 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0da528-17ce-43e1-945b-1a5fed0ec965 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:58.694015 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0da528-17ce-43e1-945b-1a5fed0ec965 None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:58.695478 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ca0bfd-77a4-4a50-8015-97d217115a0f None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:58.695662 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 153/296] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:17:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:17:58.696120 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ca0bfd-77a4-4a50-8015-97d217115a0f None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:58.696586 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ca0bfd-77a4-4a50-8015-97d217115a0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:58.701259 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd6cad4-251e-4c9c-bae4-43702f7ad86d None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:58.701554 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd6cad4-251e-4c9c-bae4-43702f7ad86d None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:58.701812 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd6cad4-251e-4c9c-bae4-43702f7ad86d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:58.721607 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-cfd6cad4-251e-4c9c-bae4-43702f7ad86d None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:17:58.723501 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-cfd6cad4-251e-4c9c-bae4-43702f7ad86d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:17:58.727900 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-f2ca0bfd-77a4-4a50-8015-97d217115a0f None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:17:58.729493 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-f2ca0bfd-77a4-4a50-8015-97d217115a0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:17:58.850867 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 154/297] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:17:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 16:17:58.855799 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 144/298] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:17:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 16:17:59.054334 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6476601f-7fad-4372-a220-f74a5b030280 None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:59.054720 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6476601f-7fad-4372-a220-f74a5b030280 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:59.054893 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6476601f-7fad-4372-a220-f74a5b030280 None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:59.056494 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 155/299] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:17:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:17:59.062004 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6315b85-72b6-40ae-bf5c-52a4a369a1ea None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:59.062292 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6315b85-72b6-40ae-bf5c-52a4a369a1ea None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:59.062593 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6315b85-72b6-40ae-bf5c-52a4a369a1ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:59.086050 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-a6315b85-72b6-40ae-bf5c-52a4a369a1ea None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:17:59.087278 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-a6315b85-72b6-40ae-bf5c-52a4a369a1ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:17:59.137101 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6476601f-7fad-4372-a220-f74a5b030280 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:59.168333 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:17:59.173386 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 145/300] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:17:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 16:17:59.174208 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6315b85-72b6-40ae-bf5c-52a4a369a1ea None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:59.249603 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:17:59.277734 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6476601f-7fad-4372-a220-f74a5b030280 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:59.289880 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6315b85-72b6-40ae-bf5c-52a4a369a1ea None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:59.323228 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbfe7e6-2698-4066-9087-dee379f16d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:59.323984 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbfe7e6-2698-4066-9087-dee379f16d08 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:59.324356 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbfe7e6-2698-4066-9087-dee379f16d08 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:59.324720 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbfe7e6-2698-4066-9087-dee379f16d08 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:59.336170 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90574967-2c56-424b-8fa4-deb4a9b589aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:59.336355 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbfe7e6-2698-4066-9087-dee379f16d08 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 16:17:59.337115 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90574967-2c56-424b-8fa4-deb4a9b589aa None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:59.337540 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90574967-2c56-424b-8fa4-deb4a9b589aa None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:59.337949 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90574967-2c56-424b-8fa4-deb4a9b589aa None admin] PATH_INFO: `/v3/domains/default` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:59.339245 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90574967-2c56-424b-8fa4-deb4a9b589aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:59.340859 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90574967-2c56-424b-8fa4-deb4a9b589aa None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:59.341844 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-9dbfe7e6-2698-4066-9087-dee379f16d08 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 16:17:59.341844 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:17:59.341844 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:17:59.341844 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:17:59.341844 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:17:59.341844 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:17:59.341844 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:17:59.341844 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:17:59.341844 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:17:59.341844 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:17:59.341844 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:17:59.341844 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:17:59.341844 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 16:17:59.341844 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 16:17:59.341844 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 16:17:59.341844 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 16:17:59.342949 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 16:17:59.342949 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 16:17:59.342949 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 16:17:59.342949 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 16:17:59.342949 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:17:59.342949 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:17:59.342949 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:17:59.342949 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:17:59.342949 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:17:59.342949 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:17:59.342949 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:17:59.342949 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 16:17:59.342949 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:17:59.342949 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:17:59.342949 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:17:59.342949 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:17:59.343944 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:17:59.343944 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:17:59.343944 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:17:59.343944 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:17:59.343944 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 16:17:59.343944 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 16:17:59.343944 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 16:17:59.343944 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 16:17:59.343944 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 16:17:59.343944 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 16:17:59.343944 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 16:17:59.343944 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 16:17:59.345541 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 146/301] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 16:17:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:17:59.351082 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 156/302] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Sep 9 16:17:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:17:59.352182 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbfe7e6-2698-4066-9087-dee379f16d08 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:59.361750 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90574967-2c56-424b-8fa4-deb4a9b589aa None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:59.430209 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:17:59.467540 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90574967-2c56-424b-8fa4-deb4a9b589aa None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:59.477455 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbfe7e6-2698-4066-9087-dee379f16d08 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:59.505243 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7135fc1d-6c96-4a71-806f-d0c65f06738b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:59.505845 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7135fc1d-6c96-4a71-806f-d0c65f06738b None admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:59.506120 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7135fc1d-6c96-4a71-806f-d0c65f06738b None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:59.506657 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7135fc1d-6c96-4a71-806f-d0c65f06738b None admin] PATH_INFO: `/v3/groups` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:59.507022 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7135fc1d-6c96-4a71-806f-d0c65f06738b None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:59.508440 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7135fc1d-6c96-4a71-806f-d0c65f06738b None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:59.514339 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0631c0-814d-4e34-828d-763cc3908ede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:59.514771 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0631c0-814d-4e34-828d-763cc3908ede None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:59.515049 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0631c0-814d-4e34-828d-763cc3908ede None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:59.515416 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0631c0-814d-4e34-828d-763cc3908ede None admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:59.515983 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0631c0-814d-4e34-828d-763cc3908ede None admin] RBAC: Adding query filter params (name=reader) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:17:59.516306 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0631c0-814d-4e34-828d-763cc3908ede None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:59.517774 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0631c0-814d-4e34-828d-763cc3908ede None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:59.525322 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 147/303] 10.222.0.27 () {60 vars in 1134 bytes} [Fri Sep 9 16:17:59 2022] POST /identity/v3/groups => generated 229 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:17:59.526392 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 157/304] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Sep 9 16:17:59 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:17:59.532103 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0631c0-814d-4e34-828d-763cc3908ede None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:59.536287 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7135fc1d-6c96-4a71-806f-d0c65f06738b None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:59.536876 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:17:59.667428 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7135fc1d-6c96-4a71-806f-d0c65f06738b None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:59.686535 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0631c0-814d-4e34-828d-763cc3908ede None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:59.703349 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:17:59.714893 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2efbd2-3066-4598-84fb-055bbc8e646f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:59.715539 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2efbd2-3066-4598-84fb-055bbc8e646f None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:59.715818 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2efbd2-3066-4598-84fb-055bbc8e646f None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:59.716108 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2efbd2-3066-4598-84fb-055bbc8e646f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:59.727551 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05a7b10-0c71-456b-b4e7-20e06d7c6cab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:59.728515 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05a7b10-0c71-456b-b4e7-20e06d7c6cab None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:59.728622 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2efbd2-3066-4598-84fb-055bbc8e646f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 16:17:59.729088 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05a7b10-0c71-456b-b4e7-20e06d7c6cab None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:59.729574 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05a7b10-0c71-456b-b4e7-20e06d7c6cab None admin] PATH_INFO: `/v3/users/428ff010f42445a594e5960703d088a0` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:59.734392 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-9d2efbd2-3066-4598-84fb-055bbc8e646f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 16:17:59.734392 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:17:59.734392 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:17:59.734392 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:17:59.734392 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:17:59.734392 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:17:59.734392 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:17:59.734392 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:17:59.734392 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:17:59.734392 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:17:59.734392 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:17:59.734392 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:17:59.734392 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 16:17:59.734392 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 16:17:59.734392 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 16:17:59.734392 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 16:17:59.735280 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 16:17:59.735280 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 16:17:59.735280 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 16:17:59.735280 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 16:17:59.735280 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:17:59.735280 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:17:59.735280 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:17:59.735280 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:17:59.735280 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:17:59.735280 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:17:59.735280 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:17:59.735280 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Sep 09 16:17:59.735280 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:17:59.735280 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:17:59.735280 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:17:59.735280 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:17:59.736085 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:17:59.736085 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:17:59.736085 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:17:59.736085 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:17:59.736085 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 16:17:59.736085 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 16:17:59.736085 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 16:17:59.736085 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 16:17:59.736085 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 16:17:59.736085 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 16:17:59.736085 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 16:17:59.736085 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:17:59.736085 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 148/305] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Sep 9 16:17:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:17:59.741855 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2efbd2-3066-4598-84fb-055bbc8e646f None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:59.748309 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05a7b10-0c71-456b-b4e7-20e06d7c6cab None admin] RBAC: Authorizing `identity:get_user(user_id=428ff010f42445a594e5960703d088a0)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:59.749766 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05a7b10-0c71-456b-b4e7-20e06d7c6cab None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:59.751620 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 158/306] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Sep 9 16:17:59 2022] GET /identity/v3/users/428ff010f42445a594e5960703d088a0 => generated 293 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 16:17:59.757127 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05a7b10-0c71-456b-b4e7-20e06d7c6cab None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:59.825076 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:17:59.871202 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05a7b10-0c71-456b-b4e7-20e06d7c6cab None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:59.872545 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2efbd2-3066-4598-84fb-055bbc8e646f None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:17:59.910762 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8e247b-71c2-4b00-bec2-8489c6208a3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:59.911766 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8e247b-71c2-4b00-bec2-8489c6208a3d None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:59.912142 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8e247b-71c2-4b00-bec2-8489c6208a3d None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:59.912545 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8e247b-71c2-4b00-bec2-8489c6208a3d None admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:59.913318 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8e247b-71c2-4b00-bec2-8489c6208a3d None admin] RBAC: Adding query filter params (name=member) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:17:59.913712 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8e247b-71c2-4b00-bec2-8489c6208a3d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:59.915248 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8e247b-71c2-4b00-bec2-8489c6208a3d None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:59.919014 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595c2662-e733-4ef3-8139-fcdc99916722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:17:59.919617 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595c2662-e733-4ef3-8139-fcdc99916722 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:17:59.919889 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595c2662-e733-4ef3-8139-fcdc99916722 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:17:59.920154 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595c2662-e733-4ef3-8139-fcdc99916722 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:17:59.920866 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595c2662-e733-4ef3-8139-fcdc99916722 None admin] RBAC: Adding query filter params (role.id=99ea656aad1b4b0c990db50b9b878b90, user.id=428ff010f42445a594e5960703d088a0, scope.system=all) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:17:59.921725 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595c2662-e733-4ef3-8139-fcdc99916722 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:17:59.923482 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595c2662-e733-4ef3-8139-fcdc99916722 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:17:59.925111 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 149/307] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Sep 9 16:17:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:17:59.930604 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8e247b-71c2-4b00-bec2-8489c6208a3d None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:17:59.933793 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 159/308] 10.222.0.27 () {56 vars in 1308 bytes} [Fri Sep 9 16:17:59 2022] GET /identity/v3/role_assignments?user.id=428ff010f42445a594e5960703d088a0&scope.system=all&role.id=99ea656aad1b4b0c990db50b9b878b90 => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 16:17:59.988305 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:00.049456 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8e247b-71c2-4b00-bec2-8489c6208a3d None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:00.089540 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629bbddd-ca5e-454a-b923-9c88e520fca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:00.090195 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629bbddd-ca5e-454a-b923-9c88e520fca9 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:00.090506 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629bbddd-ca5e-454a-b923-9c88e520fca9 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:00.090775 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629bbddd-ca5e-454a-b923-9c88e520fca9 None admin] PATH_INFO: `/v3/users/ca0e01f2d6c1443198bbe23e815515be` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:00.091943 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629bbddd-ca5e-454a-b923-9c88e520fca9 None admin] RBAC: Authorizing `identity:get_user(user_id=ca0e01f2d6c1443198bbe23e815515be)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:00.093412 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629bbddd-ca5e-454a-b923-9c88e520fca9 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:00.095369 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 150/309] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Sep 9 16:17:59 2022] GET /identity/v3/users/ca0e01f2d6c1443198bbe23e815515be => generated 293 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 16:18:00.102012 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595c2662-e733-4ef3-8139-fcdc99916722 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:00.212852 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595c2662-e733-4ef3-8139-fcdc99916722 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:00.239238 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:00.248897 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bafa97-46a3-4110-bb33-c6c4113f22d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:00.249606 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bafa97-46a3-4110-bb33-c6c4113f22d7 None admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:00.249930 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bafa97-46a3-4110-bb33-c6c4113f22d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:00.250201 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bafa97-46a3-4110-bb33-c6c4113f22d7 None admin] PATH_INFO: `/v3/system/users/ca0e01f2d6c1443198bbe23e815515be/roles/b38e84bf077846ee802e6bb1bad83522` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:00.251626 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bafa97-46a3-4110-bb33-c6c4113f22d7 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=ca0e01f2d6c1443198bbe23e815515be, role_id=b38e84bf077846ee802e6bb1bad83522)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:00.252994 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bafa97-46a3-4110-bb33-c6c4113f22d7 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:00.266493 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 160/310] 10.222.0.27 () {58 vars in 1334 bytes} [Fri Sep 9 16:18:00 2022] PUT /identity/v3/system/users/ca0e01f2d6c1443198bbe23e815515be/roles/b38e84bf077846ee802e6bb1bad83522 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:18:00.675945 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf980c7-2233-47d1-b853-480ac5a95eae None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:00.676442 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf980c7-2233-47d1-b853-480ac5a95eae None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:00.676518 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf980c7-2233-47d1-b853-480ac5a95eae None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:00.678080 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 151/311] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:18:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:18:00.683406 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba33163e-d647-4cef-9fc0-e04050f90d80 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:00.683692 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba33163e-d647-4cef-9fc0-e04050f90d80 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:00.684221 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba33163e-d647-4cef-9fc0-e04050f90d80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:00.702698 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-ba33163e-d647-4cef-9fc0-e04050f90d80 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:18:00.704000 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-ba33163e-d647-4cef-9fc0-e04050f90d80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:18:00.778422 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 161/312] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:18:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 16:18:01.043990 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf980c7-2233-47d1-b853-480ac5a95eae None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:01.151306 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf980c7-2233-47d1-b853-480ac5a95eae None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:01.170636 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:01.198837 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9190fd8-b7cf-431b-bd0a-4130c4e6e164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:01.199468 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9190fd8-b7cf-431b-bd0a-4130c4e6e164 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:01.199749 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9190fd8-b7cf-431b-bd0a-4130c4e6e164 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:01.200020 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9190fd8-b7cf-431b-bd0a-4130c4e6e164 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:01.211512 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9190fd8-b7cf-431b-bd0a-4130c4e6e164 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 16:18:01.216482 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-c9190fd8-b7cf-431b-bd0a-4130c4e6e164 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 16:18:01.216482 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:18:01.216482 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:18:01.216482 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:18:01.216482 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:18:01.216482 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:18:01.216482 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:18:01.216482 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:18:01.216482 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:18:01.216482 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:18:01.216482 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:18:01.216482 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:18:01.216482 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 16:18:01.216482 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 16:18:01.216482 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 16:18:01.216482 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 16:18:01.217347 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 16:18:01.217347 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 16:18:01.217347 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 16:18:01.217347 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 16:18:01.217347 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:18:01.217347 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:18:01.217347 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:18:01.217347 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:18:01.217347 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:18:01.217347 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:18:01.217347 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:18:01.217347 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Sep 09 16:18:01.217347 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:18:01.217347 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:18:01.217347 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:18:01.217347 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:18:01.218151 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:18:01.218151 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:18:01.218151 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:18:01.218151 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:18:01.218151 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 16:18:01.218151 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 16:18:01.218151 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 16:18:01.218151 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 16:18:01.218151 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 16:18:01.218151 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 16:18:01.218151 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 16:18:01.218151 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:18:01.222756 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 152/313] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Sep 9 16:18:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:18:01.224430 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba33163e-d647-4cef-9fc0-e04050f90d80 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:01.336067 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba33163e-d647-4cef-9fc0-e04050f90d80 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:01.357121 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:01.373127 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325f3f90-096c-4917-aebb-bfc287338aa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:01.373740 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325f3f90-096c-4917-aebb-bfc287338aa3 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:01.374017 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325f3f90-096c-4917-aebb-bfc287338aa3 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:01.374287 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325f3f90-096c-4917-aebb-bfc287338aa3 None admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:01.374966 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325f3f90-096c-4917-aebb-bfc287338aa3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:18:01.375264 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325f3f90-096c-4917-aebb-bfc287338aa3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:01.376945 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325f3f90-096c-4917-aebb-bfc287338aa3 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:01.385732 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 162/314] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Sep 9 16:18:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:18:01.391654 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9190fd8-b7cf-431b-bd0a-4130c4e6e164 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:01.505087 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9190fd8-b7cf-431b-bd0a-4130c4e6e164 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:01.541838 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c850ce7a-315e-4935-b655-dde03338aaf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:01.542945 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c850ce7a-315e-4935-b655-dde03338aaf4 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:01.543430 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c850ce7a-315e-4935-b655-dde03338aaf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:01.543920 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c850ce7a-315e-4935-b655-dde03338aaf4 None admin] PATH_INFO: `/v3/users/0e880ec0a0604a3d917e5ee944adcd99` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:01.545254 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c850ce7a-315e-4935-b655-dde03338aaf4 None admin] RBAC: Authorizing `identity:get_user(user_id=0e880ec0a0604a3d917e5ee944adcd99)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:01.546985 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c850ce7a-315e-4935-b655-dde03338aaf4 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:01.552356 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 153/315] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Sep 9 16:18:01 2022] GET /identity/v3/users/0e880ec0a0604a3d917e5ee944adcd99 => generated 297 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:18:01.555102 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325f3f90-096c-4917-aebb-bfc287338aa3 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:01.664003 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325f3f90-096c-4917-aebb-bfc287338aa3 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:01.702414 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f749bf7-fd24-47d9-bf11-6485db0f83e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:01.703043 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f749bf7-fd24-47d9-bf11-6485db0f83e1 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:01.703319 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f749bf7-fd24-47d9-bf11-6485db0f83e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:01.703724 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f749bf7-fd24-47d9-bf11-6485db0f83e1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:01.755750 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:01.774967 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f749bf7-fd24-47d9-bf11-6485db0f83e1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:01.776427 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f749bf7-fd24-47d9-bf11-6485db0f83e1 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:01.795203 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541f64de-457b-4ac1-a99e-a318d49cc80c None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:01.795703 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541f64de-457b-4ac1-a99e-a318d49cc80c None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:01.795790 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541f64de-457b-4ac1-a99e-a318d49cc80c None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:01.797075 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 154/316] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:18:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 16:18:01.802008 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4623be-023c-47da-9614-b779a1efee6b None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:01.802294 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4623be-023c-47da-9614-b779a1efee6b None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:01.802606 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4623be-023c-47da-9614-b779a1efee6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:01.822498 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-8c4623be-023c-47da-9614-b779a1efee6b None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:18:01.824084 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-8c4623be-023c-47da-9614-b779a1efee6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:18:01.872392 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:01.887034 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 163/317] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Sep 9 16:18:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 16:18:01.894348 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f749bf7-fd24-47d9-bf11-6485db0f83e1 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:01.907973 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 155/318] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:18:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 16:18:01.979753 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:02.000292 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f749bf7-fd24-47d9-bf11-6485db0f83e1 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:02.036785 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ee4e1b-e040-4acc-8f64-767c2bba75f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:02.037413 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ee4e1b-e040-4acc-8f64-767c2bba75f9 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:02.037692 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ee4e1b-e040-4acc-8f64-767c2bba75f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:02.037965 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ee4e1b-e040-4acc-8f64-767c2bba75f9 None admin] PATH_INFO: `/v3/projects/b42bed1e233c4e71a1ec8ca3ae42c433` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:02.039130 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ee4e1b-e040-4acc-8f64-767c2bba75f9 None admin] RBAC: Authorizing `identity:get_project(project_id=b42bed1e233c4e71a1ec8ca3ae42c433)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:02.040638 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ee4e1b-e040-4acc-8f64-767c2bba75f9 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:02.046450 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 164/319] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Sep 9 16:18:01 2022] GET /identity/v3/projects/b42bed1e233c4e71a1ec8ca3ae42c433 => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 16:18:02.048519 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4623be-023c-47da-9614-b779a1efee6b None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:02.157002 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4623be-023c-47da-9614-b779a1efee6b None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:02.199789 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaab2f89-9e8c-470f-b1e0-3b9f46bc0889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:02.200702 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaab2f89-9e8c-470f-b1e0-3b9f46bc0889 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:02.201182 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaab2f89-9e8c-470f-b1e0-3b9f46bc0889 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:02.201627 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaab2f89-9e8c-470f-b1e0-3b9f46bc0889 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:02.202551 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaab2f89-9e8c-470f-b1e0-3b9f46bc0889 None admin] RBAC: Adding query filter params (role.id=99ea656aad1b4b0c990db50b9b878b90, scope.project.id=b42bed1e233c4e71a1ec8ca3ae42c433, user.id=0e880ec0a0604a3d917e5ee944adcd99) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:18:02.203037 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaab2f89-9e8c-470f-b1e0-3b9f46bc0889 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:02.204678 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaab2f89-9e8c-470f-b1e0-3b9f46bc0889 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:02.212588 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ee4e1b-e040-4acc-8f64-767c2bba75f9 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:02.213837 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 156/320] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Sep 9 16:18:02 2022] GET /identity/v3/role_assignments?user.id=0e880ec0a0604a3d917e5ee944adcd99&scope.project.id=b42bed1e233c4e71a1ec8ca3ae42c433&role.id=99ea656aad1b4b0c990db50b9b878b90 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 16:18:02.291996 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bca0ac6-c7e5-44b1-8927-a8434e8a767f None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:02.292267 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bca0ac6-c7e5-44b1-8927-a8434e8a767f None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:02.292543 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bca0ac6-c7e5-44b1-8927-a8434e8a767f None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:02.294150 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 157/321] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:18:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 16:18:02.299576 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e198888-97ef-401f-aa8d-a0bc7d80d9a0 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:02.299853 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e198888-97ef-401f-aa8d-a0bc7d80d9a0 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:02.300123 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e198888-97ef-401f-aa8d-a0bc7d80d9a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:02.319860 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-5e198888-97ef-401f-aa8d-a0bc7d80d9a0 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:18:02.321453 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-5e198888-97ef-401f-aa8d-a0bc7d80d9a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:18:02.341714 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ee4e1b-e040-4acc-8f64-767c2bba75f9 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:02.371213 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:02.382096 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2d83dd-a5b5-4471-8a77-94f9f965a9b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:02.382779 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2d83dd-a5b5-4471-8a77-94f9f965a9b1 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:02.383060 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2d83dd-a5b5-4471-8a77-94f9f965a9b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:02.383328 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2d83dd-a5b5-4471-8a77-94f9f965a9b1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:02.384502 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2d83dd-a5b5-4471-8a77-94f9f965a9b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:02.386274 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2d83dd-a5b5-4471-8a77-94f9f965a9b1 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:02.387982 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 165/322] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 16:18:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:18:02.394470 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2d83dd-a5b5-4471-8a77-94f9f965a9b1 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:02.413479 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 158/323] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:18:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 16:18:02.426126 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:02.519545 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2d83dd-a5b5-4471-8a77-94f9f965a9b1 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:02.553351 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a69a12b-00ba-4934-9fbb-47cfc0ae1aab None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:02.553532 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a69a12b-00ba-4934-9fbb-47cfc0ae1aab None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:02.553809 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a69a12b-00ba-4934-9fbb-47cfc0ae1aab None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:02.555424 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 159/324] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:18:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 16:18:02.557988 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0849647-a158-4316-89f6-5fe9cb38f4fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:02.559160 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0849647-a158-4316-89f6-5fe9cb38f4fd None admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:02.559764 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0849647-a158-4316-89f6-5fe9cb38f4fd None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:02.560295 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0849647-a158-4316-89f6-5fe9cb38f4fd None admin] PATH_INFO: `/v3/groups` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:02.560718 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71e46a4-f453-451d-b284-438fb2cdf77b None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:02.560998 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71e46a4-f453-451d-b284-438fb2cdf77b None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:02.561266 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71e46a4-f453-451d-b284-438fb2cdf77b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:02.561709 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0849647-a158-4316-89f6-5fe9cb38f4fd None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:02.563362 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0849647-a158-4316-89f6-5fe9cb38f4fd None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:02.582455 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 166/325] 10.222.0.27 () {60 vars in 1134 bytes} [Fri Sep 9 16:18:02 2022] POST /identity/v3/groups => generated 226 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 16:18:02.582832 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-f71e46a4-f453-451d-b284-438fb2cdf77b None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:18:02.584067 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-f71e46a4-f453-451d-b284-438fb2cdf77b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:18:02.668546 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 160/326] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:18:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 16:18:02.693627 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0849647-a158-4316-89f6-5fe9cb38f4fd None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:02.779778 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:02.805559 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0849647-a158-4316-89f6-5fe9cb38f4fd None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:02.841095 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df323fd6-f7d6-4e7e-a7c8-99b91e4c20b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:02.841729 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df323fd6-f7d6-4e7e-a7c8-99b91e4c20b2 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:02.842004 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df323fd6-f7d6-4e7e-a7c8-99b91e4c20b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:02.842276 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df323fd6-f7d6-4e7e-a7c8-99b91e4c20b2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:02.853568 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df323fd6-f7d6-4e7e-a7c8-99b91e4c20b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 16:18:02.859059 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-df323fd6-f7d6-4e7e-a7c8-99b91e4c20b2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 16:18:02.859059 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:18:02.859059 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:18:02.859059 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:18:02.859059 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:18:02.859059 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:18:02.859059 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:18:02.859059 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:18:02.859059 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:18:02.859059 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:18:02.859059 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:18:02.859059 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:18:02.859059 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 16:18:02.859059 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 16:18:02.859059 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 16:18:02.859059 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 16:18:02.859943 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 16:18:02.859943 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 16:18:02.859943 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 16:18:02.859943 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 16:18:02.859943 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:18:02.859943 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:18:02.859943 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:18:02.859943 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:18:02.859943 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:18:02.859943 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:18:02.859943 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:18:02.859943 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 16:18:02.859943 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:18:02.859943 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:18:02.859943 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:18:02.859943 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:18:02.860755 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:18:02.860755 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:18:02.860755 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:18:02.860755 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:18:02.860755 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 16:18:02.860755 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 16:18:02.860755 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 16:18:02.860755 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 16:18:02.860755 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 16:18:02.860755 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 16:18:02.860755 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 16:18:02.860755 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 16:18:02.860755 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 167/327] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Sep 9 16:18:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:18:02.866918 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71e46a4-f453-451d-b284-438fb2cdf77b None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:02.953093 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df323fd6-f7d6-4e7e-a7c8-99b91e4c20b2 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:02.977398 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:02.981996 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71e46a4-f453-451d-b284-438fb2cdf77b None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:03.028687 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e95b606-2ef5-4977-a94e-e61475af327f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:03.029444 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e95b606-2ef5-4977-a94e-e61475af327f None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:03.029718 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e95b606-2ef5-4977-a94e-e61475af327f None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:03.029988 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e95b606-2ef5-4977-a94e-e61475af327f None admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:03.030679 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e95b606-2ef5-4977-a94e-e61475af327f None admin] RBAC: Adding query filter params (name=reader) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:18:03.030969 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e95b606-2ef5-4977-a94e-e61475af327f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:03.032338 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e95b606-2ef5-4977-a94e-e61475af327f None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:03.042633 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 161/328] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Sep 9 16:18:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:18:03.048002 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e95b606-2ef5-4977-a94e-e61475af327f None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:03.082475 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df323fd6-f7d6-4e7e-a7c8-99b91e4c20b2 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:03.119365 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe39b41-c4b3-4b13-8765-2fe3e1b6814d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:03.120002 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe39b41-c4b3-4b13-8765-2fe3e1b6814d None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:03.120283 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe39b41-c4b3-4b13-8765-2fe3e1b6814d None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:03.120554 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe39b41-c4b3-4b13-8765-2fe3e1b6814d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:03.127782 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:03.132965 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe39b41-c4b3-4b13-8765-2fe3e1b6814d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 16:18:03.137986 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-afe39b41-c4b3-4b13-8765-2fe3e1b6814d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 16:18:03.137986 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:18:03.137986 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:18:03.137986 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:18:03.137986 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:18:03.137986 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:18:03.137986 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:18:03.137986 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:18:03.137986 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:18:03.137986 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:18:03.137986 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:18:03.137986 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:18:03.137986 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 16:18:03.137986 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 16:18:03.137986 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 16:18:03.137986 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 16:18:03.138886 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 16:18:03.138886 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 16:18:03.138886 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 16:18:03.138886 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 16:18:03.138886 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:18:03.138886 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:18:03.138886 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:18:03.138886 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:18:03.138886 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:18:03.138886 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:18:03.138886 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:18:03.138886 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 16:18:03.138886 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:18:03.138886 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:18:03.138886 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:18:03.138886 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:18:03.139713 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:18:03.139713 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:18:03.139713 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:18:03.139713 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:18:03.139713 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 16:18:03.139713 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 16:18:03.139713 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 16:18:03.139713 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 16:18:03.139713 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 16:18:03.139713 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 16:18:03.139713 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 16:18:03.139713 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 16:18:03.140313 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 168/329] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Sep 9 16:18:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 16:18:03.146379 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe39b41-c4b3-4b13-8765-2fe3e1b6814d None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:03.182416 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e95b606-2ef5-4977-a94e-e61475af327f None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:03.224680 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f3e3f5-de74-4ee5-a032-1a98887010ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:03.225414 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f3e3f5-de74-4ee5-a032-1a98887010ed None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:03.225782 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f3e3f5-de74-4ee5-a032-1a98887010ed None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:03.226122 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f3e3f5-de74-4ee5-a032-1a98887010ed None admin] PATH_INFO: `/v3/users/428ff010f42445a594e5960703d088a0` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:03.227351 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f3e3f5-de74-4ee5-a032-1a98887010ed None admin] RBAC: Authorizing `identity:get_user(user_id=428ff010f42445a594e5960703d088a0)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:03.229143 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f3e3f5-de74-4ee5-a032-1a98887010ed None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:03.232191 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 162/330] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Sep 9 16:18:03 2022] GET /identity/v3/users/428ff010f42445a594e5960703d088a0 => generated 293 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:18:03.237340 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f3e3f5-de74-4ee5-a032-1a98887010ed None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:03.273851 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe39b41-c4b3-4b13-8765-2fe3e1b6814d None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:03.278758 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:03.334477 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82917f2c-b5e1-4de9-a865-90c5ee33d8b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:03.335011 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82917f2c-b5e1-4de9-a865-90c5ee33d8b0 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:03.335282 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82917f2c-b5e1-4de9-a865-90c5ee33d8b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:03.335548 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82917f2c-b5e1-4de9-a865-90c5ee33d8b0 None admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:03.336202 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82917f2c-b5e1-4de9-a865-90c5ee33d8b0 None admin] RBAC: Adding query filter params (name=member) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:18:03.336500 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82917f2c-b5e1-4de9-a865-90c5ee33d8b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:03.337893 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82917f2c-b5e1-4de9-a865-90c5ee33d8b0 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:03.350207 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 169/331] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Sep 9 16:18:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 16:18:03.356702 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82917f2c-b5e1-4de9-a865-90c5ee33d8b0 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:03.381618 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f3e3f5-de74-4ee5-a032-1a98887010ed None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:03.417897 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf5c73e-7e07-4bab-b641-3650a50cf740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:03.418650 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf5c73e-7e07-4bab-b641-3650a50cf740 None admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:03.418933 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf5c73e-7e07-4bab-b641-3650a50cf740 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:03.419202 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf5c73e-7e07-4bab-b641-3650a50cf740 None admin] PATH_INFO: `/v3/system/users/428ff010f42445a594e5960703d088a0/roles/99ea656aad1b4b0c990db50b9b878b90` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:03.420664 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf5c73e-7e07-4bab-b641-3650a50cf740 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=428ff010f42445a594e5960703d088a0, role_id=99ea656aad1b4b0c990db50b9b878b90)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:03.422040 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf5c73e-7e07-4bab-b641-3650a50cf740 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:03.428560 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:03.435958 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 163/332] 10.222.0.27 () {58 vars in 1334 bytes} [Fri Sep 9 16:18:03 2022] PUT /identity/v3/system/users/428ff010f42445a594e5960703d088a0/roles/99ea656aad1b4b0c990db50b9b878b90 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:18:03.492757 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82917f2c-b5e1-4de9-a865-90c5ee33d8b0 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:03.539491 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3918017a-29e5-46fa-9443-5d301c6c939d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:03.540146 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3918017a-29e5-46fa-9443-5d301c6c939d None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:03.540452 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3918017a-29e5-46fa-9443-5d301c6c939d None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:03.540833 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3918017a-29e5-46fa-9443-5d301c6c939d None admin] PATH_INFO: `/v3/users/ca0e01f2d6c1443198bbe23e815515be` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:03.542038 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3918017a-29e5-46fa-9443-5d301c6c939d None admin] RBAC: Authorizing `identity:get_user(user_id=ca0e01f2d6c1443198bbe23e815515be)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:03.543721 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3918017a-29e5-46fa-9443-5d301c6c939d None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:03.545719 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 170/333] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Sep 9 16:18:03 2022] GET /identity/v3/users/ca0e01f2d6c1443198bbe23e815515be => generated 293 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 16:18:03.552072 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf5c73e-7e07-4bab-b641-3650a50cf740 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:03.656804 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:03.664318 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf5c73e-7e07-4bab-b641-3650a50cf740 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:03.702681 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b91048-8eb0-4482-af28-8ab95fd91897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:03.703399 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b91048-8eb0-4482-af28-8ab95fd91897 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:03.703672 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b91048-8eb0-4482-af28-8ab95fd91897 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:03.703935 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b91048-8eb0-4482-af28-8ab95fd91897 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:03.704795 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b91048-8eb0-4482-af28-8ab95fd91897 None admin] RBAC: Adding query filter params (role.id=b38e84bf077846ee802e6bb1bad83522, user.id=ca0e01f2d6c1443198bbe23e815515be, scope.system=all) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:18:03.705104 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b91048-8eb0-4482-af28-8ab95fd91897 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:03.707652 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b91048-8eb0-4482-af28-8ab95fd91897 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:03.723153 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 164/334] 10.222.0.27 () {56 vars in 1308 bytes} [Fri Sep 9 16:18:03 2022] GET /identity/v3/role_assignments?user.id=ca0e01f2d6c1443198bbe23e815515be&scope.system=all&role.id=b38e84bf077846ee802e6bb1bad83522 => generated 510 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:18:05.157636 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392beaa2-a719-4bdc-86d5-b32dff2949c8 None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:05.158543 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392beaa2-a719-4bdc-86d5-b32dff2949c8 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:05.158986 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392beaa2-a719-4bdc-86d5-b32dff2949c8 None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:05.161375 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 171/335] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:18:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:18:05.168547 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28b6801-5b3d-4e17-a5b8-b810426c862d None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:05.168984 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28b6801-5b3d-4e17-a5b8-b810426c862d None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:05.169168 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28b6801-5b3d-4e17-a5b8-b810426c862d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:05.193529 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-c28b6801-5b3d-4e17-a5b8-b810426c862d None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:18:05.194782 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-c28b6801-5b3d-4e17-a5b8-b810426c862d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:18:05.292016 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 165/336] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:18:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 16:18:05.768541 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4ae4df-0331-4d29-9046-30d76073527f None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:05.768995 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4ae4df-0331-4d29-9046-30d76073527f None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:05.769774 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4ae4df-0331-4d29-9046-30d76073527f None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:05.771484 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 172/337] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:18:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:18:05.779740 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6b9c02-b1e2-49f8-af0a-c0737ba2f190 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:05.780019 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6b9c02-b1e2-49f8-af0a-c0737ba2f190 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:05.780294 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6b9c02-b1e2-49f8-af0a-c0737ba2f190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:05.801781 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-3e6b9c02-b1e2-49f8-af0a-c0737ba2f190 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:18:05.803003 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-3e6b9c02-b1e2-49f8-af0a-c0737ba2f190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:18:05.853053 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4ae4df-0331-4d29-9046-30d76073527f None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:05.888857 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 166/338] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:18:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 16:18:06.024042 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4ae4df-0331-4d29-9046-30d76073527f None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:06.057336 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:06.066590 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaa4853-7844-460c-976b-60be8cefbd6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:06.067227 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaa4853-7844-460c-976b-60be8cefbd6b None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:06.067502 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaa4853-7844-460c-976b-60be8cefbd6b None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:06.067769 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaa4853-7844-460c-976b-60be8cefbd6b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:06.080843 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaa4853-7844-460c-976b-60be8cefbd6b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 16:18:06.086284 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-4eaa4853-7844-460c-976b-60be8cefbd6b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 16:18:06.086284 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:18:06.086284 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:18:06.086284 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:18:06.086284 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:18:06.086284 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:18:06.086284 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:18:06.086284 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:18:06.086284 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:18:06.086284 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:18:06.086284 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:18:06.086284 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:18:06.086284 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 16:18:06.086284 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 16:18:06.086284 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 16:18:06.086284 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 16:18:06.087191 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 16:18:06.087191 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 16:18:06.087191 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 16:18:06.087191 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 16:18:06.087191 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:18:06.087191 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:18:06.087191 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:18:06.087191 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:18:06.087191 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:18:06.087191 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:18:06.087191 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:18:06.087191 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 16:18:06.087191 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:18:06.087191 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:18:06.087191 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:18:06.087191 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:18:06.087962 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:18:06.087962 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:18:06.087962 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:18:06.087962 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:18:06.087962 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 16:18:06.087962 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 16:18:06.087962 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 16:18:06.087962 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 16:18:06.087962 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 16:18:06.087962 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 16:18:06.087962 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 16:18:06.087962 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 16:18:06.087962 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 173/339] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Sep 9 16:18:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 16:18:06.094524 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6b9c02-b1e2-49f8-af0a-c0737ba2f190 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:06.123310 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:06.225992 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6b9c02-b1e2-49f8-af0a-c0737ba2f190 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:06.269774 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bf0802-3348-4486-b9ab-29f97a6e4187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:06.270481 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bf0802-3348-4486-b9ab-29f97a6e4187 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:06.270761 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bf0802-3348-4486-b9ab-29f97a6e4187 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:06.271029 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bf0802-3348-4486-b9ab-29f97a6e4187 None admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:06.271735 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bf0802-3348-4486-b9ab-29f97a6e4187 None admin] RBAC: Adding query filter params (name=member) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:18:06.272034 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bf0802-3348-4486-b9ab-29f97a6e4187 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:06.273399 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bf0802-3348-4486-b9ab-29f97a6e4187 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:06.294577 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 167/340] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Sep 9 16:18:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:18:06.300865 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaa4853-7844-460c-976b-60be8cefbd6b None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:06.450373 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaa4853-7844-460c-976b-60be8cefbd6b None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:06.478054 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bf0802-3348-4486-b9ab-29f97a6e4187 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:06.493400 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648e7abc-380f-4f2c-ae63-e78548ecdce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:06.494070 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648e7abc-380f-4f2c-ae63-e78548ecdce9 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:06.494369 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648e7abc-380f-4f2c-ae63-e78548ecdce9 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:06.494643 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648e7abc-380f-4f2c-ae63-e78548ecdce9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:06.590750 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:06.602643 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:06.617401 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bf0802-3348-4486-b9ab-29f97a6e4187 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:06.627621 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648e7abc-380f-4f2c-ae63-e78548ecdce9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:06.629211 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648e7abc-380f-4f2c-ae63-e78548ecdce9 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:06.661684 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233d0f8b-402b-4f19-a214-7e597b9e7635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:06.662354 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233d0f8b-402b-4f19-a214-7e597b9e7635 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:06.662637 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233d0f8b-402b-4f19-a214-7e597b9e7635 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:06.662905 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233d0f8b-402b-4f19-a214-7e597b9e7635 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:06.676143 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233d0f8b-402b-4f19-a214-7e597b9e7635 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 16:18:06.681928 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-233d0f8b-402b-4f19-a214-7e597b9e7635 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 16:18:06.681928 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:18:06.681928 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:18:06.681928 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:18:06.681928 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:18:06.681928 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:18:06.681928 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:18:06.681928 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:18:06.681928 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:18:06.681928 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:18:06.681928 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:18:06.681928 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:18:06.681928 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 16:18:06.681928 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 16:18:06.681928 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 16:18:06.681928 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 16:18:06.683103 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 16:18:06.683103 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 16:18:06.683103 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 16:18:06.683103 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 16:18:06.683103 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:18:06.683103 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:18:06.683103 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:18:06.683103 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:18:06.683103 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:18:06.683103 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:18:06.683103 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:18:06.683103 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Sep 09 16:18:06.683103 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:18:06.683103 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:18:06.683103 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:18:06.683103 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:18:06.684361 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:18:06.684361 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:18:06.684361 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:18:06.684361 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:18:06.684361 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 16:18:06.684361 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 16:18:06.684361 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 16:18:06.684361 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 16:18:06.684361 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 16:18:06.684361 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 16:18:06.684361 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 16:18:06.684361 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:18:06.686744 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 168/341] 10.222.0.27 () {56 vars in 1114 bytes} [Fri Sep 9 16:18:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 16:18:06.692895 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7a0c2a-ac40-4a7e-8cdb-07d4fe9250b2 None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:06.693369 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7a0c2a-ac40-4a7e-8cdb-07d4fe9250b2 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:06.693809 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7a0c2a-ac40-4a7e-8cdb-07d4fe9250b2 None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:06.695762 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 169/342] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:18:06 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:18:06.696664 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7a0c2a-ac40-4a7e-8cdb-07d4fe9250b2 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:06.812598 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7a0c2a-ac40-4a7e-8cdb-07d4fe9250b2 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:06.821276 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 174/343] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Sep 9 16:18:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 521 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 16:18:06.822268 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1d35c4-0114-4b3d-94b7-ec66455f1849 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:06.827110 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1d35c4-0114-4b3d-94b7-ec66455f1849 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:06.827110 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1d35c4-0114-4b3d-94b7-ec66455f1849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:06.850715 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-7f1d35c4-0114-4b3d-94b7-ec66455f1849 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:18:06.852220 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4b5c71-0f22-45ee-a637-4a56c995cf62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:06.853007 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4b5c71-0f22-45ee-a637-4a56c995cf62 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:06.853456 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4b5c71-0f22-45ee-a637-4a56c995cf62 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:06.853925 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4b5c71-0f22-45ee-a637-4a56c995cf62 None admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:06.854765 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4b5c71-0f22-45ee-a637-4a56c995cf62 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:18:06.854934 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-7f1d35c4-0114-4b3d-94b7-ec66455f1849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:18:06.855396 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4b5c71-0f22-45ee-a637-4a56c995cf62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:06.856989 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4b5c71-0f22-45ee-a637-4a56c995cf62 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:06.858884 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:06.874670 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 170/344] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Sep 9 16:18:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:18:06.876278 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21156662-38df-4f3c-90c5-a2492cca09dc None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:06.876716 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21156662-38df-4f3c-90c5-a2492cca09dc None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:06.877137 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21156662-38df-4f3c-90c5-a2492cca09dc None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:06.878763 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 171/345] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:18:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:18:06.879604 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21156662-38df-4f3c-90c5-a2492cca09dc None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:06.932642 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 175/346] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:18:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 16:18:06.933417 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1d35c4-0114-4b3d-94b7-ec66455f1849 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:06.978689 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:06.991694 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21156662-38df-4f3c-90c5-a2492cca09dc None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:07.032166 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61a1197-5fed-436e-b154-82212c6a1b4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:07.033065 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61a1197-5fed-436e-b154-82212c6a1b4f None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:07.033505 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61a1197-5fed-436e-b154-82212c6a1b4f None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:07.033927 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61a1197-5fed-436e-b154-82212c6a1b4f None admin] PATH_INFO: `/v3/projects/adc7a18acd23477d80890d7a3477e7c9` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:07.035707 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61a1197-5fed-436e-b154-82212c6a1b4f None admin] RBAC: Authorizing `identity:get_project(project_id=adc7a18acd23477d80890d7a3477e7c9)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:07.037350 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61a1197-5fed-436e-b154-82212c6a1b4f None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:07.039588 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 172/347] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Sep 9 16:18:06 2022] GET /identity/v3/projects/adc7a18acd23477d80890d7a3477e7c9 => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:18:07.040901 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061aaac4-309e-4110-aba8-3469ffb1ea0c None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:07.041333 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061aaac4-309e-4110-aba8-3469ffb1ea0c None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:07.041752 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061aaac4-309e-4110-aba8-3469ffb1ea0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:07.061918 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-061aaac4-309e-4110-aba8-3469ffb1ea0c None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:18:07.063443 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-061aaac4-309e-4110-aba8-3469ffb1ea0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:18:07.132652 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:07.143487 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 173/348] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:18:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 16:18:07.146367 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061aaac4-309e-4110-aba8-3469ffb1ea0c None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:07.158611 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1d35c4-0114-4b3d-94b7-ec66455f1849 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:07.247569 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dbad16-3333-4995-812e-9787346aaad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:07.248377 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dbad16-3333-4995-812e-9787346aaad1 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:07.248504 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dbad16-3333-4995-812e-9787346aaad1 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:07.248714 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dbad16-3333-4995-812e-9787346aaad1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:07.266055 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061aaac4-309e-4110-aba8-3469ffb1ea0c None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:07.311300 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4ed006-1863-4c7f-b03c-ff03c3a24b40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:07.312022 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4ed006-1863-4c7f-b03c-ff03c3a24b40 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:07.312309 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4ed006-1863-4c7f-b03c-ff03c3a24b40 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:07.312630 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4ed006-1863-4c7f-b03c-ff03c3a24b40 None admin] PATH_INFO: `/v3/groups/352ddc29b15f4e6790e820fc58e9ee68` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:07.319913 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4ed006-1863-4c7f-b03c-ff03c3a24b40 None admin] RBAC: Authorizing `identity:get_group(group_id=352ddc29b15f4e6790e820fc58e9ee68)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:07.321439 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4ed006-1863-4c7f-b03c-ff03c3a24b40 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:07.323458 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 174/349] 10.222.0.27 () {56 vars in 1180 bytes} [Fri Sep 9 16:18:07 2022] GET /identity/v3/groups/352ddc29b15f4e6790e820fc58e9ee68 => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:18:07.324702 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4ed006-1863-4c7f-b03c-ff03c3a24b40 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:07.387601 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dbad16-3333-4995-812e-9787346aaad1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:07.389003 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dbad16-3333-4995-812e-9787346aaad1 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:07.395536 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:07.413521 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:07.446058 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4ed006-1863-4c7f-b03c-ff03c3a24b40 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:07.487351 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f511bd-27fa-4611-91c3-0f9d508c14f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:07.488683 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f511bd-27fa-4611-91c3-0f9d508c14f4 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:07.488962 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f511bd-27fa-4611-91c3-0f9d508c14f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:07.489568 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f511bd-27fa-4611-91c3-0f9d508c14f4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:07.497468 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 176/350] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Sep 9 16:18:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 564 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 16:18:07.498061 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dbad16-3333-4995-812e-9787346aaad1 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:07.508586 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f511bd-27fa-4611-91c3-0f9d508c14f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 16:18:07.516245 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-d7f511bd-27fa-4611-91c3-0f9d508c14f4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 16:18:07.516245 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:18:07.516245 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:18:07.516245 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:18:07.516245 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:18:07.516245 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:18:07.516245 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:18:07.516245 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:18:07.516245 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:18:07.516245 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:18:07.516245 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:18:07.516245 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:18:07.516245 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 16:18:07.516245 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 16:18:07.516245 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 16:18:07.516245 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 16:18:07.517216 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 16:18:07.517216 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 16:18:07.517216 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 16:18:07.517216 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 16:18:07.517216 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:18:07.517216 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:18:07.517216 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:18:07.517216 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:18:07.517216 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:18:07.517216 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:18:07.517216 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:18:07.517216 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Sep 09 16:18:07.517216 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:18:07.517216 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:18:07.517216 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:18:07.517216 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:18:07.518427 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:18:07.518427 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:18:07.518427 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:18:07.518427 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:18:07.518427 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 16:18:07.518427 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 16:18:07.518427 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 16:18:07.518427 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 16:18:07.518427 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 16:18:07.518427 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 16:18:07.518427 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 16:18:07.518427 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:18:07.518427 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 175/351] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Sep 9 16:18:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:18:07.519157 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c063a143-cb20-4fc7-94f6-87d63f6e7dfa None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:07.519462 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c063a143-cb20-4fc7-94f6-87d63f6e7dfa None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:07.519619 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c063a143-cb20-4fc7-94f6-87d63f6e7dfa None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:07.521522 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 176/352] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:18:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:18:07.522218 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c063a143-cb20-4fc7-94f6-87d63f6e7dfa None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:07.632441 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dbad16-3333-4995-812e-9787346aaad1 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:07.651235 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:07.660969 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c063a143-cb20-4fc7-94f6-87d63f6e7dfa None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:07.678247 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4a9e44-c455-4ed3-8797-bf6daacb26c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:07.678918 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4a9e44-c455-4ed3-8797-bf6daacb26c5 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:07.679187 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:07.679907 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4a9e44-c455-4ed3-8797-bf6daacb26c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:07.680177 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4a9e44-c455-4ed3-8797-bf6daacb26c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:07.680901 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4a9e44-c455-4ed3-8797-bf6daacb26c5 None admin] RBAC: Adding query filter params (group.id=352ddc29b15f4e6790e820fc58e9ee68, role.id=b38e84bf077846ee802e6bb1bad83522, scope.project.id=adc7a18acd23477d80890d7a3477e7c9) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:18:07.681305 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4a9e44-c455-4ed3-8797-bf6daacb26c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:07.682836 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4a9e44-c455-4ed3-8797-bf6daacb26c5 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:07.689882 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 177/353] 10.222.0.27 () {56 vars in 1376 bytes} [Fri Sep 9 16:18:07 2022] GET /identity/v3/role_assignments?group.id=352ddc29b15f4e6790e820fc58e9ee68&scope.project.id=adc7a18acd23477d80890d7a3477e7c9&role.id=b38e84bf077846ee802e6bb1bad83522 => generated 260 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:18:07.691298 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4a9e44-c455-4ed3-8797-bf6daacb26c5 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:07.697996 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b737205-bd49-41bf-a174-a4d1446d2894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:07.698671 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b737205-bd49-41bf-a174-a4d1446d2894 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:07.698946 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b737205-bd49-41bf-a174-a4d1446d2894 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:07.699212 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b737205-bd49-41bf-a174-a4d1446d2894 None admin] PATH_INFO: `/v3/projects/adc7a18acd23477d80890d7a3477e7c9` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:07.700387 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b737205-bd49-41bf-a174-a4d1446d2894 None admin] RBAC: Authorizing `identity:get_project(project_id=adc7a18acd23477d80890d7a3477e7c9)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:07.701869 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b737205-bd49-41bf-a174-a4d1446d2894 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:07.704984 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 177/354] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Sep 9 16:18:07 2022] GET /identity/v3/projects/adc7a18acd23477d80890d7a3477e7c9 => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:18:07.706197 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935b4623-66c4-4735-9b00-c4ad56ef36b1 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:07.706545 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935b4623-66c4-4735-9b00-c4ad56ef36b1 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:07.706814 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935b4623-66c4-4735-9b00-c4ad56ef36b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:07.728570 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-935b4623-66c4-4735-9b00-c4ad56ef36b1 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:18:07.729805 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-935b4623-66c4-4735-9b00-c4ad56ef36b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:18:07.826263 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4a9e44-c455-4ed3-8797-bf6daacb26c5 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:07.830823 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 178/355] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:18:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 16:18:07.831969 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935b4623-66c4-4735-9b00-c4ad56ef36b1 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:07.869775 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c069be-0a27-48dc-8e68-e939ac1acf9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:07.870432 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c069be-0a27-48dc-8e68-e939ac1acf9d None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:07.870710 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c069be-0a27-48dc-8e68-e939ac1acf9d None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:07.870975 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c069be-0a27-48dc-8e68-e939ac1acf9d None admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:07.871642 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c069be-0a27-48dc-8e68-e939ac1acf9d None admin] RBAC: Adding query filter params (name=member) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:18:07.871939 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c069be-0a27-48dc-8e68-e939ac1acf9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:07.873350 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c069be-0a27-48dc-8e68-e939ac1acf9d None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:07.887700 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 178/356] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Sep 9 16:18:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:18:07.888684 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c069be-0a27-48dc-8e68-e939ac1acf9d None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:07.940020 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:07.975498 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935b4623-66c4-4735-9b00-c4ad56ef36b1 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:07.993322 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:08.001292 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c069be-0a27-48dc-8e68-e939ac1acf9d None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:08.016179 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1714e8-ce52-4820-9e7e-b0a52517c531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:08.016696 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1714e8-ce52-4820-9e7e-b0a52517c531 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:08.016972 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1714e8-ce52-4820-9e7e-b0a52517c531 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:08.017236 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1714e8-ce52-4820-9e7e-b0a52517c531 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:08.029324 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1714e8-ce52-4820-9e7e-b0a52517c531 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 16:18:08.035314 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-3a1714e8-ce52-4820-9e7e-b0a52517c531 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 16:18:08.035314 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:18:08.035314 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:18:08.035314 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:18:08.035314 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:18:08.035314 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:18:08.035314 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:18:08.035314 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:18:08.035314 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:18:08.035314 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:18:08.035314 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:18:08.035314 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:18:08.035314 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 16:18:08.035314 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 16:18:08.035314 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 16:18:08.035314 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 16:18:08.036211 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 16:18:08.036211 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 16:18:08.036211 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 16:18:08.036211 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 16:18:08.036211 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:18:08.036211 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:18:08.036211 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:18:08.036211 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:18:08.036211 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:18:08.036211 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:18:08.036211 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:18:08.036211 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Sep 09 16:18:08.036211 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:18:08.036211 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:18:08.036211 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:18:08.036211 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:18:08.036988 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:18:08.036988 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:18:08.036988 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:18:08.036988 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:18:08.036988 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 16:18:08.036988 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 16:18:08.036988 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 16:18:08.036988 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 16:18:08.036988 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 16:18:08.036988 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 16:18:08.036988 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 16:18:08.036988 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:18:08.036988 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 179/357] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Sep 9 16:18:07 2022] GET /identity/v3/roles/reader => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:18:08.037645 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1714e8-ce52-4820-9e7e-b0a52517c531 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:08.046774 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c4558a-78d1-48eb-bce3-1c645355fd09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:08.047780 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c4558a-78d1-48eb-bce3-1c645355fd09 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:08.048274 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c4558a-78d1-48eb-bce3-1c645355fd09 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:08.048786 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c4558a-78d1-48eb-bce3-1c645355fd09 None admin] PATH_INFO: `/v3/groups/352ddc29b15f4e6790e820fc58e9ee68` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:08.050865 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c4558a-78d1-48eb-bce3-1c645355fd09 None admin] RBAC: Authorizing `identity:get_group(group_id=352ddc29b15f4e6790e820fc58e9ee68)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:08.052518 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c4558a-78d1-48eb-bce3-1c645355fd09 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:08.054698 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 179/358] 10.222.0.27 () {56 vars in 1180 bytes} [Fri Sep 9 16:18:07 2022] GET /identity/v3/groups/352ddc29b15f4e6790e820fc58e9ee68 => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:18:08.056314 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795fffb9-b353-421d-bc6b-373e634ae9d0 None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:08.056800 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795fffb9-b353-421d-bc6b-373e634ae9d0 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:08.057261 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795fffb9-b353-421d-bc6b-373e634ae9d0 None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:08.058708 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 180/359] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:18:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:18:08.059915 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795fffb9-b353-421d-bc6b-373e634ae9d0 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:08.154638 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1714e8-ce52-4820-9e7e-b0a52517c531 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:08.173775 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795fffb9-b353-421d-bc6b-373e634ae9d0 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:08.187970 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:08.192896 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2b9b1e-6539-4769-ac8d-671598d136b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:08.193440 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2b9b1e-6539-4769-ac8d-671598d136b4 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:08.193733 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2b9b1e-6539-4769-ac8d-671598d136b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:08.193981 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2b9b1e-6539-4769-ac8d-671598d136b4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:08.216945 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deebeb14-ba3d-419a-a257-3102033959fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:08.218031 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deebeb14-ba3d-419a-a257-3102033959fe None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:08.218566 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deebeb14-ba3d-419a-a257-3102033959fe None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:08.219051 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deebeb14-ba3d-419a-a257-3102033959fe None admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:08.220269 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deebeb14-ba3d-419a-a257-3102033959fe None admin] RBAC: Adding query filter params (name=reader) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:18:08.220822 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deebeb14-ba3d-419a-a257-3102033959fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:08.223237 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deebeb14-ba3d-419a-a257-3102033959fe None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:08.232931 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 181/360] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Sep 9 16:18:08 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:18:08.238628 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deebeb14-ba3d-419a-a257-3102033959fe None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:08.248961 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:08.278380 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2b9b1e-6539-4769-ac8d-671598d136b4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:08.278975 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2b9b1e-6539-4769-ac8d-671598d136b4 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:08.362056 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deebeb14-ba3d-419a-a257-3102033959fe None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:08.403528 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 180/361] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Sep 9 16:18:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 16:18:08.406906 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3f1132-6924-4013-863a-94502a765c5b None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:08.407243 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3f1132-6924-4013-863a-94502a765c5b None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:08.407461 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3f1132-6924-4013-863a-94502a765c5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:08.415451 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ec36bf-069e-4c62-9ccc-578da957c57d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:08.416143 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ec36bf-069e-4c62-9ccc-578da957c57d None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:08.416494 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ec36bf-069e-4c62-9ccc-578da957c57d None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:08.416835 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ec36bf-069e-4c62-9ccc-578da957c57d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:08.417569 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ec36bf-069e-4c62-9ccc-578da957c57d None admin] RBAC: Adding query filter params (group.id=352ddc29b15f4e6790e820fc58e9ee68, role.id=9452afb4ffe54eb7b7b5b0aff7dd00ed, scope.project.id=adc7a18acd23477d80890d7a3477e7c9) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:18:08.417883 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ec36bf-069e-4c62-9ccc-578da957c57d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:08.419464 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ec36bf-069e-4c62-9ccc-578da957c57d None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:08.430439 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-fe3f1132-6924-4013-863a-94502a765c5b None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:18:08.430608 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 182/362] 10.222.0.27 () {56 vars in 1376 bytes} [Fri Sep 9 16:18:08 2022] GET /identity/v3/role_assignments?group.id=352ddc29b15f4e6790e820fc58e9ee68&scope.project.id=adc7a18acd23477d80890d7a3477e7c9&role.id=9452afb4ffe54eb7b7b5b0aff7dd00ed => generated 260 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:18:08.430608 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ec36bf-069e-4c62-9ccc-578da957c57d None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:08.430755 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-fe3f1132-6924-4013-863a-94502a765c5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:18:08.493089 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:08.536493 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 181/363] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:18:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 16:18:08.537535 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3f1132-6924-4013-863a-94502a765c5b None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:08.546946 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:08.620645 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ec36bf-069e-4c62-9ccc-578da957c57d None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:08.655422 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3f1132-6924-4013-863a-94502a765c5b None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:08.671313 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffee36e5-d23b-49c8-841d-a88513716cd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:08.671950 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffee36e5-d23b-49c8-841d-a88513716cd2 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:08.672227 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffee36e5-d23b-49c8-841d-a88513716cd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:08.672497 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffee36e5-d23b-49c8-841d-a88513716cd2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:08.683588 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffee36e5-d23b-49c8-841d-a88513716cd2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 16:18:08.688783 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-ffee36e5-d23b-49c8-841d-a88513716cd2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 16:18:08.688783 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:18:08.688783 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:18:08.688783 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:18:08.688783 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:18:08.688783 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:18:08.688783 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:18:08.688783 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:18:08.688783 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:18:08.688783 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:18:08.688783 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:18:08.688783 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:18:08.688783 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 16:18:08.688783 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 16:18:08.688783 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 16:18:08.688783 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 16:18:08.689660 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 16:18:08.689660 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 16:18:08.689660 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 16:18:08.689660 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 16:18:08.689660 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:18:08.689660 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:18:08.689660 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:18:08.689660 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:18:08.689660 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:18:08.689660 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:18:08.689660 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:18:08.689660 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 16:18:08.689660 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:18:08.689660 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:18:08.689660 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:18:08.689660 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:18:08.690504 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:18:08.690504 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:18:08.690504 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:18:08.690504 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:18:08.690504 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 16:18:08.690504 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 16:18:08.690504 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 16:18:08.690504 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 16:18:08.690504 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 16:18:08.690504 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 16:18:08.690504 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 16:18:08.690504 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 16:18:08.692108 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 183/364] 10.222.0.27 () {56 vars in 1114 bytes} [Fri Sep 9 16:18:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:18:08.692108 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffee36e5-d23b-49c8-841d-a88513716cd2 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:08.692878 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e42cae-a7c4-4df0-bec9-91cd57a7846e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:08.693514 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e42cae-a7c4-4df0-bec9-91cd57a7846e None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:08.693793 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e42cae-a7c4-4df0-bec9-91cd57a7846e None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:08.694064 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e42cae-a7c4-4df0-bec9-91cd57a7846e None admin] PATH_INFO: `/v3/users/428ff010f42445a594e5960703d088a0` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:08.699373 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e42cae-a7c4-4df0-bec9-91cd57a7846e None admin] RBAC: Authorizing `identity:get_user(user_id=428ff010f42445a594e5960703d088a0)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:08.700882 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e42cae-a7c4-4df0-bec9-91cd57a7846e None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:08.703002 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 182/365] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Sep 9 16:18:08 2022] GET /identity/v3/users/428ff010f42445a594e5960703d088a0 => generated 293 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:18:08.704688 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e42cae-a7c4-4df0-bec9-91cd57a7846e None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:08.814146 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:08.828343 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:08.833662 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffee36e5-d23b-49c8-841d-a88513716cd2 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:08.846700 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e42cae-a7c4-4df0-bec9-91cd57a7846e None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:08.880738 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b664add6-3092-4770-813d-6bb2d4482024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:08.881671 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b664add6-3092-4770-813d-6bb2d4482024 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:08.881954 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b664add6-3092-4770-813d-6bb2d4482024 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:08.882229 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b664add6-3092-4770-813d-6bb2d4482024 None admin] PATH_INFO: `/v3/projects/b42bed1e233c4e71a1ec8ca3ae42c433` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:08.887050 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b664add6-3092-4770-813d-6bb2d4482024 None admin] RBAC: Authorizing `identity:get_project(project_id=b42bed1e233c4e71a1ec8ca3ae42c433)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:08.889215 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b664add6-3092-4770-813d-6bb2d4482024 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:08.891487 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 184/366] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Sep 9 16:18:08 2022] GET /identity/v3/projects/b42bed1e233c4e71a1ec8ca3ae42c433 => generated 302 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:18:08.892752 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b664add6-3092-4770-813d-6bb2d4482024 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:08.897890 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d9a11e-a6c1-4062-8828-b5e50ae60ea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:08.898533 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d9a11e-a6c1-4062-8828-b5e50ae60ea9 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:08.898812 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d9a11e-a6c1-4062-8828-b5e50ae60ea9 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:08.899083 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d9a11e-a6c1-4062-8828-b5e50ae60ea9 None admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:08.899743 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d9a11e-a6c1-4062-8828-b5e50ae60ea9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:18:08.900041 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d9a11e-a6c1-4062-8828-b5e50ae60ea9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:08.901479 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d9a11e-a6c1-4062-8828-b5e50ae60ea9 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:08.916669 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 183/367] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Sep 9 16:18:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 16:18:08.917520 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d9a11e-a6c1-4062-8828-b5e50ae60ea9 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:09.052020 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b664add6-3092-4770-813d-6bb2d4482024 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:09.067584 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d9a11e-a6c1-4062-8828-b5e50ae60ea9 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:09.102225 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b265747-c442-45ea-89d9-4ee56121a362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:09.102889 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b265747-c442-45ea-89d9-4ee56121a362 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:09.103168 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b265747-c442-45ea-89d9-4ee56121a362 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:09.103543 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b265747-c442-45ea-89d9-4ee56121a362 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:09.104271 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b265747-c442-45ea-89d9-4ee56121a362 None admin] RBAC: Adding query filter params (role.id=99ea656aad1b4b0c990db50b9b878b90, user.id=428ff010f42445a594e5960703d088a0, scope.system=all) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:18:09.104575 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b265747-c442-45ea-89d9-4ee56121a362 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:09.106569 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b265747-c442-45ea-89d9-4ee56121a362 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:09.111832 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c237527-e94e-4ffb-9376-7856a3f9f129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:09.113260 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c237527-e94e-4ffb-9376-7856a3f9f129 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:09.113751 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c237527-e94e-4ffb-9376-7856a3f9f129 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:09.114219 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c237527-e94e-4ffb-9376-7856a3f9f129 None admin] PATH_INFO: `/v3/groups/352ddc29b15f4e6790e820fc58e9ee68` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:09.115568 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c237527-e94e-4ffb-9376-7856a3f9f129 None admin] RBAC: Authorizing `identity:get_group(group_id=352ddc29b15f4e6790e820fc58e9ee68)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:09.117204 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c237527-e94e-4ffb-9376-7856a3f9f129 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:09.119106 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 184/368] 10.222.0.27 () {56 vars in 1180 bytes} [Fri Sep 9 16:18:08 2022] GET /identity/v3/groups/352ddc29b15f4e6790e820fc58e9ee68 => generated 226 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:18:09.127208 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 185/369] 10.222.0.27 () {56 vars in 1308 bytes} [Fri Sep 9 16:18:08 2022] GET /identity/v3/role_assignments?user.id=428ff010f42445a594e5960703d088a0&scope.system=all&role.id=99ea656aad1b4b0c990db50b9b878b90 => generated 510 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:18:09.127208 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b265747-c442-45ea-89d9-4ee56121a362 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:09.127770 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c237527-e94e-4ffb-9376-7856a3f9f129 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:09.139721 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:09.160855 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:09.250776 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b265747-c442-45ea-89d9-4ee56121a362 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:09.295543 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4845ee4-6a4c-4371-a66e-a843e64f6d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:09.296609 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4845ee4-6a4c-4371-a66e-a843e64f6d53 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:09.297984 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4845ee4-6a4c-4371-a66e-a843e64f6d53 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:09.299057 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4845ee4-6a4c-4371-a66e-a843e64f6d53 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:09.384392 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c237527-e94e-4ffb-9376-7856a3f9f129 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:09.428913 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4845ee4-6a4c-4371-a66e-a843e64f6d53 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:09.430457 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4845ee4-6a4c-4371-a66e-a843e64f6d53 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:09.435025 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ed5052-c5c0-435c-a9a3-ae90d6b61a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:09.435742 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ed5052-c5c0-435c-a9a3-ae90d6b61a85 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:09.436106 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ed5052-c5c0-435c-a9a3-ae90d6b61a85 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:09.436441 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ed5052-c5c0-435c-a9a3-ae90d6b61a85 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:09.448480 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ed5052-c5c0-435c-a9a3-ae90d6b61a85 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 16:18:09.453807 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-d3ed5052-c5c0-435c-a9a3-ae90d6b61a85 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 16:18:09.453807 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:18:09.453807 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:18:09.453807 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:18:09.453807 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:18:09.453807 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:18:09.453807 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:18:09.453807 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:18:09.453807 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:18:09.453807 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:18:09.453807 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:18:09.453807 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:18:09.453807 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 16:18:09.453807 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 16:18:09.453807 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 16:18:09.453807 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 16:18:09.454752 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 16:18:09.454752 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 16:18:09.454752 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 16:18:09.454752 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 16:18:09.454752 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:18:09.454752 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:18:09.454752 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:18:09.454752 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:18:09.454752 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:18:09.454752 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:18:09.454752 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:18:09.454752 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Sep 09 16:18:09.454752 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:18:09.454752 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:18:09.454752 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:18:09.454752 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:18:09.455530 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:18:09.455530 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:18:09.455530 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:18:09.455530 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:18:09.455530 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 16:18:09.455530 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 16:18:09.455530 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 16:18:09.455530 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 16:18:09.455530 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 16:18:09.455530 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 16:18:09.455530 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 16:18:09.455530 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:18:09.455530 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 185/370] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Sep 9 16:18:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:18:09.456193 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ed5052-c5c0-435c-a9a3-ae90d6b61a85 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:09.474153 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:09.542691 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:09.580494 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 186/371] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Sep 9 16:18:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 16:18:09.581720 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4845ee4-6a4c-4371-a66e-a843e64f6d53 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:09.592138 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ed5052-c5c0-435c-a9a3-ae90d6b61a85 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:09.644609 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfff139d-0ae4-4489-a561-d87363c5cb13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:09.645236 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfff139d-0ae4-4489-a561-d87363c5cb13 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:09.645573 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfff139d-0ae4-4489-a561-d87363c5cb13 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:09.645902 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfff139d-0ae4-4489-a561-d87363c5cb13 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:09.646739 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfff139d-0ae4-4489-a561-d87363c5cb13 None admin] RBAC: Adding query filter params (group.id=352ddc29b15f4e6790e820fc58e9ee68, role.id=b38e84bf077846ee802e6bb1bad83522, scope.project.id=b42bed1e233c4e71a1ec8ca3ae42c433) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:18:09.647107 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfff139d-0ae4-4489-a561-d87363c5cb13 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:09.648740 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfff139d-0ae4-4489-a561-d87363c5cb13 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:09.656082 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 186/372] 10.222.0.27 () {56 vars in 1376 bytes} [Fri Sep 9 16:18:09 2022] GET /identity/v3/role_assignments?group.id=352ddc29b15f4e6790e820fc58e9ee68&scope.project.id=b42bed1e233c4e71a1ec8ca3ae42c433&role.id=b38e84bf077846ee802e6bb1bad83522 => generated 260 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:18:09.656082 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfff139d-0ae4-4489-a561-d87363c5cb13 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:09.745400 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4845ee4-6a4c-4371-a66e-a843e64f6d53 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:09.772805 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfff139d-0ae4-4489-a561-d87363c5cb13 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:09.792895 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:09.808187 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:09.818898 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76f576c-6e4d-43c7-b52a-513e3cbaec12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:09.819705 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76f576c-6e4d-43c7-b52a-513e3cbaec12 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:09.820094 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76f576c-6e4d-43c7-b52a-513e3cbaec12 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:09.820433 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76f576c-6e4d-43c7-b52a-513e3cbaec12 None admin] PATH_INFO: `/v3/projects/b42bed1e233c4e71a1ec8ca3ae42c433` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:09.821748 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76f576c-6e4d-43c7-b52a-513e3cbaec12 None admin] RBAC: Authorizing `identity:get_project(project_id=b42bed1e233c4e71a1ec8ca3ae42c433)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:09.822658 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bafaeb-9347-487c-8a34-481de78fbc20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:09.823414 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76f576c-6e4d-43c7-b52a-513e3cbaec12 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:09.823696 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bafaeb-9347-487c-8a34-481de78fbc20 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:09.824159 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bafaeb-9347-487c-8a34-481de78fbc20 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:09.824621 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bafaeb-9347-487c-8a34-481de78fbc20 None admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:09.825478 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bafaeb-9347-487c-8a34-481de78fbc20 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:18:09.825675 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 187/373] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Sep 9 16:18:09 2022] GET /identity/v3/projects/b42bed1e233c4e71a1ec8ca3ae42c433 => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:18:09.826154 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bafaeb-9347-487c-8a34-481de78fbc20 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:09.828731 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bafaeb-9347-487c-8a34-481de78fbc20 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:09.831080 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76f576c-6e4d-43c7-b52a-513e3cbaec12 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:09.849852 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 187/374] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Sep 9 16:18:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:18:09.856448 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bafaeb-9347-487c-8a34-481de78fbc20 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:09.942595 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76f576c-6e4d-43c7-b52a-513e3cbaec12 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:09.978603 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb7fb79-426e-4aa3-b2ae-25444054ff8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:09.979728 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb7fb79-426e-4aa3-b2ae-25444054ff8e None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:09.980197 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb7fb79-426e-4aa3-b2ae-25444054ff8e None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:09.980681 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb7fb79-426e-4aa3-b2ae-25444054ff8e None admin] PATH_INFO: `/v3/groups/352ddc29b15f4e6790e820fc58e9ee68` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:09.982129 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb7fb79-426e-4aa3-b2ae-25444054ff8e None admin] RBAC: Authorizing `identity:get_group(group_id=352ddc29b15f4e6790e820fc58e9ee68)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:09.983879 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb7fb79-426e-4aa3-b2ae-25444054ff8e None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:09.986101 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 188/375] 10.222.0.27 () {56 vars in 1180 bytes} [Fri Sep 9 16:18:09 2022] GET /identity/v3/groups/352ddc29b15f4e6790e820fc58e9ee68 => generated 226 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:18:09.993606 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb7fb79-426e-4aa3-b2ae-25444054ff8e None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:10.011873 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bafaeb-9347-487c-8a34-481de78fbc20 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:10.049026 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c130ee77-5cbe-4229-a820-a1a225a68ebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:10.049642 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c130ee77-5cbe-4229-a820-a1a225a68ebe None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:10.049920 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c130ee77-5cbe-4229-a820-a1a225a68ebe None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:10.050782 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c130ee77-5cbe-4229-a820-a1a225a68ebe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:10.064395 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:10.105653 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb7fb79-426e-4aa3-b2ae-25444054ff8e None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:10.120121 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:10.135939 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c130ee77-5cbe-4229-a820-a1a225a68ebe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:10.137516 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c130ee77-5cbe-4229-a820-a1a225a68ebe None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:10.147069 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b8d059-272d-4259-9792-ee946e4f3876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:10.148183 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b8d059-272d-4259-9792-ee946e4f3876 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:10.148653 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b8d059-272d-4259-9792-ee946e4f3876 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:10.149160 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b8d059-272d-4259-9792-ee946e4f3876 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:10.150160 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b8d059-272d-4259-9792-ee946e4f3876 None admin] RBAC: Adding query filter params (group.id=352ddc29b15f4e6790e820fc58e9ee68, role.id=9452afb4ffe54eb7b7b5b0aff7dd00ed, scope.project.id=b42bed1e233c4e71a1ec8ca3ae42c433) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:18:10.150687 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b8d059-272d-4259-9792-ee946e4f3876 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:10.152428 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b8d059-272d-4259-9792-ee946e4f3876 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:10.158881 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 189/376] 10.222.0.27 () {56 vars in 1376 bytes} [Fri Sep 9 16:18:09 2022] GET /identity/v3/role_assignments?group.id=352ddc29b15f4e6790e820fc58e9ee68&scope.project.id=b42bed1e233c4e71a1ec8ca3ae42c433&role.id=9452afb4ffe54eb7b7b5b0aff7dd00ed => generated 260 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:18:10.277506 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 188/377] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Sep 9 16:18:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 16:18:10.286474 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b8d059-272d-4259-9792-ee946e4f3876 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:10.416660 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b8d059-272d-4259-9792-ee946e4f3876 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:10.451093 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:10.462066 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a249ac-0ab6-48be-a817-f19560a1f94b None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:10.463049 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a249ac-0ab6-48be-a817-f19560a1f94b None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:10.463171 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d74c06-534a-491d-a493-8ff630c45d5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:10.463670 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a249ac-0ab6-48be-a817-f19560a1f94b None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:10.463963 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d74c06-534a-491d-a493-8ff630c45d5b None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:10.464467 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d74c06-534a-491d-a493-8ff630c45d5b None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:10.464737 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d74c06-534a-491d-a493-8ff630c45d5b None admin] PATH_INFO: `/v3/projects/5e37a1d93b9b4afb9e8aecb24b733b95` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:10.465682 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 189/378] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:18:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:18:10.465929 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d74c06-534a-491d-a493-8ff630c45d5b None admin] RBAC: Authorizing `identity:get_project(project_id=5e37a1d93b9b4afb9e8aecb24b733b95)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:10.467486 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d74c06-534a-491d-a493-8ff630c45d5b None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:10.469318 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 190/379] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Sep 9 16:18:10 2022] GET /identity/v3/projects/5e37a1d93b9b4afb9e8aecb24b733b95 => generated 344 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:18:10.472624 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b1a823-25f4-446c-b158-163a811a08f7 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:10.473127 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b1a823-25f4-446c-b158-163a811a08f7 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:10.473601 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b1a823-25f4-446c-b158-163a811a08f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:10.475304 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d74c06-534a-491d-a493-8ff630c45d5b None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:10.494217 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-63b1a823-25f4-446c-b158-163a811a08f7 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:18:10.496000 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-63b1a823-25f4-446c-b158-163a811a08f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:18:10.602171 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d74c06-534a-491d-a493-8ff630c45d5b None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:10.617896 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 190/380] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:18:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 16:18:10.642059 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad6b7a5-6000-42ce-8c1c-a81e1cc55c91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:10.642725 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad6b7a5-6000-42ce-8c1c-a81e1cc55c91 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:10.643000 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad6b7a5-6000-42ce-8c1c-a81e1cc55c91 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:10.643272 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad6b7a5-6000-42ce-8c1c-a81e1cc55c91 None admin] PATH_INFO: `/v3/groups/485f45f5006b4a17a2a2f7550eff0b10` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:10.652259 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad6b7a5-6000-42ce-8c1c-a81e1cc55c91 None admin] RBAC: Authorizing `identity:get_group(group_id=485f45f5006b4a17a2a2f7550eff0b10)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:10.653771 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad6b7a5-6000-42ce-8c1c-a81e1cc55c91 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:10.655785 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 191/381] 10.222.0.27 () {56 vars in 1180 bytes} [Fri Sep 9 16:18:10 2022] GET /identity/v3/groups/485f45f5006b4a17a2a2f7550eff0b10 => generated 229 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:18:10.662193 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b1a823-25f4-446c-b158-163a811a08f7 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:10.691901 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:10.798816 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b1a823-25f4-446c-b158-163a811a08f7 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:10.849385 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8f3e7d-258e-462a-9551-2a068df31a80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:10.849999 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8f3e7d-258e-462a-9551-2a068df31a80 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:10.850275 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8f3e7d-258e-462a-9551-2a068df31a80 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:10.850576 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8f3e7d-258e-462a-9551-2a068df31a80 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:10.851293 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8f3e7d-258e-462a-9551-2a068df31a80 None admin] RBAC: Adding query filter params (group.id=485f45f5006b4a17a2a2f7550eff0b10, role.id=0a36d1be416f4089be19be979943b731, scope.project.id=5e37a1d93b9b4afb9e8aecb24b733b95) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:18:10.851596 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8f3e7d-258e-462a-9551-2a068df31a80 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:10.853196 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8f3e7d-258e-462a-9551-2a068df31a80 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:10.862563 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 191/382] 10.222.0.27 () {56 vars in 1376 bytes} [Fri Sep 9 16:18:10 2022] GET /identity/v3/role_assignments?group.id=485f45f5006b4a17a2a2f7550eff0b10&scope.project.id=5e37a1d93b9b4afb9e8aecb24b733b95&role.id=0a36d1be416f4089be19be979943b731 => generated 260 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 16:18:11.062772 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad6b7a5-6000-42ce-8c1c-a81e1cc55c91 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:11.131375 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:11.182240 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad6b7a5-6000-42ce-8c1c-a81e1cc55c91 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:11.228566 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5d3105-ccac-4a41-9d1e-01a7679da42e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:11.229204 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5d3105-ccac-4a41-9d1e-01a7679da42e None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:11.229521 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5d3105-ccac-4a41-9d1e-01a7679da42e None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:11.229800 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5d3105-ccac-4a41-9d1e-01a7679da42e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:11.243392 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5d3105-ccac-4a41-9d1e-01a7679da42e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 16:18:11.248845 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-5e5d3105-ccac-4a41-9d1e-01a7679da42e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 16:18:11.248845 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:18:11.248845 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:18:11.248845 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:18:11.248845 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:18:11.248845 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:18:11.248845 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:18:11.248845 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:18:11.248845 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:18:11.248845 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:18:11.248845 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:18:11.248845 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:18:11.248845 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 16:18:11.248845 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 16:18:11.248845 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 16:18:11.248845 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 16:18:11.249714 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 16:18:11.249714 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 16:18:11.249714 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 16:18:11.249714 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 16:18:11.249714 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:18:11.249714 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:18:11.249714 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:18:11.249714 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:18:11.249714 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:18:11.249714 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:18:11.249714 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:18:11.249714 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Sep 09 16:18:11.249714 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:18:11.249714 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:18:11.249714 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:18:11.249714 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:18:11.250544 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:18:11.250544 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:18:11.250544 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:18:11.250544 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:18:11.250544 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 16:18:11.250544 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 16:18:11.250544 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 16:18:11.250544 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 16:18:11.250544 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 16:18:11.250544 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 16:18:11.250544 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 16:18:11.250544 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:18:11.250544 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 192/383] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Sep 9 16:18:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:18:11.256732 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8f3e7d-258e-462a-9551-2a068df31a80 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:11.388373 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:11.408641 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8f3e7d-258e-462a-9551-2a068df31a80 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:11.412129 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3682a5f1-44f2-4d5f-a29e-3a42cf9eab9e None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:11.412416 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3682a5f1-44f2-4d5f-a29e-3a42cf9eab9e None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:11.412687 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3682a5f1-44f2-4d5f-a29e-3a42cf9eab9e None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:11.414151 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 193/384] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:18:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:18:11.419182 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0680f3-232e-4480-b158-aacc282f435b None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:11.419750 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0680f3-232e-4480-b158-aacc282f435b None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:11.419750 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0680f3-232e-4480-b158-aacc282f435b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:11.456210 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-df0680f3-232e-4480-b158-aacc282f435b None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:18:11.457431 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-df0680f3-232e-4480-b158-aacc282f435b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:18:11.477871 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa8f24b-74c5-4c64-900c-c8a55488c9f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:11.478555 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa8f24b-74c5-4c64-900c-c8a55488c9f7 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:11.478794 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa8f24b-74c5-4c64-900c-c8a55488c9f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:11.479067 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa8f24b-74c5-4c64-900c-c8a55488c9f7 None admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:11.479730 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa8f24b-74c5-4c64-900c-c8a55488c9f7 None admin] RBAC: Adding query filter params (name=member) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:18:11.480034 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa8f24b-74c5-4c64-900c-c8a55488c9f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:11.481445 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa8f24b-74c5-4c64-900c-c8a55488c9f7 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:11.499991 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 192/385] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Sep 9 16:18:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:18:11.520910 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa8f24b-74c5-4c64-900c-c8a55488c9f7 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:11.558912 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 194/386] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:18:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 16:18:11.649423 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa8f24b-74c5-4c64-900c-c8a55488c9f7 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:11.689321 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765bd788-839f-4041-9c93-986f10fc728f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:11.689946 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765bd788-839f-4041-9c93-986f10fc728f None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:11.690223 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765bd788-839f-4041-9c93-986f10fc728f None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:11.690597 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765bd788-839f-4041-9c93-986f10fc728f None admin] PATH_INFO: `/v3/groups/352ddc29b15f4e6790e820fc58e9ee68` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:11.691765 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765bd788-839f-4041-9c93-986f10fc728f None admin] RBAC: Authorizing `identity:get_group(group_id=352ddc29b15f4e6790e820fc58e9ee68)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:11.693268 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765bd788-839f-4041-9c93-986f10fc728f None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:11.695206 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 193/387] 10.222.0.27 () {56 vars in 1180 bytes} [Fri Sep 9 16:18:11 2022] GET /identity/v3/groups/352ddc29b15f4e6790e820fc58e9ee68 => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 16:18:11.700700 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0680f3-232e-4480-b158-aacc282f435b None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:11.755112 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:11.808844 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0680f3-232e-4480-b158-aacc282f435b None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:11.843955 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc23fc9-e069-4ac9-b631-b045bd10111d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:11.844584 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc23fc9-e069-4ac9-b631-b045bd10111d None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:11.844859 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc23fc9-e069-4ac9-b631-b045bd10111d None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:11.845131 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc23fc9-e069-4ac9-b631-b045bd10111d None admin] PATH_INFO: `/v3/projects/adc7a18acd23477d80890d7a3477e7c9` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:11.846250 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc23fc9-e069-4ac9-b631-b045bd10111d None admin] RBAC: Authorizing `identity:get_project(project_id=adc7a18acd23477d80890d7a3477e7c9)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:11.848238 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc23fc9-e069-4ac9-b631-b045bd10111d None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:11.850159 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 195/388] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Sep 9 16:18:11 2022] GET /identity/v3/projects/adc7a18acd23477d80890d7a3477e7c9 => generated 298 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:18:11.855962 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765bd788-839f-4041-9c93-986f10fc728f None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:11.870122 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:11.968119 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765bd788-839f-4041-9c93-986f10fc728f None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:12.004211 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817cc9a3-2b7f-4d2b-a61b-97e4e62775c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:12.004876 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817cc9a3-2b7f-4d2b-a61b-97e4e62775c8 None admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:12.005155 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817cc9a3-2b7f-4d2b-a61b-97e4e62775c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:12.005427 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817cc9a3-2b7f-4d2b-a61b-97e4e62775c8 None admin] PATH_INFO: `/v3/projects/adc7a18acd23477d80890d7a3477e7c9/groups/352ddc29b15f4e6790e820fc58e9ee68/roles/b38e84bf077846ee802e6bb1bad83522` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:12.007396 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817cc9a3-2b7f-4d2b-a61b-97e4e62775c8 None admin] RBAC: Authorizing `identity:create_grant(project_id=adc7a18acd23477d80890d7a3477e7c9, group_id=352ddc29b15f4e6790e820fc58e9ee68, role_id=b38e84bf077846ee802e6bb1bad83522)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:12.008831 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817cc9a3-2b7f-4d2b-a61b-97e4e62775c8 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:12.024931 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 194/389] 10.222.0.27 () {58 vars in 1442 bytes} [Fri Sep 9 16:18:11 2022] PUT /identity/v3/projects/adc7a18acd23477d80890d7a3477e7c9/groups/352ddc29b15f4e6790e820fc58e9ee68/roles/b38e84bf077846ee802e6bb1bad83522 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:18:12.026466 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc23fc9-e069-4ac9-b631-b045bd10111d None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:12.175073 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc23fc9-e069-4ac9-b631-b045bd10111d None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:12.208364 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:12.229658 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdc859c-a54f-4da7-b66a-11dcb1912128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:12.230242 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdc859c-a54f-4da7-b66a-11dcb1912128 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:12.230556 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdc859c-a54f-4da7-b66a-11dcb1912128 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:12.230828 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdc859c-a54f-4da7-b66a-11dcb1912128 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:12.250401 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdc859c-a54f-4da7-b66a-11dcb1912128 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 16:18:12.257390 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-ccdc859c-a54f-4da7-b66a-11dcb1912128 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 16:18:12.257390 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:18:12.257390 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:18:12.257390 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:18:12.257390 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:18:12.257390 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:18:12.257390 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:18:12.257390 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:18:12.257390 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:18:12.257390 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:18:12.257390 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:18:12.257390 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:18:12.257390 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 16:18:12.257390 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 16:18:12.257390 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 16:18:12.257390 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 16:18:12.259443 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 16:18:12.259443 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 16:18:12.259443 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 16:18:12.259443 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 16:18:12.259443 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:18:12.259443 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:18:12.259443 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:18:12.259443 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:18:12.259443 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:18:12.259443 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:18:12.259443 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:18:12.259443 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Sep 09 16:18:12.259443 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:18:12.259443 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:18:12.259443 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:18:12.259443 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:18:12.261345 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:18:12.261345 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:18:12.261345 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:18:12.261345 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:18:12.261345 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 16:18:12.261345 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 16:18:12.261345 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 16:18:12.261345 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 16:18:12.261345 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 16:18:12.261345 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 16:18:12.261345 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 16:18:12.261345 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:18:12.261345 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 196/390] 10.222.0.27 () {56 vars in 1114 bytes} [Fri Sep 9 16:18:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:18:12.265751 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817cc9a3-2b7f-4d2b-a61b-97e4e62775c8 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:12.353988 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:12.390886 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817cc9a3-2b7f-4d2b-a61b-97e4e62775c8 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:12.428733 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7dce21-54ff-4c33-b784-2f81cf611964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:12.429346 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7dce21-54ff-4c33-b784-2f81cf611964 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:12.429624 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7dce21-54ff-4c33-b784-2f81cf611964 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:12.429945 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7dce21-54ff-4c33-b784-2f81cf611964 None admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:12.430630 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7dce21-54ff-4c33-b784-2f81cf611964 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:18:12.430984 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7dce21-54ff-4c33-b784-2f81cf611964 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:12.432431 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7dce21-54ff-4c33-b784-2f81cf611964 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:12.444762 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 195/391] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Sep 9 16:18:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:18:12.450401 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdc859c-a54f-4da7-b66a-11dcb1912128 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:12.571960 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdc859c-a54f-4da7-b66a-11dcb1912128 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:12.618078 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c18b171-47b2-4170-8963-b02b7c1316ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:12.618789 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c18b171-47b2-4170-8963-b02b7c1316ca None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:12.619072 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c18b171-47b2-4170-8963-b02b7c1316ca None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:12.619346 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c18b171-47b2-4170-8963-b02b7c1316ca None admin] PATH_INFO: `/v3/groups/352ddc29b15f4e6790e820fc58e9ee68` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:12.620469 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c18b171-47b2-4170-8963-b02b7c1316ca None admin] RBAC: Authorizing `identity:get_group(group_id=352ddc29b15f4e6790e820fc58e9ee68)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:12.621922 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c18b171-47b2-4170-8963-b02b7c1316ca None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:12.623870 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 197/392] 10.222.0.27 () {56 vars in 1180 bytes} [Fri Sep 9 16:18:12 2022] GET /identity/v3/groups/352ddc29b15f4e6790e820fc58e9ee68 => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:18:12.630053 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7dce21-54ff-4c33-b784-2f81cf611964 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:12.657604 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb06fc5a-621d-4220-9775-90855d027007 None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:12.657887 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb06fc5a-621d-4220-9775-90855d027007 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:12.658160 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb06fc5a-621d-4220-9775-90855d027007 None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:12.659746 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 198/393] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:18:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:18:12.668924 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450dfa4f-6a15-484d-a95c-f7abc0665df3 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:12.668924 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450dfa4f-6a15-484d-a95c-f7abc0665df3 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:12.668924 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450dfa4f-6a15-484d-a95c-f7abc0665df3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:12.690377 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-450dfa4f-6a15-484d-a95c-f7abc0665df3 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:18:12.692094 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-450dfa4f-6a15-484d-a95c-f7abc0665df3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:18:12.748065 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:12.770844 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7dce21-54ff-4c33-b784-2f81cf611964 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:12.786523 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 199/394] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:18:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 16:18:12.814558 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:12.820898 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa9dc5a-fc26-45eb-8d3a-7f5d97b551ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:12.821598 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa9dc5a-fc26-45eb-8d3a-7f5d97b551ad None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:12.821924 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa9dc5a-fc26-45eb-8d3a-7f5d97b551ad None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:12.822262 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa9dc5a-fc26-45eb-8d3a-7f5d97b551ad None admin] PATH_INFO: `/v3/projects/adc7a18acd23477d80890d7a3477e7c9` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:12.823377 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa9dc5a-fc26-45eb-8d3a-7f5d97b551ad None admin] RBAC: Authorizing `identity:get_project(project_id=adc7a18acd23477d80890d7a3477e7c9)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:12.824923 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa9dc5a-fc26-45eb-8d3a-7f5d97b551ad None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:12.826638 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 196/395] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Sep 9 16:18:12 2022] GET /identity/v3/projects/adc7a18acd23477d80890d7a3477e7c9 => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:18:12.835394 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450dfa4f-6a15-484d-a95c-f7abc0665df3 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:12.954011 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450dfa4f-6a15-484d-a95c-f7abc0665df3 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:12.998974 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65810488-12c5-46d4-9873-ea96e8b30358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:12.999640 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65810488-12c5-46d4-9873-ea96e8b30358 None admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:12.999922 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65810488-12c5-46d4-9873-ea96e8b30358 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:13.000192 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65810488-12c5-46d4-9873-ea96e8b30358 None admin] PATH_INFO: `/v3/projects/adc7a18acd23477d80890d7a3477e7c9/groups/352ddc29b15f4e6790e820fc58e9ee68/roles/9452afb4ffe54eb7b7b5b0aff7dd00ed` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:13.002405 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65810488-12c5-46d4-9873-ea96e8b30358 None admin] RBAC: Authorizing `identity:create_grant(project_id=adc7a18acd23477d80890d7a3477e7c9, group_id=352ddc29b15f4e6790e820fc58e9ee68, role_id=9452afb4ffe54eb7b7b5b0aff7dd00ed)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:13.004458 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65810488-12c5-46d4-9873-ea96e8b30358 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:13.035594 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 200/396] 10.222.0.27 () {58 vars in 1442 bytes} [Fri Sep 9 16:18:12 2022] PUT /identity/v3/projects/adc7a18acd23477d80890d7a3477e7c9/groups/352ddc29b15f4e6790e820fc58e9ee68/roles/9452afb4ffe54eb7b7b5b0aff7dd00ed => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:18:13.147913 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa9dc5a-fc26-45eb-8d3a-7f5d97b551ad None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:13.270837 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa9dc5a-fc26-45eb-8d3a-7f5d97b551ad None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:13.321042 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb51b794-5e65-4d02-9821-d4e3a4990625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:13.322106 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb51b794-5e65-4d02-9821-d4e3a4990625 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:13.322635 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb51b794-5e65-4d02-9821-d4e3a4990625 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:13.323113 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb51b794-5e65-4d02-9821-d4e3a4990625 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:13.335992 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb51b794-5e65-4d02-9821-d4e3a4990625 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 16:18:13.342805 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-eb51b794-5e65-4d02-9821-d4e3a4990625 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 16:18:13.342805 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:18:13.342805 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:18:13.342805 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:18:13.342805 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:18:13.342805 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:18:13.342805 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:18:13.342805 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:18:13.342805 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:18:13.342805 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:18:13.342805 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:18:13.342805 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:18:13.342805 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 16:18:13.342805 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 16:18:13.342805 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 16:18:13.342805 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 16:18:13.343760 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 16:18:13.343760 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 16:18:13.343760 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 16:18:13.343760 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 16:18:13.343760 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:18:13.343760 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:18:13.343760 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:18:13.343760 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:18:13.343760 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:18:13.343760 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:18:13.343760 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:18:13.343760 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 16:18:13.343760 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:18:13.343760 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:18:13.343760 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:18:13.343760 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:18:13.344561 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:18:13.344561 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:18:13.344561 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:18:13.344561 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:18:13.344561 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 16:18:13.344561 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 16:18:13.344561 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 16:18:13.344561 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 16:18:13.344561 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 16:18:13.344561 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 16:18:13.344561 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 16:18:13.344561 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 16:18:13.348037 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 197/397] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Sep 9 16:18:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:18:13.353535 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65810488-12c5-46d4-9873-ea96e8b30358 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:13.392976 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:13.483227 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65810488-12c5-46d4-9873-ea96e8b30358 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:13.498542 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfceaf4e-0881-4109-88e9-1cd9897de82b None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:13.499212 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfceaf4e-0881-4109-88e9-1cd9897de82b None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:13.499719 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfceaf4e-0881-4109-88e9-1cd9897de82b None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:13.501287 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 198/398] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:18:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:18:13.508091 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc4a201-ecc5-4a08-949c-d385b1772ac9 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:13.508698 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc4a201-ecc5-4a08-949c-d385b1772ac9 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:13.509168 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc4a201-ecc5-4a08-949c-d385b1772ac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:13.526607 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a917e4b-0e98-4b8f-ba51-5ee1d8ccf8aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:13.527228 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a917e4b-0e98-4b8f-ba51-5ee1d8ccf8aa None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:13.527504 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a917e4b-0e98-4b8f-ba51-5ee1d8ccf8aa None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:13.527774 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a917e4b-0e98-4b8f-ba51-5ee1d8ccf8aa None admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:13.528431 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a917e4b-0e98-4b8f-ba51-5ee1d8ccf8aa None admin] RBAC: Adding query filter params (name=member) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:18:13.528729 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a917e4b-0e98-4b8f-ba51-5ee1d8ccf8aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:13.530107 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a917e4b-0e98-4b8f-ba51-5ee1d8ccf8aa None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:13.533295 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-bbc4a201-ecc5-4a08-949c-d385b1772ac9 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:18:13.535430 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-bbc4a201-ecc5-4a08-949c-d385b1772ac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:18:13.541162 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 201/399] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Sep 9 16:18:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:18:13.547291 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a917e4b-0e98-4b8f-ba51-5ee1d8ccf8aa None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:13.645758 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:13.663672 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:13.668183 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a917e4b-0e98-4b8f-ba51-5ee1d8ccf8aa None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:13.674331 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 199/400] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:18:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 16:18:13.710057 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a249e349-c1e9-4937-9d26-3ab4087e7587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:13.710719 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a249e349-c1e9-4937-9d26-3ab4087e7587 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:13.710998 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a249e349-c1e9-4937-9d26-3ab4087e7587 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:13.711271 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a249e349-c1e9-4937-9d26-3ab4087e7587 None admin] PATH_INFO: `/v3/groups/352ddc29b15f4e6790e820fc58e9ee68` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:13.714967 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a249e349-c1e9-4937-9d26-3ab4087e7587 None admin] RBAC: Authorizing `identity:get_group(group_id=352ddc29b15f4e6790e820fc58e9ee68)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:13.716424 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a249e349-c1e9-4937-9d26-3ab4087e7587 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:13.718003 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 202/401] 10.222.0.27 () {56 vars in 1180 bytes} [Fri Sep 9 16:18:13 2022] GET /identity/v3/groups/352ddc29b15f4e6790e820fc58e9ee68 => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 16:18:13.724121 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc4a201-ecc5-4a08-949c-d385b1772ac9 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:13.892019 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc4a201-ecc5-4a08-949c-d385b1772ac9 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:13.935892 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbbb17d-67f8-4c31-9aab-419e507317ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:13.936527 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbbb17d-67f8-4c31-9aab-419e507317ef None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:13.936802 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbbb17d-67f8-4c31-9aab-419e507317ef None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:13.937100 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbbb17d-67f8-4c31-9aab-419e507317ef None admin] PATH_INFO: `/v3/projects/b42bed1e233c4e71a1ec8ca3ae42c433` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:13.938188 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbbb17d-67f8-4c31-9aab-419e507317ef None admin] RBAC: Authorizing `identity:get_project(project_id=b42bed1e233c4e71a1ec8ca3ae42c433)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:13.939647 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbbb17d-67f8-4c31-9aab-419e507317ef None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:13.942136 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 200/402] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Sep 9 16:18:13 2022] GET /identity/v3/projects/b42bed1e233c4e71a1ec8ca3ae42c433 => generated 302 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:18:13.947474 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a249e349-c1e9-4937-9d26-3ab4087e7587 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:14.093287 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a249e349-c1e9-4937-9d26-3ab4087e7587 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:14.115359 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbbb17d-67f8-4c31-9aab-419e507317ef None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:14.136900 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17759b2-dd09-483a-8e5d-6b6eacad7146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:14.138623 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17759b2-dd09-483a-8e5d-6b6eacad7146 None admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:14.139329 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17759b2-dd09-483a-8e5d-6b6eacad7146 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:14.141195 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17759b2-dd09-483a-8e5d-6b6eacad7146 None admin] PATH_INFO: `/v3/projects/b42bed1e233c4e71a1ec8ca3ae42c433/groups/352ddc29b15f4e6790e820fc58e9ee68/roles/b38e84bf077846ee802e6bb1bad83522` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:14.145857 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17759b2-dd09-483a-8e5d-6b6eacad7146 None admin] RBAC: Authorizing `identity:create_grant(project_id=b42bed1e233c4e71a1ec8ca3ae42c433, group_id=352ddc29b15f4e6790e820fc58e9ee68, role_id=b38e84bf077846ee802e6bb1bad83522)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:14.147848 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17759b2-dd09-483a-8e5d-6b6eacad7146 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:14.170656 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 203/403] 10.222.0.27 () {58 vars in 1442 bytes} [Fri Sep 9 16:18:13 2022] PUT /identity/v3/projects/b42bed1e233c4e71a1ec8ca3ae42c433/groups/352ddc29b15f4e6790e820fc58e9ee68/roles/b38e84bf077846ee802e6bb1bad83522 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:18:14.172280 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263d652c-8ceb-41e8-91cf-e67999a0e03a None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:14.172637 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263d652c-8ceb-41e8-91cf-e67999a0e03a None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:14.172917 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263d652c-8ceb-41e8-91cf-e67999a0e03a None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:14.178674 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 204/404] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:18:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:18:14.180739 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c349fb7-dff2-4c35-b842-300b89bcfd9b None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:14.181237 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c349fb7-dff2-4c35-b842-300b89bcfd9b None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:14.181704 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c349fb7-dff2-4c35-b842-300b89bcfd9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:14.201555 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-9c349fb7-dff2-4c35-b842-300b89bcfd9b None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:18:14.203172 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-9c349fb7-dff2-4c35-b842-300b89bcfd9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:18:14.206466 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:14.241950 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:14.304491 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbbb17d-67f8-4c31-9aab-419e507317ef None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:14.352765 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 205/405] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:18:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 16:18:14.374931 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5509487d-3ab9-43c4-aca6-e619fb50f223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:14.375575 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5509487d-3ab9-43c4-aca6-e619fb50f223 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:14.375850 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5509487d-3ab9-43c4-aca6-e619fb50f223 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:14.376113 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5509487d-3ab9-43c4-aca6-e619fb50f223 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:14.395127 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5509487d-3ab9-43c4-aca6-e619fb50f223 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 16:18:14.400066 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-5509487d-3ab9-43c4-aca6-e619fb50f223 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 16:18:14.400066 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:18:14.400066 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:18:14.400066 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:18:14.400066 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:18:14.400066 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:18:14.400066 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:18:14.400066 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:18:14.400066 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:18:14.400066 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:18:14.400066 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:18:14.400066 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:18:14.400066 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 16:18:14.400066 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 16:18:14.400066 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 16:18:14.400066 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 16:18:14.400932 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 16:18:14.400932 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 16:18:14.400932 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 16:18:14.400932 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 16:18:14.400932 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:18:14.400932 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:18:14.400932 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:18:14.400932 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:18:14.400932 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:18:14.400932 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:18:14.400932 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:18:14.400932 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 16:18:14.400932 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:18:14.400932 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:18:14.400932 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:18:14.400932 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:18:14.401743 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:18:14.401743 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:18:14.401743 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:18:14.401743 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:18:14.401743 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 16:18:14.401743 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 16:18:14.401743 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 16:18:14.401743 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 16:18:14.401743 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 16:18:14.401743 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 16:18:14.401743 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 16:18:14.401743 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 16:18:14.402376 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 201/406] 10.222.0.27 () {56 vars in 1114 bytes} [Fri Sep 9 16:18:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:18:14.407765 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c349fb7-dff2-4c35-b842-300b89bcfd9b None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:14.578928 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c349fb7-dff2-4c35-b842-300b89bcfd9b None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:14.632367 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea45892-4229-433a-b25e-0bce44114c20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:14.632982 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea45892-4229-433a-b25e-0bce44114c20 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:14.633259 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea45892-4229-433a-b25e-0bce44114c20 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:14.633529 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea45892-4229-433a-b25e-0bce44114c20 None admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:14.634186 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea45892-4229-433a-b25e-0bce44114c20 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:18:14.634513 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea45892-4229-433a-b25e-0bce44114c20 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:14.635894 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea45892-4229-433a-b25e-0bce44114c20 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:14.649925 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 206/407] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Sep 9 16:18:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:18:14.655352 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5509487d-3ab9-43c4-aca6-e619fb50f223 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:14.698664 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea45892-4229-433a-b25e-0bce44114c20 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:14.727338 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:14.799431 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5509487d-3ab9-43c4-aca6-e619fb50f223 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:14.822169 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:14.855191 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128ef987-00cf-4d96-b50a-08ab41bdc444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:14.855825 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128ef987-00cf-4d96-b50a-08ab41bdc444 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:14.856097 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128ef987-00cf-4d96-b50a-08ab41bdc444 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:14.856368 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128ef987-00cf-4d96-b50a-08ab41bdc444 None admin] PATH_INFO: `/v3/groups/352ddc29b15f4e6790e820fc58e9ee68` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:14.858286 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128ef987-00cf-4d96-b50a-08ab41bdc444 None admin] RBAC: Authorizing `identity:get_group(group_id=352ddc29b15f4e6790e820fc58e9ee68)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:14.859753 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128ef987-00cf-4d96-b50a-08ab41bdc444 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:14.861334 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 202/408] 10.222.0.27 () {56 vars in 1180 bytes} [Fri Sep 9 16:18:14 2022] GET /identity/v3/groups/352ddc29b15f4e6790e820fc58e9ee68 => generated 226 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:18:14.868498 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128ef987-00cf-4d96-b50a-08ab41bdc444 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:14.894288 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea45892-4229-433a-b25e-0bce44114c20 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:14.933587 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ec6710-2a23-4062-a584-ac3f2a6a6930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:14.934497 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ec6710-2a23-4062-a584-ac3f2a6a6930 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:14.934776 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ec6710-2a23-4062-a584-ac3f2a6a6930 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:14.935045 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ec6710-2a23-4062-a584-ac3f2a6a6930 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:14.946793 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ec6710-2a23-4062-a584-ac3f2a6a6930 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 16:18:14.952932 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-e8ec6710-2a23-4062-a584-ac3f2a6a6930 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 16:18:14.952932 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:18:14.952932 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:18:14.952932 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:18:14.952932 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:18:14.952932 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:18:14.952932 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:18:14.952932 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:18:14.952932 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:18:14.952932 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:18:14.952932 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:18:14.952932 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:18:14.952932 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 16:18:14.952932 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 16:18:14.952932 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 16:18:14.952932 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 16:18:14.953830 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 16:18:14.953830 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 16:18:14.953830 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 16:18:14.953830 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 16:18:14.953830 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:18:14.953830 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:18:14.953830 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:18:14.953830 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:18:14.953830 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:18:14.953830 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:18:14.953830 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:18:14.953830 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Sep 09 16:18:14.953830 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:18:14.953830 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:18:14.953830 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:18:14.953830 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:18:14.954681 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:18:14.954681 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:18:14.954681 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:18:14.954681 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:18:14.954681 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 16:18:14.954681 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 16:18:14.954681 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 16:18:14.954681 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 16:18:14.954681 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 16:18:14.954681 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 16:18:14.954681 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 16:18:14.954681 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:18:14.954681 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 207/409] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Sep 9 16:18:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 16:18:14.955471 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d690e564-3161-4f4c-b702-e6337e8a56c7 None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:14.955471 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d690e564-3161-4f4c-b702-e6337e8a56c7 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:14.955790 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d690e564-3161-4f4c-b702-e6337e8a56c7 None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:14.957935 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 208/410] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:18:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:18:14.962919 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d690e564-3161-4f4c-b702-e6337e8a56c7 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:15.021806 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128ef987-00cf-4d96-b50a-08ab41bdc444 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:15.053649 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:15.073707 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b895ae08-df5b-40a6-b3ed-5ba0d695fe96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:15.074562 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b895ae08-df5b-40a6-b3ed-5ba0d695fe96 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:15.074839 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b895ae08-df5b-40a6-b3ed-5ba0d695fe96 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:15.075109 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b895ae08-df5b-40a6-b3ed-5ba0d695fe96 None admin] PATH_INFO: `/v3/projects/b42bed1e233c4e71a1ec8ca3ae42c433` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:15.077210 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b895ae08-df5b-40a6-b3ed-5ba0d695fe96 None admin] RBAC: Authorizing `identity:get_project(project_id=b42bed1e233c4e71a1ec8ca3ae42c433)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:15.079554 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b895ae08-df5b-40a6-b3ed-5ba0d695fe96 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:15.082214 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 203/411] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Sep 9 16:18:14 2022] GET /identity/v3/projects/b42bed1e233c4e71a1ec8ca3ae42c433 => generated 302 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:18:15.083246 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56488529-fb61-4e24-a8af-3edcdd61057e None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:15.083485 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56488529-fb61-4e24-a8af-3edcdd61057e None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:15.083757 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56488529-fb61-4e24-a8af-3edcdd61057e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:15.086694 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d690e564-3161-4f4c-b702-e6337e8a56c7 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:15.106442 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-56488529-fb61-4e24-a8af-3edcdd61057e None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:18:15.108369 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-56488529-fb61-4e24-a8af-3edcdd61057e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:18:15.127116 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c822ffb4-7ab3-464a-877a-406879b80e2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:15.127844 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c822ffb4-7ab3-464a-877a-406879b80e2e None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:15.128349 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c822ffb4-7ab3-464a-877a-406879b80e2e None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:15.128691 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c822ffb4-7ab3-464a-877a-406879b80e2e None admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:15.129405 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c822ffb4-7ab3-464a-877a-406879b80e2e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:18:15.129781 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c822ffb4-7ab3-464a-877a-406879b80e2e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:15.131577 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c822ffb4-7ab3-464a-877a-406879b80e2e None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:15.142815 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 209/412] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Sep 9 16:18:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:18:15.143549 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c822ffb4-7ab3-464a-877a-406879b80e2e None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:15.179585 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:15.208910 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 204/413] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:18:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 16:18:15.209838 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56488529-fb61-4e24-a8af-3edcdd61057e None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:15.264872 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c822ffb4-7ab3-464a-877a-406879b80e2e None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:15.302568 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b48f7e-b1f0-454b-9d4d-e74232a33cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:15.303505 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b48f7e-b1f0-454b-9d4d-e74232a33cb2 None admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:15.303983 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b48f7e-b1f0-454b-9d4d-e74232a33cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:15.304506 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b48f7e-b1f0-454b-9d4d-e74232a33cb2 None admin] PATH_INFO: `/v3/projects/b42bed1e233c4e71a1ec8ca3ae42c433/groups/352ddc29b15f4e6790e820fc58e9ee68/roles/9452afb4ffe54eb7b7b5b0aff7dd00ed` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:15.306973 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b48f7e-b1f0-454b-9d4d-e74232a33cb2 None admin] RBAC: Authorizing `identity:create_grant(project_id=b42bed1e233c4e71a1ec8ca3ae42c433, group_id=352ddc29b15f4e6790e820fc58e9ee68, role_id=9452afb4ffe54eb7b7b5b0aff7dd00ed)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:15.308721 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b48f7e-b1f0-454b-9d4d-e74232a33cb2 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:15.331860 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:15.336990 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 210/414] 10.222.0.27 () {58 vars in 1442 bytes} [Fri Sep 9 16:18:15 2022] PUT /identity/v3/projects/b42bed1e233c4e71a1ec8ca3ae42c433/groups/352ddc29b15f4e6790e820fc58e9ee68/roles/9452afb4ffe54eb7b7b5b0aff7dd00ed => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:18:15.375207 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56488529-fb61-4e24-a8af-3edcdd61057e None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:15.414203 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef07af2-d5d3-4d84-beb1-0c8c46a695f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:15.415252 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef07af2-d5d3-4d84-beb1-0c8c46a695f7 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:15.415723 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef07af2-d5d3-4d84-beb1-0c8c46a695f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:15.416210 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef07af2-d5d3-4d84-beb1-0c8c46a695f7 None admin] PATH_INFO: `/v3/groups/485f45f5006b4a17a2a2f7550eff0b10` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:15.417926 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef07af2-d5d3-4d84-beb1-0c8c46a695f7 None admin] RBAC: Authorizing `identity:get_group(group_id=485f45f5006b4a17a2a2f7550eff0b10)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:15.419658 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef07af2-d5d3-4d84-beb1-0c8c46a695f7 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:15.421879 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 205/415] 10.222.0.27 () {56 vars in 1180 bytes} [Fri Sep 9 16:18:15 2022] GET /identity/v3/groups/485f45f5006b4a17a2a2f7550eff0b10 => generated 229 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:18:15.427451 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b48f7e-b1f0-454b-9d4d-e74232a33cb2 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:15.554907 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b48f7e-b1f0-454b-9d4d-e74232a33cb2 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:15.592110 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7302be8e-aace-4e2d-8b84-85ef5ecd9758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:15.592724 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7302be8e-aace-4e2d-8b84-85ef5ecd9758 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:15.593004 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7302be8e-aace-4e2d-8b84-85ef5ecd9758 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:15.593275 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7302be8e-aace-4e2d-8b84-85ef5ecd9758 None admin] PATH_INFO: `/v3/projects/5e37a1d93b9b4afb9e8aecb24b733b95` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:15.594444 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7302be8e-aace-4e2d-8b84-85ef5ecd9758 None admin] RBAC: Authorizing `identity:get_project(project_id=5e37a1d93b9b4afb9e8aecb24b733b95)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:15.595895 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7302be8e-aace-4e2d-8b84-85ef5ecd9758 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:15.597845 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 211/416] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Sep 9 16:18:15 2022] GET /identity/v3/projects/5e37a1d93b9b4afb9e8aecb24b733b95 => generated 344 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:18:15.603813 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef07af2-d5d3-4d84-beb1-0c8c46a695f7 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:15.618433 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7302be8e-aace-4e2d-8b84-85ef5ecd9758 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:15.675855 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:15.698656 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:15.748084 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef07af2-d5d3-4d84-beb1-0c8c46a695f7 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:15.764160 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7302be8e-aace-4e2d-8b84-85ef5ecd9758 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:15.819244 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e868445-d928-4fa9-a3ba-8a052e11eba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:15.819848 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e868445-d928-4fa9-a3ba-8a052e11eba2 None admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:15.820127 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e868445-d928-4fa9-a3ba-8a052e11eba2 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:15.820397 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e868445-d928-4fa9-a3ba-8a052e11eba2 None admin] PATH_INFO: `/v3/projects/5e37a1d93b9b4afb9e8aecb24b733b95/groups/485f45f5006b4a17a2a2f7550eff0b10/roles/0a36d1be416f4089be19be979943b731` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:15.824595 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e868445-d928-4fa9-a3ba-8a052e11eba2 None admin] RBAC: Authorizing `identity:create_grant(project_id=5e37a1d93b9b4afb9e8aecb24b733b95, group_id=485f45f5006b4a17a2a2f7550eff0b10, role_id=0a36d1be416f4089be19be979943b731)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:15.826098 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e868445-d928-4fa9-a3ba-8a052e11eba2 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:15.832535 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12946da7-930b-4b01-a762-318ce19d9a67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:15.833191 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12946da7-930b-4b01-a762-318ce19d9a67 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:15.833473 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12946da7-930b-4b01-a762-318ce19d9a67 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:15.833740 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12946da7-930b-4b01-a762-318ce19d9a67 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:15.847784 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12946da7-930b-4b01-a762-318ce19d9a67 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 16:18:15.853080 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-12946da7-930b-4b01-a762-318ce19d9a67 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 16:18:15.853080 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:18:15.853080 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:18:15.853080 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:18:15.853080 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:18:15.853080 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:18:15.853080 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:18:15.853080 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:18:15.853080 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:18:15.853080 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:18:15.853080 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:18:15.853080 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:18:15.853080 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 16:18:15.853080 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 16:18:15.853080 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 16:18:15.853080 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 16:18:15.853959 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 16:18:15.853959 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 16:18:15.853959 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 16:18:15.853959 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 16:18:15.853959 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:18:15.853959 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:18:15.853959 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:18:15.853959 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:18:15.853959 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:18:15.853959 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:18:15.853959 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:18:15.853959 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Sep 09 16:18:15.853959 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:18:15.853959 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:18:15.853959 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:18:15.853959 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:18:15.854956 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:18:15.854956 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:18:15.854956 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:18:15.854956 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:18:15.854956 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 16:18:15.854956 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 16:18:15.854956 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 16:18:15.854956 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 16:18:15.854956 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 16:18:15.854956 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 16:18:15.854956 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 16:18:15.854956 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:18:15.854956 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 212/417] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Sep 9 16:18:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:18:15.865601 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12946da7-930b-4b01-a762-318ce19d9a67 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:15.870908 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 206/418] 10.222.0.27 () {58 vars in 1442 bytes} [Fri Sep 9 16:18:15 2022] PUT /identity/v3/projects/5e37a1d93b9b4afb9e8aecb24b733b95/groups/485f45f5006b4a17a2a2f7550eff0b10/roles/0a36d1be416f4089be19be979943b731 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:18:15.944599 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aa08d2-f379-4cfd-b8b2-85a6b15a899d None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:15.944904 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aa08d2-f379-4cfd-b8b2-85a6b15a899d None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:15.945146 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aa08d2-f379-4cfd-b8b2-85a6b15a899d None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:15.947459 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 207/419] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:18:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:18:15.956420 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b63df1-0672-47bb-932f-b6afbf3f28d6 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:15.957734 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b63df1-0672-47bb-932f-b6afbf3f28d6 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:15.958384 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b63df1-0672-47bb-932f-b6afbf3f28d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:15.994289 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-44b63df1-0672-47bb-932f-b6afbf3f28d6 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:18:15.997867 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-44b63df1-0672-47bb-932f-b6afbf3f28d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:18:16.057390 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12946da7-930b-4b01-a762-318ce19d9a67 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:16.104462 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:16.115912 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe69a57-ecf5-4ec6-93f5-f02afe5bfde4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:16.116892 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe69a57-ecf5-4ec6-93f5-f02afe5bfde4 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:16.117330 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 208/420] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:18:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 16:18:16.117536 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe69a57-ecf5-4ec6-93f5-f02afe5bfde4 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:16.117815 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe69a57-ecf5-4ec6-93f5-f02afe5bfde4 None admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:16.119217 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe69a57-ecf5-4ec6-93f5-f02afe5bfde4 None admin] RBAC: Adding query filter params (name=member) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:18:16.119217 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe69a57-ecf5-4ec6-93f5-f02afe5bfde4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:16.120295 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe69a57-ecf5-4ec6-93f5-f02afe5bfde4 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:16.134490 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 213/421] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Sep 9 16:18:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:18:16.140248 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b63df1-0672-47bb-932f-b6afbf3f28d6 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:16.191673 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:16.266603 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b63df1-0672-47bb-932f-b6afbf3f28d6 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:16.320272 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7be603d-07fe-484e-942b-7febe7c021dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:16.320890 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7be603d-07fe-484e-942b-7febe7c021dd None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:16.321170 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7be603d-07fe-484e-942b-7febe7c021dd None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:16.321435 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7be603d-07fe-484e-942b-7febe7c021dd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:16.403488 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe69a57-ecf5-4ec6-93f5-f02afe5bfde4 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:16.430162 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7be603d-07fe-484e-942b-7febe7c021dd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:16.432862 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7be603d-07fe-484e-942b-7febe7c021dd None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:16.509830 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:16.537697 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe69a57-ecf5-4ec6-93f5-f02afe5bfde4 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:16.591195 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eff303f-3775-4b28-b95d-f5d6d3cbe439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:16.591855 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eff303f-3775-4b28-b95d-f5d6d3cbe439 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:16.592138 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eff303f-3775-4b28-b95d-f5d6d3cbe439 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:16.592652 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eff303f-3775-4b28-b95d-f5d6d3cbe439 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:16.611971 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eff303f-3775-4b28-b95d-f5d6d3cbe439 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 16:18:16.617356 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-2eff303f-3775-4b28-b95d-f5d6d3cbe439 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 16:18:16.617356 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:18:16.617356 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:18:16.617356 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:18:16.617356 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:18:16.617356 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:18:16.617356 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:18:16.617356 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:18:16.617356 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:18:16.617356 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:18:16.617356 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:18:16.617356 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:18:16.617356 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 16:18:16.617356 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 16:18:16.617356 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 16:18:16.617356 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 16:18:16.618242 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 16:18:16.618242 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 16:18:16.618242 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 16:18:16.618242 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 16:18:16.618242 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:18:16.618242 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:18:16.618242 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:18:16.618242 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:18:16.618242 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:18:16.618242 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:18:16.618242 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:18:16.618242 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Sep 09 16:18:16.618242 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:18:16.618242 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:18:16.618242 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:18:16.618242 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:18:16.619490 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:18:16.619490 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:18:16.619490 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:18:16.619490 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:18:16.619490 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 16:18:16.619490 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 16:18:16.619490 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 16:18:16.619490 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 16:18:16.619490 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 16:18:16.619490 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 16:18:16.619490 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 16:18:16.619490 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:18:16.619490 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 214/422] 10.222.0.27 () {56 vars in 1114 bytes} [Fri Sep 9 16:18:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 16:18:16.622248 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 209/423] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Sep 9 16:18:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 16:18:16.626744 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7be603d-07fe-484e-942b-7febe7c021dd None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:16.627739 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eff303f-3775-4b28-b95d-f5d6d3cbe439 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:16.688432 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:16.743523 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eff303f-3775-4b28-b95d-f5d6d3cbe439 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:16.751181 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7be603d-07fe-484e-942b-7febe7c021dd None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:16.778513 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291535cf-c8ea-41dd-a428-988899c386cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:16.779111 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291535cf-c8ea-41dd-a428-988899c386cc None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:16.779393 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291535cf-c8ea-41dd-a428-988899c386cc None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:16.779654 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291535cf-c8ea-41dd-a428-988899c386cc None admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:16.780297 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291535cf-c8ea-41dd-a428-988899c386cc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:18:16.780593 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291535cf-c8ea-41dd-a428-988899c386cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:16.781964 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291535cf-c8ea-41dd-a428-988899c386cc None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:16.790217 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ce0637-d42f-492d-8ee2-725eeadecb60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:16.791020 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ce0637-d42f-492d-8ee2-725eeadecb60 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:16.791435 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ce0637-d42f-492d-8ee2-725eeadecb60 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:16.791839 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ce0637-d42f-492d-8ee2-725eeadecb60 None admin] PATH_INFO: `/v3/projects/adc7a18acd23477d80890d7a3477e7c9` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:16.793095 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ce0637-d42f-492d-8ee2-725eeadecb60 None admin] RBAC: Authorizing `identity:get_project(project_id=adc7a18acd23477d80890d7a3477e7c9)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:16.794709 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ce0637-d42f-492d-8ee2-725eeadecb60 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:16.794822 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 215/424] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Sep 9 16:18:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:18:16.795974 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf96d398-7ca1-42d5-b8a5-9dd22ea5c85b None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:16.796262 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf96d398-7ca1-42d5-b8a5-9dd22ea5c85b None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:16.796534 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf96d398-7ca1-42d5-b8a5-9dd22ea5c85b None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:16.797017 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 210/425] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Sep 9 16:18:16 2022] GET /identity/v3/projects/adc7a18acd23477d80890d7a3477e7c9 => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:18:16.798275 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 216/426] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:18:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:18:16.799200 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ce0637-d42f-492d-8ee2-725eeadecb60 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:16.802420 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf96d398-7ca1-42d5-b8a5-9dd22ea5c85b None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:16.813073 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:16.926598 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ce0637-d42f-492d-8ee2-725eeadecb60 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:16.947182 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf96d398-7ca1-42d5-b8a5-9dd22ea5c85b None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:16.963967 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc8a288-cd13-4e1b-a6fb-a2aa1d34a9c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:16.964576 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc8a288-cd13-4e1b-a6fb-a2aa1d34a9c8 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:16.964849 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc8a288-cd13-4e1b-a6fb-a2aa1d34a9c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:16.965128 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc8a288-cd13-4e1b-a6fb-a2aa1d34a9c8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:16.966991 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:16.996489 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd87fcd4-2e75-49de-b492-87323eef04fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:16.997708 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd87fcd4-2e75-49de-b492-87323eef04fe None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:16.998180 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd87fcd4-2e75-49de-b492-87323eef04fe None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:16.998673 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd87fcd4-2e75-49de-b492-87323eef04fe None admin] PATH_INFO: `/v3/groups/352ddc29b15f4e6790e820fc58e9ee68` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:17.000092 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd87fcd4-2e75-49de-b492-87323eef04fe None admin] RBAC: Authorizing `identity:get_group(group_id=352ddc29b15f4e6790e820fc58e9ee68)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:17.001723 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd87fcd4-2e75-49de-b492-87323eef04fe None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:17.005329 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 217/427] 10.222.0.27 () {56 vars in 1180 bytes} [Fri Sep 9 16:18:16 2022] GET /identity/v3/groups/352ddc29b15f4e6790e820fc58e9ee68 => generated 226 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 16:18:17.006790 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4440488a-bfb0-45e9-8f1e-99b999be178e None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:17.007290 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4440488a-bfb0-45e9-8f1e-99b999be178e None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:17.007766 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4440488a-bfb0-45e9-8f1e-99b999be178e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:17.028758 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-4440488a-bfb0-45e9-8f1e-99b999be178e None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:18:17.030795 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-4440488a-bfb0-45e9-8f1e-99b999be178e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:18:17.041575 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc8a288-cd13-4e1b-a6fb-a2aa1d34a9c8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:17.043256 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc8a288-cd13-4e1b-a6fb-a2aa1d34a9c8 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:17.056013 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:17.107130 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 218/428] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:18:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 16:18:17.108351 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4440488a-bfb0-45e9-8f1e-99b999be178e None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:17.203047 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 211/429] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Sep 9 16:18:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 09 16:18:17.204782 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc8a288-cd13-4e1b-a6fb-a2aa1d34a9c8 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:17.223188 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4440488a-bfb0-45e9-8f1e-99b999be178e None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:17.235784 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:17.261565 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb54024-abf4-4a49-a709-5af032aca457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:17.262643 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb54024-abf4-4a49-a709-5af032aca457 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:17.263138 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb54024-abf4-4a49-a709-5af032aca457 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:17.263600 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb54024-abf4-4a49-a709-5af032aca457 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:17.264522 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb54024-abf4-4a49-a709-5af032aca457 None admin] RBAC: Adding query filter params (group.id=352ddc29b15f4e6790e820fc58e9ee68, role.id=b38e84bf077846ee802e6bb1bad83522, scope.project.id=adc7a18acd23477d80890d7a3477e7c9) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:18:17.265018 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb54024-abf4-4a49-a709-5af032aca457 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:17.266670 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb54024-abf4-4a49-a709-5af032aca457 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:17.274916 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 219/430] 10.222.0.27 () {56 vars in 1376 bytes} [Fri Sep 9 16:18:17 2022] GET /identity/v3/role_assignments?group.id=352ddc29b15f4e6790e820fc58e9ee68&scope.project.id=adc7a18acd23477d80890d7a3477e7c9&role.id=b38e84bf077846ee802e6bb1bad83522 => generated 611 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:18:17.390794 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc8a288-cd13-4e1b-a6fb-a2aa1d34a9c8 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:17.403679 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:17.436749 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b9369d-ac00-4c5d-b5f2-a5e4c8b27d12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:17.437401 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b9369d-ac00-4c5d-b5f2-a5e4c8b27d12 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:17.437681 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b9369d-ac00-4c5d-b5f2-a5e4c8b27d12 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:17.437954 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b9369d-ac00-4c5d-b5f2-a5e4c8b27d12 None admin] PATH_INFO: `/v3/projects/adc7a18acd23477d80890d7a3477e7c9` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:17.441201 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b9369d-ac00-4c5d-b5f2-a5e4c8b27d12 None admin] RBAC: Authorizing `identity:get_project(project_id=adc7a18acd23477d80890d7a3477e7c9)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:17.442716 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b9369d-ac00-4c5d-b5f2-a5e4c8b27d12 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:17.444624 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 212/431] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Sep 9 16:18:17 2022] GET /identity/v3/projects/adc7a18acd23477d80890d7a3477e7c9 => generated 298 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 16:18:17.450194 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb54024-abf4-4a49-a709-5af032aca457 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:17.574594 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb54024-abf4-4a49-a709-5af032aca457 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:17.585358 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b9369d-ac00-4c5d-b5f2-a5e4c8b27d12 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:17.611134 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2400c48c-25fd-4474-bc46-84a91b790ed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:17.611774 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2400c48c-25fd-4474-bc46-84a91b790ed7 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:17.612091 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2400c48c-25fd-4474-bc46-84a91b790ed7 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:17.612406 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2400c48c-25fd-4474-bc46-84a91b790ed7 None admin] PATH_INFO: `/v3/groups/352ddc29b15f4e6790e820fc58e9ee68` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:17.613782 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2400c48c-25fd-4474-bc46-84a91b790ed7 None admin] RBAC: Authorizing `identity:get_group(group_id=352ddc29b15f4e6790e820fc58e9ee68)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:17.615240 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2400c48c-25fd-4474-bc46-84a91b790ed7 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:17.617151 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 220/432] 10.222.0.27 () {56 vars in 1180 bytes} [Fri Sep 9 16:18:17 2022] GET /identity/v3/groups/352ddc29b15f4e6790e820fc58e9ee68 => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:18:17.622955 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2400c48c-25fd-4474-bc46-84a91b790ed7 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:17.674349 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:17.716532 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b9369d-ac00-4c5d-b5f2-a5e4c8b27d12 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:17.746536 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2400c48c-25fd-4474-bc46-84a91b790ed7 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:17.760987 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71110737-db42-4f5f-af8f-8f20f2502d3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:17.761866 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71110737-db42-4f5f-af8f-8f20f2502d3b None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:17.762151 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71110737-db42-4f5f-af8f-8f20f2502d3b None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:17.762453 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71110737-db42-4f5f-af8f-8f20f2502d3b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:17.777379 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71110737-db42-4f5f-af8f-8f20f2502d3b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 16:18:17.783528 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-71110737-db42-4f5f-af8f-8f20f2502d3b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 16:18:17.783528 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:18:17.783528 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:18:17.783528 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:18:17.783528 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:18:17.783528 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:18:17.783528 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:18:17.783528 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:18:17.783528 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:18:17.783528 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:18:17.783528 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:18:17.783528 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:18:17.783528 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 16:18:17.783528 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 16:18:17.783528 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 16:18:17.783528 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 16:18:17.784450 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 16:18:17.784450 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 16:18:17.784450 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 16:18:17.784450 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 16:18:17.784450 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:18:17.784450 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:18:17.784450 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:18:17.784450 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:18:17.784450 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:18:17.784450 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:18:17.784450 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:18:17.784450 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 16:18:17.784450 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:18:17.784450 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:18:17.784450 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:18:17.784450 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:18:17.785330 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:18:17.785330 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:18:17.785330 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:18:17.785330 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:18:17.785330 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 16:18:17.785330 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 16:18:17.785330 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 16:18:17.785330 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 16:18:17.785330 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 16:18:17.785330 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 16:18:17.785330 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 16:18:17.785330 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 16:18:17.785330 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 213/433] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Sep 9 16:18:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 16:18:17.792187 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71110737-db42-4f5f-af8f-8f20f2502d3b None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:17.792675 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c549c406-57f8-40fc-a4ec-60fbe401fef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:17.793348 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c549c406-57f8-40fc-a4ec-60fbe401fef0 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:17.793634 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c549c406-57f8-40fc-a4ec-60fbe401fef0 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:17.794012 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c549c406-57f8-40fc-a4ec-60fbe401fef0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:17.794841 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c549c406-57f8-40fc-a4ec-60fbe401fef0 None admin] RBAC: Adding query filter params (group.id=352ddc29b15f4e6790e820fc58e9ee68, role.id=9452afb4ffe54eb7b7b5b0aff7dd00ed, scope.project.id=adc7a18acd23477d80890d7a3477e7c9) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:18:17.795160 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c549c406-57f8-40fc-a4ec-60fbe401fef0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:17.796653 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c549c406-57f8-40fc-a4ec-60fbe401fef0 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:17.813319 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 221/434] 10.222.0.27 () {56 vars in 1376 bytes} [Fri Sep 9 16:18:17 2022] GET /identity/v3/role_assignments?group.id=352ddc29b15f4e6790e820fc58e9ee68&scope.project.id=adc7a18acd23477d80890d7a3477e7c9&role.id=9452afb4ffe54eb7b7b5b0aff7dd00ed => generated 611 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 16:18:17.860634 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:17.910074 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71110737-db42-4f5f-af8f-8f20f2502d3b None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:17.950136 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9f2668-0d8b-4958-b3ea-c252db8964f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:17.951191 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9f2668-0d8b-4958-b3ea-c252db8964f4 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:17.951665 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9f2668-0d8b-4958-b3ea-c252db8964f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:17.952152 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9f2668-0d8b-4958-b3ea-c252db8964f4 None admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:17.953061 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9f2668-0d8b-4958-b3ea-c252db8964f4 None admin] RBAC: Adding query filter params (name=member) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:18:17.953597 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9f2668-0d8b-4958-b3ea-c252db8964f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:17.955306 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9f2668-0d8b-4958-b3ea-c252db8964f4 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:17.967208 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 214/435] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Sep 9 16:18:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:18:17.975499 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c549c406-57f8-40fc-a4ec-60fbe401fef0 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:18.081607 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087d0d7e-8841-47ae-b40d-74c1fd07fc71 None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:18.082016 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087d0d7e-8841-47ae-b40d-74c1fd07fc71 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:18.082247 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087d0d7e-8841-47ae-b40d-74c1fd07fc71 None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:18.083815 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 215/436] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:18:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 16:18:18.089272 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af71130e-8bea-4f71-a764-c5417531da8e None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:18.089553 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af71130e-8bea-4f71-a764-c5417531da8e None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:18.089823 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af71130e-8bea-4f71-a764-c5417531da8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:18.104645 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c549c406-57f8-40fc-a4ec-60fbe401fef0 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:18.113073 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:18.123302 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-af71130e-8bea-4f71-a764-c5417531da8e None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:18:18.124520 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-af71130e-8bea-4f71-a764-c5417531da8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:18:18.150165 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05827e89-8a0e-4067-a974-4406084a58bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:18.151102 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05827e89-8a0e-4067-a974-4406084a58bb None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:18.151413 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05827e89-8a0e-4067-a974-4406084a58bb None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:18.151653 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05827e89-8a0e-4067-a974-4406084a58bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:18.217744 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 216/437] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:18:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 16:18:18.247377 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05827e89-8a0e-4067-a974-4406084a58bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:18.249141 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05827e89-8a0e-4067-a974-4406084a58bb None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:18.363795 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 222/438] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Sep 9 16:18:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 16:18:18.369174 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af71130e-8bea-4f71-a764-c5417531da8e None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:18.403821 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:18.457032 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e508dcd7-5f8d-47d6-a77e-aadac92dbaeb None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:18.457597 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e508dcd7-5f8d-47d6-a77e-aadac92dbaeb None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:18.457866 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e508dcd7-5f8d-47d6-a77e-aadac92dbaeb None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:18.459230 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 223/439] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:18:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 16:18:18.467705 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b4623c-1d5f-47ad-953f-37b7817ed1f7 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:18.467971 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b4623c-1d5f-47ad-953f-37b7817ed1f7 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:18.468237 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b4623c-1d5f-47ad-953f-37b7817ed1f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:18.481868 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:18.488291 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af71130e-8bea-4f71-a764-c5417531da8e None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:18.488599 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-47b4623c-1d5f-47ad-953f-37b7817ed1f7 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:18:18.489766 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-47b4623c-1d5f-47ad-953f-37b7817ed1f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:18:18.522772 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752136bd-a874-4f48-ab0d-7e95ab7971b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:18.523403 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752136bd-a874-4f48-ab0d-7e95ab7971b9 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:18.523681 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752136bd-a874-4f48-ab0d-7e95ab7971b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:18.523953 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752136bd-a874-4f48-ab0d-7e95ab7971b9 None admin] PATH_INFO: `/v3/projects/b42bed1e233c4e71a1ec8ca3ae42c433` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:18.525058 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752136bd-a874-4f48-ab0d-7e95ab7971b9 None admin] RBAC: Authorizing `identity:get_project(project_id=b42bed1e233c4e71a1ec8ca3ae42c433)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:18.526527 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752136bd-a874-4f48-ab0d-7e95ab7971b9 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:18.528144 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 217/440] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Sep 9 16:18:18 2022] GET /identity/v3/projects/b42bed1e233c4e71a1ec8ca3ae42c433 => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:18:18.528959 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752136bd-a874-4f48-ab0d-7e95ab7971b9 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:18.555984 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 224/441] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:18:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 16:18:18.555984 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b4623c-1d5f-47ad-953f-37b7817ed1f7 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:18.642160 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:18.647087 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752136bd-a874-4f48-ab0d-7e95ab7971b9 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:18.665919 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b4623c-1d5f-47ad-953f-37b7817ed1f7 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:18.682750 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caf4f39-e649-48b3-8a84-8ee2c19fe965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:18.683369 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caf4f39-e649-48b3-8a84-8ee2c19fe965 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:18.683650 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caf4f39-e649-48b3-8a84-8ee2c19fe965 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:18.683916 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caf4f39-e649-48b3-8a84-8ee2c19fe965 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:18.694971 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5caf4f39-e649-48b3-8a84-8ee2c19fe965 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 16:18:18.700011 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-5caf4f39-e649-48b3-8a84-8ee2c19fe965 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 16:18:18.700011 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:18:18.700011 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:18:18.700011 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:18:18.700011 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:18:18.700011 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:18:18.700011 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:18:18.700011 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:18:18.700011 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:18:18.700011 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:18:18.700011 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:18:18.700011 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:18:18.700011 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 16:18:18.700011 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 16:18:18.700011 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 16:18:18.700011 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 16:18:18.700912 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 16:18:18.700912 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 16:18:18.700912 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 16:18:18.700912 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 16:18:18.700912 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:18:18.700912 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:18:18.700912 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:18:18.700912 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:18:18.700912 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:18:18.700912 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:18:18.700912 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:18:18.700912 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 16:18:18.700912 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:18:18.700912 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:18:18.700912 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:18:18.700912 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:18:18.702571 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:18:18.702571 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:18:18.702571 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:18:18.702571 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:18:18.702571 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 16:18:18.702571 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 16:18:18.702571 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 16:18:18.702571 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 16:18:18.702571 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 16:18:18.702571 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 16:18:18.702571 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 16:18:18.702571 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 16:18:18.702571 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 218/442] 10.222.0.27 () {56 vars in 1114 bytes} [Fri Sep 9 16:18:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:18:18.705132 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6558fa78-c211-4b3b-8415-df7db8285642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:18.705926 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6558fa78-c211-4b3b-8415-df7db8285642 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:18.706189 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6558fa78-c211-4b3b-8415-df7db8285642 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:18.706492 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6558fa78-c211-4b3b-8415-df7db8285642 None admin] PATH_INFO: `/v3/groups/352ddc29b15f4e6790e820fc58e9ee68` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:18.707372 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caf4f39-e649-48b3-8a84-8ee2c19fe965 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:18.708921 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6558fa78-c211-4b3b-8415-df7db8285642 None admin] RBAC: Authorizing `identity:get_group(group_id=352ddc29b15f4e6790e820fc58e9ee68)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:18.710499 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6558fa78-c211-4b3b-8415-df7db8285642 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:18.716993 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 225/443] 10.222.0.27 () {56 vars in 1180 bytes} [Fri Sep 9 16:18:18 2022] GET /identity/v3/groups/352ddc29b15f4e6790e820fc58e9ee68 => generated 226 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:18:18.717802 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6558fa78-c211-4b3b-8415-df7db8285642 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:18.722031 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:18.808885 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caf4f39-e649-48b3-8a84-8ee2c19fe965 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:18.825584 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6558fa78-c211-4b3b-8415-df7db8285642 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:18.842690 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4244be-99ae-4364-a762-784fbd1edb04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:18.843291 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4244be-99ae-4364-a762-784fbd1edb04 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:18.843567 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4244be-99ae-4364-a762-784fbd1edb04 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:18.843840 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4244be-99ae-4364-a762-784fbd1edb04 None admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:18.844484 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4244be-99ae-4364-a762-784fbd1edb04 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:18:18.844791 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4244be-99ae-4364-a762-784fbd1edb04 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:18.846159 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4244be-99ae-4364-a762-784fbd1edb04 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:18.853767 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 219/444] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Sep 9 16:18:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 16:18:18.854562 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4244be-99ae-4364-a762-784fbd1edb04 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:18.860379 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ef0181-1b91-44ae-9a64-18408ebbbc7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:18.860986 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ef0181-1b91-44ae-9a64-18408ebbbc7e None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:18.861268 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ef0181-1b91-44ae-9a64-18408ebbbc7e None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:18.861539 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ef0181-1b91-44ae-9a64-18408ebbbc7e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:18.862785 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ef0181-1b91-44ae-9a64-18408ebbbc7e None admin] RBAC: Adding query filter params (group.id=352ddc29b15f4e6790e820fc58e9ee68, role.id=b38e84bf077846ee802e6bb1bad83522, scope.project.id=b42bed1e233c4e71a1ec8ca3ae42c433) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:18:18.863107 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ef0181-1b91-44ae-9a64-18408ebbbc7e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:18.864965 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ef0181-1b91-44ae-9a64-18408ebbbc7e None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:18.871624 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 226/445] 10.222.0.27 () {56 vars in 1376 bytes} [Fri Sep 9 16:18:18 2022] GET /identity/v3/role_assignments?group.id=352ddc29b15f4e6790e820fc58e9ee68&scope.project.id=b42bed1e233c4e71a1ec8ca3ae42c433&role.id=b38e84bf077846ee802e6bb1bad83522 => generated 611 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:18:18.872394 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ef0181-1b91-44ae-9a64-18408ebbbc7e None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:18.876684 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:18.952291 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:18.972634 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4244be-99ae-4364-a762-784fbd1edb04 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:18.995688 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ef0181-1b91-44ae-9a64-18408ebbbc7e None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:19.010104 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6f9400-7057-4215-98e1-1b3147587b70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:19.010833 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6f9400-7057-4215-98e1-1b3147587b70 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:19.011113 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6f9400-7057-4215-98e1-1b3147587b70 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:19.011386 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6f9400-7057-4215-98e1-1b3147587b70 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:19.023392 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6f9400-7057-4215-98e1-1b3147587b70 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 16:18:19.028821 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-1f6f9400-7057-4215-98e1-1b3147587b70 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 16:18:19.028821 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:18:19.028821 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:18:19.028821 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:18:19.028821 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:18:19.028821 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:18:19.028821 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:18:19.028821 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:18:19.028821 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:18:19.028821 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:18:19.028821 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:18:19.028821 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:18:19.028821 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 16:18:19.028821 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 16:18:19.028821 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 16:18:19.028821 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 16:18:19.029768 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 16:18:19.029768 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 16:18:19.029768 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 16:18:19.029768 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 16:18:19.029768 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:18:19.029768 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:18:19.029768 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:18:19.029768 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:18:19.029768 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:18:19.029768 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:18:19.029768 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:18:19.029768 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 16:18:19.029768 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:18:19.029768 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:18:19.029768 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:18:19.029768 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:18:19.030622 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:18:19.030622 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:18:19.030622 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:18:19.030622 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:18:19.030622 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 16:18:19.030622 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 16:18:19.030622 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 16:18:19.030622 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 16:18:19.030622 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 16:18:19.030622 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 16:18:19.030622 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 16:18:19.030622 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 16:18:19.030622 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 220/446] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Sep 9 16:18:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:18:19.036257 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6f9400-7057-4215-98e1-1b3147587b70 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:19.045517 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e5ac42-1b4c-4dbf-a0d2-bb8e48584661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:19.046128 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e5ac42-1b4c-4dbf-a0d2-bb8e48584661 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:19.046437 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e5ac42-1b4c-4dbf-a0d2-bb8e48584661 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:19.046705 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e5ac42-1b4c-4dbf-a0d2-bb8e48584661 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:19.129939 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e5ac42-1b4c-4dbf-a0d2-bb8e48584661 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:19.131398 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e5ac42-1b4c-4dbf-a0d2-bb8e48584661 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:19.132439 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:19.152996 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6f9400-7057-4215-98e1-1b3147587b70 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:19.195654 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a0b901-994b-433c-ad2c-c06880685c8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:19.196259 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a0b901-994b-433c-ad2c-c06880685c8e None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:19.196541 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a0b901-994b-433c-ad2c-c06880685c8e None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:19.196813 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a0b901-994b-433c-ad2c-c06880685c8e None admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:19.197469 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a0b901-994b-433c-ad2c-c06880685c8e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:18:19.197770 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a0b901-994b-433c-ad2c-c06880685c8e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:19.199197 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a0b901-994b-433c-ad2c-c06880685c8e None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:19.210427 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 221/447] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Sep 9 16:18:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 16:18:19.210594 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:19.214128 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a0b901-994b-433c-ad2c-c06880685c8e None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:19.252189 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 227/448] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Sep 9 16:18:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 16:18:19.257500 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e5ac42-1b4c-4dbf-a0d2-bb8e48584661 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:19.320599 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a0b901-994b-433c-ad2c-c06880685c8e None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:19.356429 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f3806b-811d-452f-8bec-ac0812b8ef89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:19.357033 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f3806b-811d-452f-8bec-ac0812b8ef89 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:19.357309 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f3806b-811d-452f-8bec-ac0812b8ef89 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:19.357580 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f3806b-811d-452f-8bec-ac0812b8ef89 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:19.357667 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e5ac42-1b4c-4dbf-a0d2-bb8e48584661 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:19.370024 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:19.391711 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49d01eb-f90f-49d4-aad6-60b8bcc99a45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:19.392328 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49d01eb-f90f-49d4-aad6-60b8bcc99a45 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:19.392606 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49d01eb-f90f-49d4-aad6-60b8bcc99a45 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:19.392879 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49d01eb-f90f-49d4-aad6-60b8bcc99a45 None admin] PATH_INFO: `/v3/projects/b42bed1e233c4e71a1ec8ca3ae42c433` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:19.394525 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49d01eb-f90f-49d4-aad6-60b8bcc99a45 None admin] RBAC: Authorizing `identity:get_project(project_id=b42bed1e233c4e71a1ec8ca3ae42c433)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:19.395983 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49d01eb-f90f-49d4-aad6-60b8bcc99a45 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:19.397594 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 228/449] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Sep 9 16:18:19 2022] GET /identity/v3/projects/b42bed1e233c4e71a1ec8ca3ae42c433 => generated 302 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 16:18:19.403014 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49d01eb-f90f-49d4-aad6-60b8bcc99a45 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:19.424971 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f3806b-811d-452f-8bec-ac0812b8ef89 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:19.426464 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f3806b-811d-452f-8bec-ac0812b8ef89 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:19.437307 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:19.502557 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49d01eb-f90f-49d4-aad6-60b8bcc99a45 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:19.526180 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 222/450] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Sep 9 16:18:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 16:18:19.531791 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f3806b-811d-452f-8bec-ac0812b8ef89 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:19.541321 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af5d31b-0abf-46a2-9622-f561a8e41f09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:19.542017 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af5d31b-0abf-46a2-9622-f561a8e41f09 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:19.542349 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af5d31b-0abf-46a2-9622-f561a8e41f09 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:19.542621 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af5d31b-0abf-46a2-9622-f561a8e41f09 None admin] PATH_INFO: `/v3/groups/352ddc29b15f4e6790e820fc58e9ee68` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:19.543726 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af5d31b-0abf-46a2-9622-f561a8e41f09 None admin] RBAC: Authorizing `identity:get_group(group_id=352ddc29b15f4e6790e820fc58e9ee68)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:19.545156 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af5d31b-0abf-46a2-9622-f561a8e41f09 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:19.546730 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 229/451] 10.222.0.27 () {56 vars in 1180 bytes} [Fri Sep 9 16:18:19 2022] GET /identity/v3/groups/352ddc29b15f4e6790e820fc58e9ee68 => generated 226 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 16:18:19.552357 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af5d31b-0abf-46a2-9622-f561a8e41f09 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:19.572271 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:19.627479 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f3806b-811d-452f-8bec-ac0812b8ef89 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:19.648659 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af5d31b-0abf-46a2-9622-f561a8e41f09 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:19.650942 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:19.660623 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448309c2-8a2a-478a-b935-8884db13d20d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:19.661253 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448309c2-8a2a-478a-b935-8884db13d20d None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:19.661531 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448309c2-8a2a-478a-b935-8884db13d20d None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:19.661803 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448309c2-8a2a-478a-b935-8884db13d20d None admin] PATH_INFO: `/v3/projects/5e37a1d93b9b4afb9e8aecb24b733b95` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:19.662910 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448309c2-8a2a-478a-b935-8884db13d20d None admin] RBAC: Authorizing `identity:get_project(project_id=5e37a1d93b9b4afb9e8aecb24b733b95)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:19.664359 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448309c2-8a2a-478a-b935-8884db13d20d None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:19.670452 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 223/452] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Sep 9 16:18:19 2022] GET /identity/v3/projects/5e37a1d93b9b4afb9e8aecb24b733b95 => generated 344 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 16:18:19.671981 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448309c2-8a2a-478a-b935-8884db13d20d None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:19.684395 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e0960f-1525-46c6-86e8-25da7b43043b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:19.684983 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e0960f-1525-46c6-86e8-25da7b43043b None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:19.685255 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e0960f-1525-46c6-86e8-25da7b43043b None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:19.685518 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e0960f-1525-46c6-86e8-25da7b43043b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:19.686220 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e0960f-1525-46c6-86e8-25da7b43043b None admin] RBAC: Adding query filter params (group.id=352ddc29b15f4e6790e820fc58e9ee68, role.id=9452afb4ffe54eb7b7b5b0aff7dd00ed, scope.project.id=b42bed1e233c4e71a1ec8ca3ae42c433) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:18:19.686554 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e0960f-1525-46c6-86e8-25da7b43043b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:19.687958 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e0960f-1525-46c6-86e8-25da7b43043b None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:19.693470 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 230/453] 10.222.0.27 () {56 vars in 1376 bytes} [Fri Sep 9 16:18:19 2022] GET /identity/v3/role_assignments?group.id=352ddc29b15f4e6790e820fc58e9ee68&scope.project.id=b42bed1e233c4e71a1ec8ca3ae42c433&role.id=9452afb4ffe54eb7b7b5b0aff7dd00ed => generated 611 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 16:18:19.781488 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448309c2-8a2a-478a-b935-8884db13d20d None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:19.793131 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:19.818508 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7000cefb-c059-43e9-b53d-f281189edf49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:19.819200 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7000cefb-c059-43e9-b53d-f281189edf49 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:19.819427 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7000cefb-c059-43e9-b53d-f281189edf49 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:19.819699 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7000cefb-c059-43e9-b53d-f281189edf49 None admin] PATH_INFO: `/v3/groups/485f45f5006b4a17a2a2f7550eff0b10` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:19.820864 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7000cefb-c059-43e9-b53d-f281189edf49 None admin] RBAC: Authorizing `identity:get_group(group_id=485f45f5006b4a17a2a2f7550eff0b10)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:19.822361 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7000cefb-c059-43e9-b53d-f281189edf49 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:19.823935 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 224/454] 10.222.0.27 () {56 vars in 1180 bytes} [Fri Sep 9 16:18:19 2022] GET /identity/v3/groups/485f45f5006b4a17a2a2f7550eff0b10 => generated 229 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:18:19.830051 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e0960f-1525-46c6-86e8-25da7b43043b None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:19.929148 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e0960f-1525-46c6-86e8-25da7b43043b None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:19.962533 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1788a0-c960-47d7-8545-d07d6c7fc629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:19.963126 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1788a0-c960-47d7-8545-d07d6c7fc629 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:19.963404 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1788a0-c960-47d7-8545-d07d6c7fc629 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:19.963669 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1788a0-c960-47d7-8545-d07d6c7fc629 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:19.964371 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1788a0-c960-47d7-8545-d07d6c7fc629 None admin] RBAC: Adding query filter params (group.id=485f45f5006b4a17a2a2f7550eff0b10, role.id=0a36d1be416f4089be19be979943b731, scope.project.id=5e37a1d93b9b4afb9e8aecb24b733b95) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:18:19.964674 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1788a0-c960-47d7-8545-d07d6c7fc629 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:19.966091 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1788a0-c960-47d7-8545-d07d6c7fc629 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:19.972061 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 231/455] 10.222.0.27 () {56 vars in 1376 bytes} [Fri Sep 9 16:18:19 2022] GET /identity/v3/role_assignments?group.id=485f45f5006b4a17a2a2f7550eff0b10&scope.project.id=5e37a1d93b9b4afb9e8aecb24b733b95&role.id=0a36d1be416f4089be19be979943b731 => generated 611 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 16:18:22.678085 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643120ca-e5f3-4ea5-8a2e-74b801fe8735 None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:22.678623 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643120ca-e5f3-4ea5-8a2e-74b801fe8735 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:22.678726 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643120ca-e5f3-4ea5-8a2e-74b801fe8735 None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:22.680309 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 225/456] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:18:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:18:22.686650 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e14397-1ef5-4495-956e-f5dd59587293 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:22.687554 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e14397-1ef5-4495-956e-f5dd59587293 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:22.688021 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e14397-1ef5-4495-956e-f5dd59587293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:22.710823 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-e1e14397-1ef5-4495-956e-f5dd59587293 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:18:22.717646 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-e1e14397-1ef5-4495-956e-f5dd59587293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:18:22.749141 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:22.811368 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 232/457] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:18:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 16:18:22.821489 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4689594f-14ab-4c2a-9781-9728925d6f03 None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:22.821831 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4689594f-14ab-4c2a-9781-9728925d6f03 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:22.822105 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4689594f-14ab-4c2a-9781-9728925d6f03 None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:22.824808 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 226/458] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:18:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:18:22.829186 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fa3bf9-57d3-4a9d-bef5-d3f424aabd4b None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:22.829476 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fa3bf9-57d3-4a9d-bef5-d3f424aabd4b None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:22.829753 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fa3bf9-57d3-4a9d-bef5-d3f424aabd4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:22.856165 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-92fa3bf9-57d3-4a9d-bef5-d3f424aabd4b None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:18:22.857357 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-92fa3bf9-57d3-4a9d-bef5-d3f424aabd4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:18:22.957041 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 233/459] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:18:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 16:18:23.167078 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4689594f-14ab-4c2a-9781-9728925d6f03 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:23.190524 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259fb01d-acf8-4494-a553-afe5af0f9bc6 None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:23.190990 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259fb01d-acf8-4494-a553-afe5af0f9bc6 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:23.191159 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259fb01d-acf8-4494-a553-afe5af0f9bc6 None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:23.192765 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 234/460] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:18:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:18:23.197979 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e9cdf0-b886-4dae-886a-8b3e439eaf78 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:23.198261 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e9cdf0-b886-4dae-886a-8b3e439eaf78 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:23.198569 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e9cdf0-b886-4dae-886a-8b3e439eaf78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:23.229995 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-f2e9cdf0-b886-4dae-886a-8b3e439eaf78 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:18:23.231169 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-f2e9cdf0-b886-4dae-886a-8b3e439eaf78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:18:23.315615 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4689594f-14ab-4c2a-9781-9728925d6f03 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:23.334417 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 235/461] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:18:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 16:18:23.336300 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eddb14d-ed37-468e-850b-eaf34e03089c None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:23.336782 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eddb14d-ed37-468e-850b-eaf34e03089c None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:23.337298 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eddb14d-ed37-468e-850b-eaf34e03089c None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:23.339822 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 236/462] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:18:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:18:23.345788 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47539fc6-811e-4f61-b27a-05ccc3342f4e None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:23.346615 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47539fc6-811e-4f61-b27a-05ccc3342f4e None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:23.347626 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47539fc6-811e-4f61-b27a-05ccc3342f4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:23.353487 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e20dff-10ef-40a9-93f8-e2c4101692e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:23.354118 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e20dff-10ef-40a9-93f8-e2c4101692e8 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:23.354429 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e20dff-10ef-40a9-93f8-e2c4101692e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:23.354689 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e20dff-10ef-40a9-93f8-e2c4101692e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:23.370696 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e20dff-10ef-40a9-93f8-e2c4101692e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:23.371931 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e20dff-10ef-40a9-93f8-e2c4101692e8 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:23.379998 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-47539fc6-811e-4f61-b27a-05ccc3342f4e None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:18:23.381431 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-47539fc6-811e-4f61-b27a-05ccc3342f4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:18:23.392360 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-05e20dff-10ef-40a9-93f8-e2c4101692e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 16:18:23.392360 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:18:23.392360 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:18:23.392360 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:18:23.392360 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:18:23.392360 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:18:23.392360 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:18:23.392360 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:18:23.392360 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:18:23.392360 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:18:23.392360 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:18:23.392360 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:18:23.392360 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 16:18:23.392360 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 16:18:23.392360 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 16:18:23.392360 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 16:18:23.393286 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:18:23.393286 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:18:23.393286 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:18:23.393286 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:18:23.393286 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:18:23.393286 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:18:23.393286 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:18:23.393286 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 16:18:23.393286 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:18:23.393286 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:18:23.393286 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:18:23.393286 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:18:23.393286 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:18:23.393286 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:18:23.393286 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:18:23.393286 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:18:23.393286 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 16:18:23.399398 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 16:18:23.399398 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 16:18:23.399398 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 16:18:23.399398 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 227/463] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 16:18:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:18:23.399398 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e20dff-10ef-40a9-93f8-e2c4101692e8 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:23.407958 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:23.434360 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:23.472272 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 237/464] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:18:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 16:18:23.486425 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47539fc6-811e-4f61-b27a-05ccc3342f4e None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:23.553830 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e20dff-10ef-40a9-93f8-e2c4101692e8 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:23.598333 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47539fc6-811e-4f61-b27a-05ccc3342f4e None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:23.616904 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7d6877-10d5-4be0-a230-e4dc2beb6c4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:23.617549 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7d6877-10d5-4be0-a230-e4dc2beb6c4a None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:23.617829 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7d6877-10d5-4be0-a230-e4dc2beb6c4a None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:23.618100 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7d6877-10d5-4be0-a230-e4dc2beb6c4a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:23.629777 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7d6877-10d5-4be0-a230-e4dc2beb6c4a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:23.630028 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7150c1f1-c5b0-43ae-a77e-d58baa15c31c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:23.630709 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7150c1f1-c5b0-43ae-a77e-d58baa15c31c None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:23.630988 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7150c1f1-c5b0-43ae-a77e-d58baa15c31c None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:23.631254 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7150c1f1-c5b0-43ae-a77e-d58baa15c31c None admin] PATH_INFO: `/v3/domains` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:23.631371 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7d6877-10d5-4be0-a230-e4dc2beb6c4a None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:23.631882 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7150c1f1-c5b0-43ae-a77e-d58baa15c31c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:18:23.632181 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7150c1f1-c5b0-43ae-a77e-d58baa15c31c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:23.633748 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7150c1f1-c5b0-43ae-a77e-d58baa15c31c None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:23.646478 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-8d7d6877-10d5-4be0-a230-e4dc2beb6c4a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 16:18:23.646478 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:18:23.646478 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:18:23.646478 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:18:23.646478 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:18:23.646478 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:18:23.646478 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:18:23.646478 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:18:23.646478 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:18:23.646478 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:18:23.646478 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:18:23.646478 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:18:23.646478 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 16:18:23.646478 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 16:18:23.646478 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 16:18:23.646478 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 16:18:23.647390 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:18:23.647390 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:18:23.647390 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:18:23.647390 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:18:23.647390 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:18:23.647390 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:18:23.647390 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:18:23.647390 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 16:18:23.647390 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:18:23.647390 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:18:23.647390 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:18:23.647390 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:18:23.647390 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:18:23.647390 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:18:23.647390 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:18:23.647390 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:18:23.647390 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 16:18:23.648539 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 16:18:23.648539 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 16:18:23.648539 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 16:18:23.648539 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 228/465] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 16:18:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:18:23.648748 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7d6877-10d5-4be0-a230-e4dc2beb6c4a None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:23.654653 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 238/466] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Sep 9 16:18:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:18:23.655727 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7150c1f1-c5b0-43ae-a77e-d58baa15c31c None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:23.672358 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:23.742588 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:23.764544 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7d6877-10d5-4be0-a230-e4dc2beb6c4a None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:23.774260 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7150c1f1-c5b0-43ae-a77e-d58baa15c31c None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:23.801282 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0c9218-c1df-4012-bc4f-a39bea0500dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:23.802154 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0c9218-c1df-4012-bc4f-a39bea0500dd None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:23.802701 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0c9218-c1df-4012-bc4f-a39bea0500dd None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:23.803120 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0c9218-c1df-4012-bc4f-a39bea0500dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:23.812444 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5e6142-f8c2-41cd-b49b-cae5d69cb697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:23.813442 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5e6142-f8c2-41cd-b49b-cae5d69cb697 None admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:23.813728 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5e6142-f8c2-41cd-b49b-cae5d69cb697 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:23.814002 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5e6142-f8c2-41cd-b49b-cae5d69cb697 None admin] PATH_INFO: `/v3/users` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:23.814958 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5e6142-f8c2-41cd-b49b-cae5d69cb697 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:23.816241 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0c9218-c1df-4012-bc4f-a39bea0500dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:23.816928 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5e6142-f8c2-41cd-b49b-cae5d69cb697 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:23.818013 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0c9218-c1df-4012-bc4f-a39bea0500dd None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:23.835015 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-2a0c9218-c1df-4012-bc4f-a39bea0500dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 16:18:23.835015 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:18:23.835015 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:18:23.835015 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:18:23.835015 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:18:23.835015 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:18:23.835015 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:18:23.835015 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:18:23.835015 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:18:23.835015 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:18:23.835015 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:18:23.835015 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:18:23.835015 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 16:18:23.835015 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 16:18:23.835015 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 16:18:23.835015 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 16:18:23.836052 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:18:23.836052 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:18:23.836052 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:18:23.836052 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:18:23.836052 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:18:23.836052 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:18:23.836052 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:18:23.836052 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 16:18:23.836052 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:18:23.836052 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:18:23.836052 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:18:23.836052 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:18:23.836052 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:18:23.836052 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:18:23.836052 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:18:23.836052 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:18:23.836052 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 16:18:23.836916 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 16:18:23.836916 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 16:18:23.836916 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 16:18:23.844371 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 239/467] 10.222.0.27 () {60 vars in 1132 bytes} [Fri Sep 9 16:18:23 2022] POST /identity/v3/users => generated 246 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:18:23.844993 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 229/468] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 16:18:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:18:23.845485 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5e6142-f8c2-41cd-b49b-cae5d69cb697 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:23.847348 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0c9218-c1df-4012-bc4f-a39bea0500dd None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:23.935611 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:23.976262 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0c9218-c1df-4012-bc4f-a39bea0500dd None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:23.979328 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5e6142-f8c2-41cd-b49b-cae5d69cb697 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:24.022935 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b317c22-5802-4408-a21b-be0e779380f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:24.023276 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6073117-0779-4026-9f3f-6ed78022c6cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:24.023882 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6073117-0779-4026-9f3f-6ed78022c6cb None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:24.024159 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6073117-0779-4026-9f3f-6ed78022c6cb None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:24.024426 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6073117-0779-4026-9f3f-6ed78022c6cb None admin] PATH_INFO: `/v3/domains` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:24.024908 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b317c22-5802-4408-a21b-be0e779380f8 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:24.025082 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6073117-0779-4026-9f3f-6ed78022c6cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:18:24.025379 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6073117-0779-4026-9f3f-6ed78022c6cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:24.025744 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b317c22-5802-4408-a21b-be0e779380f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:24.026247 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b317c22-5802-4408-a21b-be0e779380f8 None admin] PATH_INFO: `/v3/domains` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:24.027167 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b317c22-5802-4408-a21b-be0e779380f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:18:24.027691 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b317c22-5802-4408-a21b-be0e779380f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:24.027792 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6073117-0779-4026-9f3f-6ed78022c6cb None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:24.029456 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b317c22-5802-4408-a21b-be0e779380f8 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:24.030867 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:24.051403 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 230/470] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Sep 9 16:18:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:18:24.051403 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6073117-0779-4026-9f3f-6ed78022c6cb None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:24.051821 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 240/470] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Sep 9 16:18:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:18:24.052886 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b317c22-5802-4408-a21b-be0e779380f8 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:24.168060 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6073117-0779-4026-9f3f-6ed78022c6cb None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:24.173768 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b317c22-5802-4408-a21b-be0e779380f8 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:24.203637 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:24.204587 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d283c4a5-9eaa-4610-8584-aac05c2fbc56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:24.205198 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d283c4a5-9eaa-4610-8584-aac05c2fbc56 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:24.205594 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d283c4a5-9eaa-4610-8584-aac05c2fbc56 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:24.205752 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d283c4a5-9eaa-4610-8584-aac05c2fbc56 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:24.213212 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0c244c-690e-4c38-9d40-e2612582c3ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:24.213815 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0c244c-690e-4c38-9d40-e2612582c3ac None admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:24.214497 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0c244c-690e-4c38-9d40-e2612582c3ac None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:24.214775 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0c244c-690e-4c38-9d40-e2612582c3ac None admin] PATH_INFO: `/v3/users` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:24.215426 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0c244c-690e-4c38-9d40-e2612582c3ac None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:24.215961 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d283c4a5-9eaa-4610-8584-aac05c2fbc56 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:24.216852 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0c244c-690e-4c38-9d40-e2612582c3ac None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:24.217405 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d283c4a5-9eaa-4610-8584-aac05c2fbc56 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:24.232307 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-d283c4a5-9eaa-4610-8584-aac05c2fbc56 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 16:18:24.232307 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:18:24.232307 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:18:24.232307 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:18:24.232307 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:18:24.232307 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:18:24.232307 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:18:24.232307 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:18:24.232307 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:18:24.232307 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:18:24.232307 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:18:24.232307 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:18:24.232307 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 16:18:24.232307 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 16:18:24.232307 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 16:18:24.232307 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 16:18:24.233257 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:18:24.233257 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:18:24.233257 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:18:24.233257 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:18:24.233257 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:18:24.233257 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:18:24.233257 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:18:24.233257 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 16:18:24.233257 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:18:24.233257 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:18:24.233257 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:18:24.233257 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:18:24.233257 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:18:24.233257 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:18:24.233257 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:18:24.233257 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:18:24.233257 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 16:18:24.234081 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 16:18:24.234081 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 16:18:24.234081 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 16:18:24.234081 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 231/471] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 16:18:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:18:24.234340 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d283c4a5-9eaa-4610-8584-aac05c2fbc56 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:24.243991 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 241/472] 10.222.0.27 () {60 vars in 1132 bytes} [Fri Sep 9 16:18:24 2022] POST /identity/v3/users => generated 248 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:18:24.245587 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faabb92-0ab2-4042-ab2d-0072d2f3dbbd None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:24.246068 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faabb92-0ab2-4042-ab2d-0072d2f3dbbd None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:24.246581 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faabb92-0ab2-4042-ab2d-0072d2f3dbbd None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:24.248190 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 242/473] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:18:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:18:24.254327 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faabb92-0ab2-4042-ab2d-0072d2f3dbbd None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:24.291477 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:24.376053 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d283c4a5-9eaa-4610-8584-aac05c2fbc56 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:24.396293 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faabb92-0ab2-4042-ab2d-0072d2f3dbbd None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:24.426863 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035566f8-d22c-475f-ac99-50f35dcc0241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:24.428208 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035566f8-d22c-475f-ac99-50f35dcc0241 None admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:24.428801 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035566f8-d22c-475f-ac99-50f35dcc0241 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:24.429311 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035566f8-d22c-475f-ac99-50f35dcc0241 None admin] PATH_INFO: `/v3/users` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:24.430390 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035566f8-d22c-475f-ac99-50f35dcc0241 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:24.432725 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035566f8-d22c-475f-ac99-50f35dcc0241 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:24.440570 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4524db-23ca-446a-a364-61681b3e65ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:24.441337 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4524db-23ca-446a-a364-61681b3e65ea None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:24.441704 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4524db-23ca-446a-a364-61681b3e65ea None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:24.442101 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4524db-23ca-446a-a364-61681b3e65ea None admin] PATH_INFO: `/v3/domains` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:24.442865 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4524db-23ca-446a-a364-61681b3e65ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:18:24.443326 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4524db-23ca-446a-a364-61681b3e65ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:24.444793 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4524db-23ca-446a-a364-61681b3e65ea None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:24.461210 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 243/474] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Sep 9 16:18:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:18:24.462667 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae68bfb-8ed5-48dd-9a0f-189d0bc8dcab None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:24.463080 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae68bfb-8ed5-48dd-9a0f-189d0bc8dcab None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:24.463443 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae68bfb-8ed5-48dd-9a0f-189d0bc8dcab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:24.463921 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 232/475] 10.222.0.27 () {60 vars in 1132 bytes} [Fri Sep 9 16:18:24 2022] POST /identity/v3/users => generated 248 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:18:24.466899 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035566f8-d22c-475f-ac99-50f35dcc0241 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:24.496228 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-4ae68bfb-8ed5-48dd-9a0f-189d0bc8dcab None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:18:24.497824 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-4ae68bfb-8ed5-48dd-9a0f-189d0bc8dcab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:18:24.547504 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:24.588021 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 244/476] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:18:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 16:18:24.600048 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035566f8-d22c-475f-ac99-50f35dcc0241 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:24.601713 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:24.651665 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b317569c-6a95-4228-9f8d-cc84bb510615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:24.652533 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b317569c-6a95-4228-9f8d-cc84bb510615 None admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:24.652951 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b317569c-6a95-4228-9f8d-cc84bb510615 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:24.653359 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b317569c-6a95-4228-9f8d-cc84bb510615 None admin] PATH_INFO: `/v3/users` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:24.654147 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b317569c-6a95-4228-9f8d-cc84bb510615 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:24.655799 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b317569c-6a95-4228-9f8d-cc84bb510615 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:24.681564 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 233/477] 10.222.0.27 () {60 vars in 1132 bytes} [Fri Sep 9 16:18:24 2022] POST /identity/v3/users => generated 249 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 16:18:24.881485 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae68bfb-8ed5-48dd-9a0f-189d0bc8dcab None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:25.003665 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae68bfb-8ed5-48dd-9a0f-189d0bc8dcab None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:25.042054 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21269b9c-843b-489c-8e81-c8ff4f4ece69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:25.042700 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21269b9c-843b-489c-8e81-c8ff4f4ece69 None admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:25.042972 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21269b9c-843b-489c-8e81-c8ff4f4ece69 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:25.043236 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21269b9c-843b-489c-8e81-c8ff4f4ece69 None admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:25.043890 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21269b9c-843b-489c-8e81-c8ff4f4ece69 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:25.045247 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21269b9c-843b-489c-8e81-c8ff4f4ece69 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:25.058806 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.sql.core [None req-21269b9c-843b-489c-8e81-c8ff4f4ece69 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 09 16:18:25.058806 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 09 16:18:25.058806 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [parameters: {'id': 'c417ac5ba9e24be7ba11a4096e1fc416', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 09 16:18:25.058806 dv-cinder-831247-27-smb devstack@keystone.service[81446]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81446) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 09 16:18:25.075787 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-21269b9c-843b-489c-8e81-c8ff4f4ece69 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 09 16:18:25.075787 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:18:25.075787 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 09 16:18:25.075787 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 09 16:18:25.075787 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 09 16:18:25.075787 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 09 16:18:25.075787 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 09 16:18:25.075787 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application result = self._query(query) Sep 09 16:18:25.075787 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 09 16:18:25.075787 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application conn.query(q) Sep 09 16:18:25.075787 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 09 16:18:25.075787 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 09 16:18:25.075787 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 09 16:18:25.075787 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application result.read() Sep 09 16:18:25.075787 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 09 16:18:25.076666 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 09 16:18:25.076666 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 09 16:18:25.076666 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 09 16:18:25.076666 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 09 16:18:25.076666 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 09 16:18:25.076666 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 09 16:18:25.076666 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 09 16:18:25.076666 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 09 16:18:25.076666 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:18:25.076666 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 09 16:18:25.076666 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:18:25.076666 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:18:25.076666 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 09 16:18:25.076666 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 09 16:18:25.076666 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Sep 09 16:18:25.076666 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return ref.to_dict() Sep 09 16:18:25.076666 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 09 16:18:25.076666 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application next(self.gen) Sep 09 16:18:25.077632 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 09 16:18:25.077632 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application yield resource Sep 09 16:18:25.077632 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 09 16:18:25.077632 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application next(self.gen) Sep 09 16:18:25.077632 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 09 16:18:25.077632 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application self.session.rollback() Sep 09 16:18:25.077632 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 09 16:18:25.077632 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application self.force_reraise() Sep 09 16:18:25.077632 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 09 16:18:25.077632 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise self.value Sep 09 16:18:25.077632 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 09 16:18:25.077632 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 09 16:18:25.077632 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 09 16:18:25.077632 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application session.commit() Sep 09 16:18:25.077632 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 09 16:18:25.077632 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 09 16:18:25.077632 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 09 16:18:25.079677 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application self._prepare_impl() Sep 09 16:18:25.079677 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 09 16:18:25.079677 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application self.session.flush() Sep 09 16:18:25.079677 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 09 16:18:25.079677 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application self._flush(objects) Sep 09 16:18:25.079677 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 09 16:18:25.079677 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 09 16:18:25.079677 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 09 16:18:25.079677 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application compat.raise_( Sep 09 16:18:25.079677 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 09 16:18:25.079677 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception Sep 09 16:18:25.079677 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 09 16:18:25.079677 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application flush_context.execute() Sep 09 16:18:25.079677 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 09 16:18:25.079677 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rec.execute(self) Sep 09 16:18:25.079677 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 09 16:18:25.079677 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 09 16:18:25.081781 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 09 16:18:25.081781 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 09 16:18:25.081781 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 09 16:18:25.081781 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 09 16:18:25.081781 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 09 16:18:25.081781 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 09 16:18:25.081781 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 09 16:18:25.081781 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 09 16:18:25.081781 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 09 16:18:25.081781 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 09 16:18:25.081781 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 09 16:18:25.081781 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 09 16:18:25.081781 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 09 16:18:25.081781 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 09 16:18:25.081781 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 09 16:18:25.081781 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception Sep 09 16:18:25.083983 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 09 16:18:25.083983 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 09 16:18:25.083983 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 09 16:18:25.083983 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 09 16:18:25.083983 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 09 16:18:25.083983 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application result = self._query(query) Sep 09 16:18:25.083983 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 09 16:18:25.083983 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application conn.query(q) Sep 09 16:18:25.083983 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 09 16:18:25.083983 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 09 16:18:25.083983 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 09 16:18:25.083983 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application result.read() Sep 09 16:18:25.083983 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 09 16:18:25.083983 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 09 16:18:25.083983 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 09 16:18:25.083983 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 09 16:18:25.085994 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 09 16:18:25.085994 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 09 16:18:25.085994 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 09 16:18:25.085994 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 09 16:18:25.085994 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 09 16:18:25.085994 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 09 16:18:25.085994 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [parameters: {'id': 'c417ac5ba9e24be7ba11a4096e1fc416', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 09 16:18:25.085994 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 09 16:18:25.085994 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:18:25.085994 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 16:18:25.085994 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:18:25.085994 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:18:25.085994 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:18:25.085994 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:18:25.085994 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:18:25.085994 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:18:25.091210 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:18:25.091210 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:18:25.091210 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:18:25.091210 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:18:25.091210 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:18:25.091210 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:18:25.091210 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Sep 09 16:18:25.091210 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Sep 09 16:18:25.091210 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:18:25.091210 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:18:25.091210 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Sep 09 16:18:25.091210 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Sep 09 16:18:25.091210 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 09 16:18:25.091210 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 09 16:18:25.091210 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 09 16:18:25.091210 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:18:25.092003 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 245/478] 10.222.0.27 () {60 vars in 1131 bytes} [Fri Sep 9 16:18:24 2022] POST /identity/v3/roles => generated 144 bytes in 196 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:18:25.092067 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b317569c-6a95-4228-9f8d-cc84bb510615 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:25.258356 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b317569c-6a95-4228-9f8d-cc84bb510615 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:25.312448 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea3cea9-7483-497d-b4b4-fd5b709f6b51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:25.313084 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea3cea9-7483-497d-b4b4-fd5b709f6b51 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:25.313358 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea3cea9-7483-497d-b4b4-fd5b709f6b51 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:25.313806 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea3cea9-7483-497d-b4b4-fd5b709f6b51 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:25.327861 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea3cea9-7483-497d-b4b4-fd5b709f6b51 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 16:18:25.338959 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-0ea3cea9-7483-497d-b4b4-fd5b709f6b51 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 16:18:25.338959 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:18:25.338959 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:18:25.338959 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:18:25.338959 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:18:25.338959 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:18:25.338959 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:18:25.338959 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:18:25.338959 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:18:25.338959 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:18:25.338959 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:18:25.338959 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:18:25.338959 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 16:18:25.338959 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 16:18:25.338959 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 16:18:25.338959 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 16:18:25.339839 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 16:18:25.339839 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 16:18:25.339839 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 16:18:25.339839 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 16:18:25.339839 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:18:25.339839 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:18:25.339839 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:18:25.339839 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:18:25.339839 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:18:25.339839 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:18:25.339839 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:18:25.339839 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 16:18:25.339839 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:18:25.339839 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:18:25.339839 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:18:25.339839 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:18:25.342121 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:18:25.342121 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:18:25.342121 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:18:25.342121 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:18:25.342121 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 16:18:25.342121 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 16:18:25.342121 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 16:18:25.342121 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 16:18:25.342121 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 16:18:25.342121 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 16:18:25.342121 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 16:18:25.342121 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 16:18:25.342121 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 234/479] 10.222.0.27 () {56 vars in 1114 bytes} [Fri Sep 9 16:18:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:18:25.347596 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21269b9c-843b-489c-8e81-c8ff4f4ece69 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:25.407665 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:25.497101 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21269b9c-843b-489c-8e81-c8ff4f4ece69 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:25.547079 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e49330f-9883-47ad-9b7d-4fe93f80fd88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:25.547605 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e49330f-9883-47ad-9b7d-4fe93f80fd88 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:25.547883 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e49330f-9883-47ad-9b7d-4fe93f80fd88 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:25.548152 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e49330f-9883-47ad-9b7d-4fe93f80fd88 None admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:25.548806 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e49330f-9883-47ad-9b7d-4fe93f80fd88 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:18:25.549103 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e49330f-9883-47ad-9b7d-4fe93f80fd88 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:25.551014 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e49330f-9883-47ad-9b7d-4fe93f80fd88 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:25.566497 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 246/480] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Sep 9 16:18:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:18:26.580100 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9228ee-4a4f-4c37-9fea-d04737a130dd None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:26.580584 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9228ee-4a4f-4c37-9fea-d04737a130dd None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:26.580893 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9228ee-4a4f-4c37-9fea-d04737a130dd None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:26.583266 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 235/481] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:18:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:18:26.588098 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74946407-321f-479f-b9a4-a02a841f3d25 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:26.588484 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74946407-321f-479f-b9a4-a02a841f3d25 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:26.588664 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74946407-321f-479f-b9a4-a02a841f3d25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:26.616436 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-74946407-321f-479f-b9a4-a02a841f3d25 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:18:26.617627 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-74946407-321f-479f-b9a4-a02a841f3d25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:18:26.716454 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 247/482] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:18:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 16:18:26.938665 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba114442-80d0-4cd0-8ea3-1d47f3572c44 None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:26.939080 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba114442-80d0-4cd0-8ea3-1d47f3572c44 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:26.939498 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba114442-80d0-4cd0-8ea3-1d47f3572c44 None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:26.941942 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 236/483] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:18:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:18:26.946971 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f90a291-96bc-48db-b21a-da856f786640 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:26.947470 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f90a291-96bc-48db-b21a-da856f786640 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:26.947949 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f90a291-96bc-48db-b21a-da856f786640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:26.969123 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-6f90a291-96bc-48db-b21a-da856f786640 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:18:26.970650 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-6f90a291-96bc-48db-b21a-da856f786640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:18:27.005650 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:27.068127 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 248/484] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:18:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 16:18:27.093081 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba114442-80d0-4cd0-8ea3-1d47f3572c44 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:27.118004 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:27.220586 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba114442-80d0-4cd0-8ea3-1d47f3572c44 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:27.254898 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb798ea-e077-4b43-b403-16b7581ba906 None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:27.255485 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb798ea-e077-4b43-b403-16b7581ba906 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:27.255485 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb798ea-e077-4b43-b403-16b7581ba906 None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:27.257191 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 249/485] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:18:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 16:18:27.263105 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85387dd-5de0-42b5-9455-e383d5b88698 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:27.263424 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85387dd-5de0-42b5-9455-e383d5b88698 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:27.263655 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85387dd-5de0-42b5-9455-e383d5b88698 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:27.285818 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-d85387dd-5de0-42b5-9455-e383d5b88698 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:18:27.286884 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f98938c-f44b-4152-89e7-82481b134afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:27.287101 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-d85387dd-5de0-42b5-9455-e383d5b88698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:18:27.287953 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f98938c-f44b-4152-89e7-82481b134afb None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:27.288422 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f98938c-f44b-4152-89e7-82481b134afb None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:27.288980 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f98938c-f44b-4152-89e7-82481b134afb None admin] PATH_INFO: `/v3/roles/service` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:27.307650 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f98938c-f44b-4152-89e7-82481b134afb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 16:18:27.313278 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-8f98938c-f44b-4152-89e7-82481b134afb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 16:18:27.313278 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:18:27.313278 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:18:27.313278 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:18:27.313278 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:18:27.313278 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:18:27.313278 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:18:27.313278 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:18:27.313278 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:18:27.313278 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:18:27.313278 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:18:27.313278 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:18:27.313278 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 16:18:27.313278 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 16:18:27.313278 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 16:18:27.313278 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 16:18:27.314212 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 16:18:27.314212 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 16:18:27.314212 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 16:18:27.314212 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 16:18:27.314212 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:18:27.314212 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:18:27.314212 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:18:27.314212 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:18:27.314212 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:18:27.314212 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:18:27.314212 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:18:27.314212 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 16:18:27.314212 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:18:27.314212 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:18:27.314212 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:18:27.314212 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:18:27.315050 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:18:27.315050 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:18:27.315050 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:18:27.315050 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:18:27.315050 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 16:18:27.315050 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 16:18:27.315050 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 16:18:27.315050 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 16:18:27.315050 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 16:18:27.315050 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 16:18:27.315050 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 16:18:27.315050 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 16:18:27.318252 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 237/486] 10.222.0.27 () {56 vars in 1102 bytes} [Fri Sep 9 16:18:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:18:27.324053 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f98938c-f44b-4152-89e7-82481b134afb None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:27.369686 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 250/487] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:18:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 16:18:27.429006 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85387dd-5de0-42b5-9455-e383d5b88698 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:27.448690 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:27.472114 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f98938c-f44b-4152-89e7-82481b134afb None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:27.526335 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048e6479-0c23-4740-a148-44e981768f75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:27.526958 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048e6479-0c23-4740-a148-44e981768f75 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:27.527447 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048e6479-0c23-4740-a148-44e981768f75 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:27.527553 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048e6479-0c23-4740-a148-44e981768f75 None admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:27.528150 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048e6479-0c23-4740-a148-44e981768f75 None admin] RBAC: Adding query filter params (name=service) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:18:27.528454 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048e6479-0c23-4740-a148-44e981768f75 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:27.529851 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048e6479-0c23-4740-a148-44e981768f75 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:27.540586 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:27.546677 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 238/488] 10.222.0.27 () {56 vars in 1103 bytes} [Fri Sep 9 16:18:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:18:27.552444 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048e6479-0c23-4740-a148-44e981768f75 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:27.553585 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85387dd-5de0-42b5-9455-e383d5b88698 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:27.590004 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dfdadf-2cfb-46c8-bbb0-4563d9d36a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:27.591444 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dfdadf-2cfb-46c8-bbb0-4563d9d36a60 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:27.591949 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dfdadf-2cfb-46c8-bbb0-4563d9d36a60 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:27.592408 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dfdadf-2cfb-46c8-bbb0-4563d9d36a60 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:27.603196 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dfdadf-2cfb-46c8-bbb0-4563d9d36a60 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 16:18:27.608156 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-b5dfdadf-2cfb-46c8-bbb0-4563d9d36a60 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 16:18:27.608156 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:18:27.608156 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:18:27.608156 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:18:27.608156 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:18:27.608156 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:18:27.608156 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:18:27.608156 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:18:27.608156 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:18:27.608156 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:18:27.608156 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:18:27.608156 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:18:27.608156 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 16:18:27.608156 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 16:18:27.608156 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 16:18:27.608156 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 16:18:27.609017 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 16:18:27.609017 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 16:18:27.609017 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 16:18:27.609017 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 16:18:27.609017 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:18:27.609017 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:18:27.609017 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:18:27.609017 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:18:27.609017 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:18:27.609017 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:18:27.609017 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:18:27.609017 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Sep 09 16:18:27.609017 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:18:27.609017 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:18:27.609017 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:18:27.609017 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:18:27.609800 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:18:27.609800 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:18:27.609800 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:18:27.609800 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:18:27.609800 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 16:18:27.609800 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 16:18:27.609800 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 16:18:27.609800 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 16:18:27.609800 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 16:18:27.609800 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 16:18:27.609800 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 16:18:27.609800 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:18:27.612073 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 251/489] 10.222.0.27 () {56 vars in 1102 bytes} [Fri Sep 9 16:18:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:18:27.617916 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dfdadf-2cfb-46c8-bbb0-4563d9d36a60 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:27.687060 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048e6479-0c23-4740-a148-44e981768f75 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:27.724597 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5931dc18-e119-4211-8b33-0ebfe531c6c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:27.725169 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5931dc18-e119-4211-8b33-0ebfe531c6c9 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:27.725445 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5931dc18-e119-4211-8b33-0ebfe531c6c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:27.725713 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5931dc18-e119-4211-8b33-0ebfe531c6c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:27.734467 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:27.736904 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5931dc18-e119-4211-8b33-0ebfe531c6c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:27.739022 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5931dc18-e119-4211-8b33-0ebfe531c6c9 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:27.754665 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-5931dc18-e119-4211-8b33-0ebfe531c6c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 16:18:27.754665 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:18:27.754665 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:18:27.754665 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:18:27.754665 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:18:27.754665 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:18:27.754665 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:18:27.754665 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:18:27.754665 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:18:27.754665 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:18:27.754665 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:18:27.754665 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:18:27.754665 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 16:18:27.754665 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 16:18:27.754665 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 16:18:27.754665 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 16:18:27.755748 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:18:27.755748 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:18:27.755748 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:18:27.755748 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:18:27.755748 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:18:27.755748 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:18:27.755748 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:18:27.755748 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 16:18:27.755748 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:18:27.755748 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:18:27.755748 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:18:27.755748 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:18:27.755748 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:18:27.755748 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:18:27.755748 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:18:27.755748 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:18:27.755748 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 16:18:27.756604 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 16:18:27.756604 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 16:18:27.756604 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 16:18:27.756604 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 239/490] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 16:18:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:18:27.757235 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81c142a-9efa-48f7-96ff-e075f0c37ad7 None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:27.757517 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81c142a-9efa-48f7-96ff-e075f0c37ad7 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:27.757655 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dfdadf-2cfb-46c8-bbb0-4563d9d36a60 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:27.757785 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81c142a-9efa-48f7-96ff-e075f0c37ad7 None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:27.759025 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 240/491] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:18:27 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:18:27.759717 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81c142a-9efa-48f7-96ff-e075f0c37ad7 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:27.800117 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da59ef4-e751-48d2-956d-448b29bddbec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:27.800757 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da59ef4-e751-48d2-956d-448b29bddbec None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:27.801039 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da59ef4-e751-48d2-956d-448b29bddbec None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:27.801312 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da59ef4-e751-48d2-956d-448b29bddbec None admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:27.801966 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da59ef4-e751-48d2-956d-448b29bddbec None admin] RBAC: Adding query filter params (name=service) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:18:27.802269 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da59ef4-e751-48d2-956d-448b29bddbec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:27.803692 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da59ef4-e751-48d2-956d-448b29bddbec None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:27.812725 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 252/492] 10.222.0.27 () {56 vars in 1103 bytes} [Fri Sep 9 16:18:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 16:18:27.813724 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da59ef4-e751-48d2-956d-448b29bddbec None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:27.828911 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:27.875836 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81c142a-9efa-48f7-96ff-e075f0c37ad7 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:27.910981 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ab5182-551c-4b06-b0a2-7e7ddb4cb593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:27.911590 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ab5182-551c-4b06-b0a2-7e7ddb4cb593 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:27.911873 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ab5182-551c-4b06-b0a2-7e7ddb4cb593 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:27.912148 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ab5182-551c-4b06-b0a2-7e7ddb4cb593 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:27.919095 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da59ef4-e751-48d2-956d-448b29bddbec None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:27.922475 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ab5182-551c-4b06-b0a2-7e7ddb4cb593 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 16:18:27.928167 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-46ab5182-551c-4b06-b0a2-7e7ddb4cb593 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 16:18:27.928167 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:18:27.928167 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:18:27.928167 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:18:27.928167 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:18:27.928167 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:18:27.928167 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:18:27.928167 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:18:27.928167 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:18:27.928167 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:18:27.928167 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:18:27.928167 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:18:27.928167 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 16:18:27.928167 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 16:18:27.928167 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 16:18:27.928167 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 16:18:27.929060 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 16:18:27.929060 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 16:18:27.929060 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 16:18:27.929060 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 16:18:27.929060 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:18:27.929060 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:18:27.929060 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:18:27.929060 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:18:27.929060 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:18:27.929060 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:18:27.929060 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:18:27.929060 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 16:18:27.929060 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:18:27.929060 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:18:27.929060 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:18:27.929060 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:18:27.929877 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:18:27.929877 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:18:27.929877 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:18:27.929877 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:18:27.929877 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 16:18:27.929877 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 16:18:27.929877 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 16:18:27.929877 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 16:18:27.929877 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 16:18:27.929877 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 16:18:27.929877 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 16:18:27.929877 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 16:18:27.929877 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 241/493] 10.222.0.27 () {56 vars in 1102 bytes} [Fri Sep 9 16:18:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:18:27.930556 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8639a58-72c9-4ac6-87bd-d9a1ba5b0676 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:27.930621 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8639a58-72c9-4ac6-87bd-d9a1ba5b0676 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:27.931036 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8639a58-72c9-4ac6-87bd-d9a1ba5b0676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:27.950103 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-a8639a58-72c9-4ac6-87bd-d9a1ba5b0676 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:18:27.951322 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-a8639a58-72c9-4ac6-87bd-d9a1ba5b0676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:18:27.963593 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d23c96-bcd4-4ed5-89dc-21a7624b6fc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:27.964197 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d23c96-bcd4-4ed5-89dc-21a7624b6fc2 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:27.964477 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d23c96-bcd4-4ed5-89dc-21a7624b6fc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:27.964749 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d23c96-bcd4-4ed5-89dc-21a7624b6fc2 None admin] PATH_INFO: `/v3/domains` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:27.965380 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d23c96-bcd4-4ed5-89dc-21a7624b6fc2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:18:27.965687 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d23c96-bcd4-4ed5-89dc-21a7624b6fc2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:27.967086 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d23c96-bcd4-4ed5-89dc-21a7624b6fc2 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:27.979059 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 253/494] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Sep 9 16:18:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:18:27.979589 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d23c96-bcd4-4ed5-89dc-21a7624b6fc2 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:28.008619 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:28.039881 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 242/495] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:18:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 16:18:28.039881 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8639a58-72c9-4ac6-87bd-d9a1ba5b0676 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:28.083830 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:28.120963 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d23c96-bcd4-4ed5-89dc-21a7624b6fc2 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:28.152076 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8639a58-72c9-4ac6-87bd-d9a1ba5b0676 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:28.171381 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deceb68-cff9-49e9-9889-a1837e9af3c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:28.172762 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deceb68-cff9-49e9-9889-a1837e9af3c9 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:28.173238 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deceb68-cff9-49e9-9889-a1837e9af3c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:28.173699 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deceb68-cff9-49e9-9889-a1837e9af3c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:28.188930 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0deceb68-cff9-49e9-9889-a1837e9af3c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:28.189802 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce70dd7a-e0e9-4fae-943a-9142c34055a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:28.190481 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce70dd7a-e0e9-4fae-943a-9142c34055a3 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:28.190759 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce70dd7a-e0e9-4fae-943a-9142c34055a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:28.191029 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce70dd7a-e0e9-4fae-943a-9142c34055a3 None admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:28.191680 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce70dd7a-e0e9-4fae-943a-9142c34055a3 None admin] RBAC: Adding query filter params (name=service) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:18:28.191897 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0deceb68-cff9-49e9-9889-a1837e9af3c9 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:28.191994 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce70dd7a-e0e9-4fae-943a-9142c34055a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:28.193338 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce70dd7a-e0e9-4fae-943a-9142c34055a3 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:28.203036 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 243/496] 10.222.0.27 () {56 vars in 1103 bytes} [Fri Sep 9 16:18:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:18:28.208846 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce70dd7a-e0e9-4fae-943a-9142c34055a3 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:28.213427 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-0deceb68-cff9-49e9-9889-a1837e9af3c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 16:18:28.213427 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:18:28.213427 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:18:28.213427 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:18:28.213427 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:18:28.213427 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:18:28.213427 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:18:28.213427 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:18:28.213427 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:18:28.213427 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:18:28.213427 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:18:28.213427 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:18:28.213427 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 16:18:28.213427 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 16:18:28.213427 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 16:18:28.213427 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 16:18:28.214288 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:18:28.214288 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:18:28.214288 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:18:28.214288 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:18:28.214288 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:18:28.214288 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:18:28.214288 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:18:28.214288 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Sep 09 16:18:28.214288 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:18:28.214288 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:18:28.214288 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:18:28.214288 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:18:28.214288 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:18:28.214288 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:18:28.214288 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:18:28.214288 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:18:28.214288 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 16:18:28.215155 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 16:18:28.215155 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 16:18:28.215155 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:18:28.217165 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 254/497] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 16:18:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:18:28.218153 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deceb68-cff9-49e9-9889-a1837e9af3c9 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:28.263154 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:28.332679 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce70dd7a-e0e9-4fae-943a-9142c34055a3 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:28.359482 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deceb68-cff9-49e9-9889-a1837e9af3c9 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:28.369356 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841bf858-8924-4954-9b24-c91b3df8933b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:28.369982 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841bf858-8924-4954-9b24-c91b3df8933b None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:28.370327 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841bf858-8924-4954-9b24-c91b3df8933b None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:28.370619 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841bf858-8924-4954-9b24-c91b3df8933b None admin] PATH_INFO: `/v3/users/nova` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:28.378715 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841bf858-8924-4954-9b24-c91b3df8933b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:28.380218 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841bf858-8924-4954-9b24-c91b3df8933b None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:28.384108 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:28.395461 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de2e887-44ea-4ce4-91c5-c5addbf8992b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:28.395697 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-841bf858-8924-4954-9b24-c91b3df8933b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 09 16:18:28.395697 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:18:28.395697 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:18:28.395697 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:18:28.395697 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:18:28.395697 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:18:28.395697 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:18:28.395697 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:18:28.395697 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:18:28.395697 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:18:28.395697 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:18:28.395697 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:18:28.395697 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 16:18:28.395697 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 16:18:28.395697 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 16:18:28.395697 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 16:18:28.396582 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:18:28.396582 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:18:28.396582 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 16:18:28.396582 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 16:18:28.396582 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 16:18:28.396582 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 16:18:28.396582 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:18:28.396582 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:18:28.396582 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:18:28.396582 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:18:28.396582 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:18:28.396582 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 16:18:28.396582 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:18:28.396582 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:18:28.396582 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:18:28.396582 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:18:28.396582 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:18:28.396582 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:18:28.397486 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:18:28.397486 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:18:28.397486 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 16:18:28.397486 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 16:18:28.397486 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 16:18:28.397486 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 16:18:28.397486 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 16:18:28.397486 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 16:18:28.397486 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 09 16:18:28.397486 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 16:18:28.397992 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de2e887-44ea-4ce4-91c5-c5addbf8992b None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:28.397992 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de2e887-44ea-4ce4-91c5-c5addbf8992b None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:28.397992 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de2e887-44ea-4ce4-91c5-c5addbf8992b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:28.398171 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 244/498] 10.222.0.27 () {56 vars in 1093 bytes} [Fri Sep 9 16:18:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:18:28.398171 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841bf858-8924-4954-9b24-c91b3df8933b None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:28.412425 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de2e887-44ea-4ce4-91c5-c5addbf8992b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:28.414460 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de2e887-44ea-4ce4-91c5-c5addbf8992b None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:28.430482 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-4de2e887-44ea-4ce4-91c5-c5addbf8992b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 16:18:28.430482 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:18:28.430482 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:18:28.430482 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:18:28.430482 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:18:28.430482 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:18:28.430482 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:18:28.430482 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:18:28.430482 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:18:28.430482 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:18:28.430482 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:18:28.430482 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:18:28.430482 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 16:18:28.430482 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 16:18:28.430482 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 16:18:28.430482 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 16:18:28.431407 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:18:28.431407 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:18:28.431407 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:18:28.431407 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:18:28.431407 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:18:28.431407 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:18:28.431407 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:18:28.431407 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Sep 09 16:18:28.431407 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:18:28.431407 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:18:28.431407 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:18:28.431407 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:18:28.431407 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:18:28.431407 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:18:28.431407 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:18:28.431407 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:18:28.431407 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 16:18:28.437412 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 16:18:28.437412 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 16:18:28.437412 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:18:28.437412 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 255/499] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 16:18:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:18:28.437412 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de2e887-44ea-4ce4-91c5-c5addbf8992b None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:28.507189 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841bf858-8924-4954-9b24-c91b3df8933b None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:28.510579 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:28.543976 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de2e887-44ea-4ce4-91c5-c5addbf8992b None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:28.552348 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92002553-64cc-44a4-b0b5-93aa3e4c5202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:28.553009 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92002553-64cc-44a4-b0b5-93aa3e4c5202 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:28.553288 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92002553-64cc-44a4-b0b5-93aa3e4c5202 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:28.553555 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92002553-64cc-44a4-b0b5-93aa3e4c5202 None admin] PATH_INFO: `/v3/domains` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:28.554191 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92002553-64cc-44a4-b0b5-93aa3e4c5202 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:18:28.554530 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92002553-64cc-44a4-b0b5-93aa3e4c5202 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:28.555907 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92002553-64cc-44a4-b0b5-93aa3e4c5202 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:28.567886 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 245/500] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Sep 9 16:18:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:18:28.568686 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92002553-64cc-44a4-b0b5-93aa3e4c5202 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:28.584969 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c3caea-0f25-40bc-9774-113c4d96985b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:28.585756 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c3caea-0f25-40bc-9774-113c4d96985b None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:28.586039 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c3caea-0f25-40bc-9774-113c4d96985b None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:28.586342 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c3caea-0f25-40bc-9774-113c4d96985b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:28.598236 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c3caea-0f25-40bc-9774-113c4d96985b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 16:18:28.604102 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-d1c3caea-0f25-40bc-9774-113c4d96985b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 16:18:28.604102 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:18:28.604102 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:18:28.604102 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:18:28.604102 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:18:28.604102 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:18:28.604102 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:18:28.604102 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:18:28.604102 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:18:28.604102 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:18:28.604102 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:18:28.604102 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:18:28.604102 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 16:18:28.604102 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 16:18:28.604102 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 16:18:28.604102 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 16:18:28.605047 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 16:18:28.605047 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 16:18:28.605047 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 16:18:28.605047 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 16:18:28.605047 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:18:28.605047 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:18:28.605047 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:18:28.605047 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:18:28.605047 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:18:28.605047 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:18:28.605047 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:18:28.605047 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Sep 09 16:18:28.605047 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:18:28.605047 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:18:28.605047 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:18:28.605047 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:18:28.605835 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:18:28.605835 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:18:28.605835 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:18:28.605835 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:18:28.605835 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 16:18:28.605835 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 16:18:28.605835 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 16:18:28.605835 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 16:18:28.605835 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 16:18:28.605835 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 16:18:28.605835 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 16:18:28.605835 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:18:28.605835 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 256/501] 10.222.0.27 () {56 vars in 1102 bytes} [Fri Sep 9 16:18:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:18:28.605835 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c3caea-0f25-40bc-9774-113c4d96985b None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:28.645346 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:28.674693 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92002553-64cc-44a4-b0b5-93aa3e4c5202 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:28.713344 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a59e27-8046-42c7-a6cb-03ee2af73e28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:28.713978 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a59e27-8046-42c7-a6cb-03ee2af73e28 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:28.714206 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a59e27-8046-42c7-a6cb-03ee2af73e28 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:28.714501 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a59e27-8046-42c7-a6cb-03ee2af73e28 None admin] PATH_INFO: `/v3/users` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:28.715212 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a59e27-8046-42c7-a6cb-03ee2af73e28 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:18:28.715513 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a59e27-8046-42c7-a6cb-03ee2af73e28 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:28.716956 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a59e27-8046-42c7-a6cb-03ee2af73e28 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:28.721085 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c3caea-0f25-40bc-9774-113c4d96985b None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:28.753938 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 246/502] 10.222.0.27 () {56 vars in 1133 bytes} [Fri Sep 9 16:18:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:18:28.754794 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a59e27-8046-42c7-a6cb-03ee2af73e28 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:28.758589 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2b990d-e916-48b9-8dea-910c3c4da680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:28.759203 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2b990d-e916-48b9-8dea-910c3c4da680 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:28.759485 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2b990d-e916-48b9-8dea-910c3c4da680 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:28.759758 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2b990d-e916-48b9-8dea-910c3c4da680 None admin] PATH_INFO: `/v3/domains` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:28.760390 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2b990d-e916-48b9-8dea-910c3c4da680 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:18:28.760688 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2b990d-e916-48b9-8dea-910c3c4da680 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:28.762086 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2b990d-e916-48b9-8dea-910c3c4da680 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:28.778650 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 257/503] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Sep 9 16:18:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:18:28.778650 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2b990d-e916-48b9-8dea-910c3c4da680 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:28.781759 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:28.858426 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a59e27-8046-42c7-a6cb-03ee2af73e28 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:28.865028 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:28.871282 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2b990d-e916-48b9-8dea-910c3c4da680 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:28.891918 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a097bc13-5967-44df-9aa6-3f04bb499bcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:28.892538 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a097bc13-5967-44df-9aa6-3f04bb499bcc None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:28.892814 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a097bc13-5967-44df-9aa6-3f04bb499bcc None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:28.893082 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a097bc13-5967-44df-9aa6-3f04bb499bcc None admin] PATH_INFO: `/v3/users/glance` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:28.900592 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a097bc13-5967-44df-9aa6-3f04bb499bcc None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:28.902039 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a097bc13-5967-44df-9aa6-3f04bb499bcc None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:28.905380 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e65de7-bbe6-464e-91a7-a6df7f6eb358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:28.905961 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e65de7-bbe6-464e-91a7-a6df7f6eb358 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:28.906236 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e65de7-bbe6-464e-91a7-a6df7f6eb358 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:28.906536 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e65de7-bbe6-464e-91a7-a6df7f6eb358 None admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:28.907171 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e65de7-bbe6-464e-91a7-a6df7f6eb358 None admin] RBAC: Adding query filter params (name=service) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:18:28.907465 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e65de7-bbe6-464e-91a7-a6df7f6eb358 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:28.908813 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e65de7-bbe6-464e-91a7-a6df7f6eb358 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:28.913397 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-a097bc13-5967-44df-9aa6-3f04bb499bcc None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 09 16:18:28.913397 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:18:28.913397 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:18:28.913397 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:18:28.913397 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:18:28.913397 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:18:28.913397 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:18:28.913397 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:18:28.913397 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:18:28.913397 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:18:28.913397 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:18:28.913397 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:18:28.913397 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 16:18:28.913397 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 16:18:28.913397 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 16:18:28.913397 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 16:18:28.914263 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:18:28.914263 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:18:28.914263 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 16:18:28.914263 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 16:18:28.914263 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 16:18:28.914263 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 16:18:28.914263 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:18:28.914263 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:18:28.914263 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:18:28.914263 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:18:28.914263 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:18:28.914263 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 16:18:28.914263 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:18:28.914263 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:18:28.914263 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:18:28.914263 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:18:28.914263 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:18:28.914263 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:18:28.916036 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:18:28.916036 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:18:28.916036 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 16:18:28.916036 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 16:18:28.916036 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 16:18:28.916036 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 16:18:28.916036 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 16:18:28.916036 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 16:18:28.916036 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 09 16:18:28.916036 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 16:18:28.916036 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 247/504] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Sep 9 16:18:28 2022] GET /identity/v3/users/glance => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:18:28.916036 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca3fcb2-a7b1-4898-8331-43b905b372bd None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:28.916036 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca3fcb2-a7b1-4898-8331-43b905b372bd None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:28.916729 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca3fcb2-a7b1-4898-8331-43b905b372bd None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:28.921628 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 248/505] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:18:28 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:18:28.921628 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca3fcb2-a7b1-4898-8331-43b905b372bd None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:28.921911 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 258/506] 10.222.0.27 () {56 vars in 1103 bytes} [Fri Sep 9 16:18:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:18:28.921911 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e65de7-bbe6-464e-91a7-a6df7f6eb358 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:29.006748 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:29.029134 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca3fcb2-a7b1-4898-8331-43b905b372bd None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:29.038217 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e65de7-bbe6-464e-91a7-a6df7f6eb358 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:29.064883 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b6483a-3309-47d3-b6f1-28f2b0b37604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:29.066011 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b6483a-3309-47d3-b6f1-28f2b0b37604 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:29.066293 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b6483a-3309-47d3-b6f1-28f2b0b37604 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:29.066593 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b6483a-3309-47d3-b6f1-28f2b0b37604 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:29.071534 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d12b6f-e2ee-4fb9-ab86-fd0ce2aaa42c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:29.072162 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d12b6f-e2ee-4fb9-ab86-fd0ce2aaa42c None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:29.072442 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d12b6f-e2ee-4fb9-ab86-fd0ce2aaa42c None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:29.072713 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d12b6f-e2ee-4fb9-ab86-fd0ce2aaa42c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:29.080139 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d12b6f-e2ee-4fb9-ab86-fd0ce2aaa42c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:29.082151 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d12b6f-e2ee-4fb9-ab86-fd0ce2aaa42c None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:29.094336 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-92d12b6f-e2ee-4fb9-ab86-fd0ce2aaa42c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 09 16:18:29.094336 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:18:29.094336 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:18:29.094336 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:18:29.094336 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:18:29.094336 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:18:29.094336 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:18:29.094336 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:18:29.094336 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:18:29.094336 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:18:29.094336 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:18:29.094336 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:18:29.094336 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 16:18:29.094336 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 16:18:29.094336 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 16:18:29.094336 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 16:18:29.095362 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:18:29.095362 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:18:29.095362 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 16:18:29.095362 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 16:18:29.095362 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 16:18:29.095362 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 16:18:29.095362 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:18:29.095362 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:18:29.095362 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:18:29.095362 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:18:29.095362 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:18:29.095362 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Sep 09 16:18:29.095362 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:18:29.095362 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:18:29.095362 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:18:29.095362 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:18:29.095362 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:18:29.095362 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:18:29.096240 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:18:29.096240 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:18:29.096240 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 16:18:29.096240 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 16:18:29.096240 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 16:18:29.096240 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 16:18:29.096240 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 16:18:29.096240 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 16:18:29.096240 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 09 16:18:29.096240 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:18:29.096240 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 259/507] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Sep 9 16:18:28 2022] GET /identity/v3/users/cinder => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:18:29.096240 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d12b6f-e2ee-4fb9-ab86-fd0ce2aaa42c None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:29.114550 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:29.137392 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b6483a-3309-47d3-b6f1-28f2b0b37604 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:29.138912 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b6483a-3309-47d3-b6f1-28f2b0b37604 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:29.196519 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d12b6f-e2ee-4fb9-ab86-fd0ce2aaa42c None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:29.219352 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:29.228657 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0b3ad7-7fcc-4743-9431-ba5dc6fd84f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:29.229253 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0b3ad7-7fcc-4743-9431-ba5dc6fd84f4 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:29.229530 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0b3ad7-7fcc-4743-9431-ba5dc6fd84f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:29.229802 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0b3ad7-7fcc-4743-9431-ba5dc6fd84f4 None admin] PATH_INFO: `/v3/users` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:29.230550 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0b3ad7-7fcc-4743-9431-ba5dc6fd84f4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:18:29.230854 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0b3ad7-7fcc-4743-9431-ba5dc6fd84f4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:29.232285 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0b3ad7-7fcc-4743-9431-ba5dc6fd84f4 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:29.239193 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 249/508] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Sep 9 16:18:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 16:18:29.240446 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f0a785-8a6a-41c3-a0fe-90cec30fe8e8 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:29.240731 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f0a785-8a6a-41c3-a0fe-90cec30fe8e8 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:29.241001 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f0a785-8a6a-41c3-a0fe-90cec30fe8e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:29.258904 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-d3f0a785-8a6a-41c3-a0fe-90cec30fe8e8 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:18:29.260090 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-d3f0a785-8a6a-41c3-a0fe-90cec30fe8e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:18:29.269083 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 260/509] 10.222.0.27 () {56 vars in 1137 bytes} [Fri Sep 9 16:18:29 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:18:29.269908 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0b3ad7-7fcc-4743-9431-ba5dc6fd84f4 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:29.336040 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 250/510] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:18:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 16:18:29.336910 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f0a785-8a6a-41c3-a0fe-90cec30fe8e8 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:29.357918 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:29.385006 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0b3ad7-7fcc-4743-9431-ba5dc6fd84f4 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:29.420708 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66543468-5974-4f24-b022-c8100536c1a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:29.421328 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66543468-5974-4f24-b022-c8100536c1a2 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:29.421602 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66543468-5974-4f24-b022-c8100536c1a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:29.421870 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66543468-5974-4f24-b022-c8100536c1a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:29.432756 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66543468-5974-4f24-b022-c8100536c1a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:29.434586 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66543468-5974-4f24-b022-c8100536c1a2 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:29.449796 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f0a785-8a6a-41c3-a0fe-90cec30fe8e8 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:29.450442 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-66543468-5974-4f24-b022-c8100536c1a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 16:18:29.450442 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:18:29.450442 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:18:29.450442 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:18:29.450442 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:18:29.450442 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:18:29.450442 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:18:29.450442 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:18:29.450442 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:18:29.450442 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:18:29.450442 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:18:29.450442 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:18:29.450442 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 16:18:29.450442 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 16:18:29.450442 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 16:18:29.450442 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 16:18:29.451305 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:18:29.451305 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:18:29.451305 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:18:29.451305 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:18:29.451305 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:18:29.451305 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:18:29.451305 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:18:29.451305 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Sep 09 16:18:29.451305 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:18:29.451305 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:18:29.451305 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:18:29.451305 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:18:29.451305 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:18:29.451305 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:18:29.451305 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:18:29.451305 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:18:29.451305 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 16:18:29.452170 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 16:18:29.452170 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 16:18:29.452170 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:18:29.452170 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 261/511] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 16:18:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:18:29.452397 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66543468-5974-4f24-b022-c8100536c1a2 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:29.468150 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:29.491608 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049daf1e-b689-4c4e-bdbe-223bf1e2b201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:29.492207 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049daf1e-b689-4c4e-bdbe-223bf1e2b201 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:29.492481 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049daf1e-b689-4c4e-bdbe-223bf1e2b201 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:29.492749 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049daf1e-b689-4c4e-bdbe-223bf1e2b201 None admin] PATH_INFO: `/v3/users` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:29.493460 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049daf1e-b689-4c4e-bdbe-223bf1e2b201 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:18:29.493758 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049daf1e-b689-4c4e-bdbe-223bf1e2b201 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:29.495241 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049daf1e-b689-4c4e-bdbe-223bf1e2b201 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:29.513823 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 251/512] 10.222.0.27 () {56 vars in 1137 bytes} [Fri Sep 9 16:18:29 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:18:29.514921 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049daf1e-b689-4c4e-bdbe-223bf1e2b201 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:29.561422 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66543468-5974-4f24-b022-c8100536c1a2 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:29.589758 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:29.602454 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d8e922-9ced-48c1-8a68-c1c291624067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:29.603084 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d8e922-9ced-48c1-8a68-c1c291624067 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:29.603360 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d8e922-9ced-48c1-8a68-c1c291624067 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:29.603633 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d8e922-9ced-48c1-8a68-c1c291624067 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:29.616113 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d8e922-9ced-48c1-8a68-c1c291624067 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:29.617549 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d8e922-9ced-48c1-8a68-c1c291624067 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:29.624268 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049daf1e-b689-4c4e-bdbe-223bf1e2b201 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:29.631118 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-a0d8e922-9ced-48c1-8a68-c1c291624067 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 16:18:29.631118 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:18:29.631118 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:18:29.631118 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:18:29.631118 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:18:29.631118 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:18:29.631118 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:18:29.631118 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:18:29.631118 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:18:29.631118 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:18:29.631118 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:18:29.631118 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:18:29.631118 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 16:18:29.631118 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 16:18:29.631118 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 16:18:29.631118 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 16:18:29.632168 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:18:29.632168 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:18:29.632168 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:18:29.632168 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:18:29.632168 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:18:29.632168 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:18:29.632168 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:18:29.632168 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Sep 09 16:18:29.632168 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:18:29.632168 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:18:29.632168 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:18:29.632168 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:18:29.632168 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:18:29.632168 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:18:29.632168 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:18:29.632168 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:18:29.632168 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 16:18:29.633004 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 16:18:29.633004 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 16:18:29.633004 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:18:29.633004 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 262/513] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 16:18:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:18:29.633214 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d8e922-9ced-48c1-8a68-c1c291624067 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:29.658668 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62155a6b-d4c6-4401-87a0-9413e2b94d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:29.659712 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62155a6b-d4c6-4401-87a0-9413e2b94d58 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:29.659985 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62155a6b-d4c6-4401-87a0-9413e2b94d58 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:29.660284 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62155a6b-d4c6-4401-87a0-9413e2b94d58 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:29.698379 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:29.727510 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62155a6b-d4c6-4401-87a0-9413e2b94d58 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:29.728979 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62155a6b-d4c6-4401-87a0-9413e2b94d58 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:29.734776 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d8e922-9ced-48c1-8a68-c1c291624067 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:29.766886 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb07325-17b2-4958-ba7f-502833b02184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:29.767480 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb07325-17b2-4958-ba7f-502833b02184 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:29.767755 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb07325-17b2-4958-ba7f-502833b02184 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:29.768024 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb07325-17b2-4958-ba7f-502833b02184 None admin] PATH_INFO: `/v3/domains` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:29.768645 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb07325-17b2-4958-ba7f-502833b02184 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:18:29.768934 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb07325-17b2-4958-ba7f-502833b02184 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:29.770271 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb07325-17b2-4958-ba7f-502833b02184 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:29.781688 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 263/514] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Sep 9 16:18:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:18:29.782715 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb07325-17b2-4958-ba7f-502833b02184 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:29.824707 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:29.828399 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 252/515] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Sep 9 16:18:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 16:18:29.829227 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62155a6b-d4c6-4401-87a0-9413e2b94d58 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:29.885261 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb07325-17b2-4958-ba7f-502833b02184 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:29.895627 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:29.919816 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b2b31b-b9ea-4514-a100-adbb0bebbbaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:29.920417 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b2b31b-b9ea-4514-a100-adbb0bebbbaa None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:29.920694 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b2b31b-b9ea-4514-a100-adbb0bebbbaa None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:29.920962 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b2b31b-b9ea-4514-a100-adbb0bebbbaa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:29.925750 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62155a6b-d4c6-4401-87a0-9413e2b94d58 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:29.959115 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7643dbb8-dab0-42ea-ac6a-40e09c234b75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:29.960151 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7643dbb8-dab0-42ea-ac6a-40e09c234b75 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:29.960430 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7643dbb8-dab0-42ea-ac6a-40e09c234b75 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:29.960700 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7643dbb8-dab0-42ea-ac6a-40e09c234b75 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:29.970323 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7643dbb8-dab0-42ea-ac6a-40e09c234b75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:29.972330 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7643dbb8-dab0-42ea-ac6a-40e09c234b75 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:29.986987 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b2b31b-b9ea-4514-a100-adbb0bebbbaa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:29.988435 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b2b31b-b9ea-4514-a100-adbb0bebbbaa None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:29.989951 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-7643dbb8-dab0-42ea-ac6a-40e09c234b75 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 16:18:29.989951 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:18:29.989951 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:18:29.989951 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:18:29.989951 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:18:29.989951 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:18:29.989951 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:18:29.989951 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:18:29.989951 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:18:29.989951 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:18:29.989951 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:18:29.989951 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:18:29.989951 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 16:18:29.989951 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 16:18:29.989951 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 16:18:29.989951 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 16:18:29.990851 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:18:29.990851 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:18:29.990851 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:18:29.990851 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:18:29.990851 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:18:29.990851 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:18:29.990851 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:18:29.990851 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 16:18:29.990851 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:18:29.990851 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:18:29.990851 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:18:29.990851 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:18:29.990851 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:18:29.990851 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:18:29.990851 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:18:29.990851 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:18:29.990851 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 16:18:29.991845 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 16:18:29.991845 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 16:18:29.991845 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 16:18:29.991845 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 253/516] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 16:18:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:18:29.991845 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7643dbb8-dab0-42ea-ac6a-40e09c234b75 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:30.033696 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:30.091359 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7643dbb8-dab0-42ea-ac6a-40e09c234b75 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:30.097443 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 264/517] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Sep 9 16:18:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 16:18:30.097443 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b2b31b-b9ea-4514-a100-adbb0bebbbaa None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:30.114406 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:30.127389 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a76787-ef39-4799-9c54-6e726256cfe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:30.128056 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a76787-ef39-4799-9c54-6e726256cfe9 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:30.128331 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a76787-ef39-4799-9c54-6e726256cfe9 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:30.128602 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a76787-ef39-4799-9c54-6e726256cfe9 None admin] PATH_INFO: `/v3/domains` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:30.129233 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a76787-ef39-4799-9c54-6e726256cfe9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:18:30.129533 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a76787-ef39-4799-9c54-6e726256cfe9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:30.130952 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a76787-ef39-4799-9c54-6e726256cfe9 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:30.144167 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 254/518] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Sep 9 16:18:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:18:30.145003 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a76787-ef39-4799-9c54-6e726256cfe9 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:30.197397 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b2b31b-b9ea-4514-a100-adbb0bebbbaa None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:30.232571 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68e84ba-a53a-46dc-b601-b1cea6462c60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:30.233236 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68e84ba-a53a-46dc-b601-b1cea6462c60 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:30.233515 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68e84ba-a53a-46dc-b601-b1cea6462c60 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:30.233780 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68e84ba-a53a-46dc-b601-b1cea6462c60 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:30.241123 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68e84ba-a53a-46dc-b601-b1cea6462c60 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:30.242599 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68e84ba-a53a-46dc-b601-b1cea6462c60 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:30.245023 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:30.246412 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a76787-ef39-4799-9c54-6e726256cfe9 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:30.256178 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-d68e84ba-a53a-46dc-b601-b1cea6462c60 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 09 16:18:30.256178 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:18:30.256178 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:18:30.256178 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:18:30.256178 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:18:30.256178 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:18:30.256178 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:18:30.256178 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:18:30.256178 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:18:30.256178 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:18:30.256178 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:18:30.256178 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:18:30.256178 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 16:18:30.256178 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 16:18:30.256178 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 16:18:30.256178 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 16:18:30.262010 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:18:30.262010 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:18:30.262010 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 16:18:30.262010 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 16:18:30.262010 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 16:18:30.262010 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 16:18:30.262010 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:18:30.262010 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:18:30.262010 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:18:30.262010 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:18:30.262010 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:18:30.262010 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Sep 09 16:18:30.262010 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:18:30.262010 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:18:30.262010 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:18:30.262010 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:18:30.262010 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:18:30.262010 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:18:30.263193 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:18:30.263193 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:18:30.263193 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 16:18:30.263193 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 16:18:30.263193 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 16:18:30.263193 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 16:18:30.263193 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 16:18:30.263193 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 16:18:30.263193 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 09 16:18:30.263193 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:18:30.263193 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 265/519] 10.222.0.27 () {56 vars in 1102 bytes} [Fri Sep 9 16:18:30 2022] GET /identity/v3/users/neutron => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:18:30.263193 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68e84ba-a53a-46dc-b601-b1cea6462c60 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:30.286714 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c335dc7f-b19f-4f7f-98e0-3393cb262985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:30.287414 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c335dc7f-b19f-4f7f-98e0-3393cb262985 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:30.287762 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c335dc7f-b19f-4f7f-98e0-3393cb262985 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:30.288094 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c335dc7f-b19f-4f7f-98e0-3393cb262985 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:30.298142 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c335dc7f-b19f-4f7f-98e0-3393cb262985 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:30.299711 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c335dc7f-b19f-4f7f-98e0-3393cb262985 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:30.314593 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-c335dc7f-b19f-4f7f-98e0-3393cb262985 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 16:18:30.314593 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:18:30.314593 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:18:30.314593 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:18:30.314593 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:18:30.314593 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:18:30.314593 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:18:30.314593 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:18:30.314593 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:18:30.314593 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:18:30.314593 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:18:30.314593 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:18:30.314593 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 16:18:30.314593 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 16:18:30.314593 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 16:18:30.314593 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 16:18:30.316147 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:18:30.316147 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:18:30.316147 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:18:30.316147 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:18:30.316147 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:18:30.316147 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:18:30.316147 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:18:30.316147 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 16:18:30.316147 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:18:30.316147 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:18:30.316147 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:18:30.316147 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:18:30.316147 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:18:30.316147 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:18:30.316147 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:18:30.316147 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:18:30.316147 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 16:18:30.317167 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 16:18:30.317167 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 16:18:30.317167 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 16:18:30.317833 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 255/520] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 16:18:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:18:30.319078 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c335dc7f-b19f-4f7f-98e0-3393cb262985 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:30.354068 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:30.373458 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68e84ba-a53a-46dc-b601-b1cea6462c60 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:30.407072 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2accd36e-0c73-482e-afc2-6ca1dc99e70b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:30.407674 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2accd36e-0c73-482e-afc2-6ca1dc99e70b None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:30.407953 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2accd36e-0c73-482e-afc2-6ca1dc99e70b None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:30.408223 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2accd36e-0c73-482e-afc2-6ca1dc99e70b None admin] PATH_INFO: `/v3/domains` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:30.408871 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2accd36e-0c73-482e-afc2-6ca1dc99e70b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:18:30.409176 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2accd36e-0c73-482e-afc2-6ca1dc99e70b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:30.410602 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2accd36e-0c73-482e-afc2-6ca1dc99e70b None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:30.420497 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c335dc7f-b19f-4f7f-98e0-3393cb262985 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:30.422231 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 266/521] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Sep 9 16:18:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:18:30.423063 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2accd36e-0c73-482e-afc2-6ca1dc99e70b None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:30.461100 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d3bab6-b996-43ef-995e-b321f8762c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:30.461639 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d3bab6-b996-43ef-995e-b321f8762c8f None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:30.461912 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d3bab6-b996-43ef-995e-b321f8762c8f None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:30.462184 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d3bab6-b996-43ef-995e-b321f8762c8f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:30.473147 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d3bab6-b996-43ef-995e-b321f8762c8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:30.474689 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d3bab6-b996-43ef-995e-b321f8762c8f None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:30.482653 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:30.489255 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-a8d3bab6-b996-43ef-995e-b321f8762c8f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 16:18:30.489255 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:18:30.489255 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:18:30.489255 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:18:30.489255 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:18:30.489255 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:18:30.489255 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:18:30.489255 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:18:30.489255 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:18:30.489255 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:18:30.489255 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:18:30.489255 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:18:30.489255 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 16:18:30.489255 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 16:18:30.489255 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 16:18:30.489255 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 16:18:30.490510 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:18:30.490510 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:18:30.490510 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:18:30.490510 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:18:30.490510 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:18:30.490510 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:18:30.490510 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:18:30.490510 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 16:18:30.490510 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:18:30.490510 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:18:30.490510 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:18:30.490510 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:18:30.490510 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:18:30.490510 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:18:30.490510 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:18:30.490510 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:18:30.490510 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 16:18:30.491532 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 16:18:30.491532 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 16:18:30.491532 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 16:18:30.491532 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 256/522] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 16:18:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:18:30.491532 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d3bab6-b996-43ef-995e-b321f8762c8f None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:30.529477 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2accd36e-0c73-482e-afc2-6ca1dc99e70b None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:30.563726 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86ca230-1e4c-4ac0-ac09-508156b4e003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:30.564343 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86ca230-1e4c-4ac0-ac09-508156b4e003 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:30.564618 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86ca230-1e4c-4ac0-ac09-508156b4e003 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:30.564884 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86ca230-1e4c-4ac0-ac09-508156b4e003 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:30.572174 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86ca230-1e4c-4ac0-ac09-508156b4e003 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:30.573614 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86ca230-1e4c-4ac0-ac09-508156b4e003 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:30.580741 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:30.585628 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-a86ca230-1e4c-4ac0-ac09-508156b4e003 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 16:18:30.585628 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:18:30.585628 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:18:30.585628 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:18:30.585628 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:18:30.585628 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:18:30.585628 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:18:30.585628 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:18:30.585628 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:18:30.585628 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:18:30.585628 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:18:30.585628 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:18:30.585628 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 16:18:30.585628 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 16:18:30.585628 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 16:18:30.586548 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 16:18:30.586548 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:18:30.586548 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:18:30.586548 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:18:30.586548 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:18:30.586548 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:18:30.586548 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:18:30.586548 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:18:30.586548 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Sep 09 16:18:30.586548 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:18:30.586548 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:18:30.586548 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:18:30.586548 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:18:30.586548 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:18:30.586548 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:18:30.586548 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:18:30.586548 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:18:30.587500 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 16:18:30.587500 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 16:18:30.587500 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 16:18:30.587500 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 16:18:30.587500 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 16:18:30.587500 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 16:18:30.587500 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 16:18:30.587500 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:18:30.587500 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 267/523] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Sep 9 16:18:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:18:30.587500 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86ca230-1e4c-4ac0-ac09-508156b4e003 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:30.598846 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d3bab6-b996-43ef-995e-b321f8762c8f None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:30.632600 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec5b191-9435-4224-8e9a-df191458ed4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:30.633194 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec5b191-9435-4224-8e9a-df191458ed4a None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:30.633470 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec5b191-9435-4224-8e9a-df191458ed4a None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:30.633723 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec5b191-9435-4224-8e9a-df191458ed4a None admin] PATH_INFO: `/v3/users` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:30.634476 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec5b191-9435-4224-8e9a-df191458ed4a None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:18:30.634772 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec5b191-9435-4224-8e9a-df191458ed4a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:30.636308 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec5b191-9435-4224-8e9a-df191458ed4a None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:30.654647 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 257/524] 10.222.0.27 () {56 vars in 1139 bytes} [Fri Sep 9 16:18:30 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:18:30.655448 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec5b191-9435-4224-8e9a-df191458ed4a None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:30.688481 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86ca230-1e4c-4ac0-ac09-508156b4e003 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:30.710607 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:30.726880 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4be1eff-de98-48c4-b89a-abe6d1d37e0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:30.727419 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4be1eff-de98-48c4-b89a-abe6d1d37e0a None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:30.727696 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4be1eff-de98-48c4-b89a-abe6d1d37e0a None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:30.727992 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4be1eff-de98-48c4-b89a-abe6d1d37e0a None admin] PATH_INFO: `/v3/domains` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:30.728631 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4be1eff-de98-48c4-b89a-abe6d1d37e0a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:18:30.728929 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4be1eff-de98-48c4-b89a-abe6d1d37e0a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:30.730324 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4be1eff-de98-48c4-b89a-abe6d1d37e0a None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:30.742054 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 268/525] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Sep 9 16:18:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:18:30.742967 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4be1eff-de98-48c4-b89a-abe6d1d37e0a None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:30.761304 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec5b191-9435-4224-8e9a-df191458ed4a None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:30.796620 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80096c4b-4f69-4c25-819c-5e8056112f57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:30.797220 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80096c4b-4f69-4c25-819c-5e8056112f57 None admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:30.797497 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80096c4b-4f69-4c25-819c-5e8056112f57 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:30.797765 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80096c4b-4f69-4c25-819c-5e8056112f57 None admin] PATH_INFO: `/v3/users` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:30.798432 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80096c4b-4f69-4c25-819c-5e8056112f57 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:30.799860 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80096c4b-4f69-4c25-819c-5e8056112f57 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:30.816742 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:30.821721 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 258/526] 10.222.0.27 () {60 vars in 1132 bytes} [Fri Sep 9 16:18:30 2022] POST /identity/v3/users => generated 247 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:18:30.822705 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80096c4b-4f69-4c25-819c-5e8056112f57 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:30.845621 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4be1eff-de98-48c4-b89a-abe6d1d37e0a None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:30.884634 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67637ad8-08d8-41e0-a06b-3d48254b1d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:30.885247 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67637ad8-08d8-41e0-a06b-3d48254b1d5d None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:30.885711 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67637ad8-08d8-41e0-a06b-3d48254b1d5d None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:30.885986 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67637ad8-08d8-41e0-a06b-3d48254b1d5d None admin] PATH_INFO: `/v3/domains` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:30.887122 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67637ad8-08d8-41e0-a06b-3d48254b1d5d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:18:30.887432 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67637ad8-08d8-41e0-a06b-3d48254b1d5d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:30.888827 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67637ad8-08d8-41e0-a06b-3d48254b1d5d None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:30.901303 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 269/527] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Sep 9 16:18:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:18:30.902158 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67637ad8-08d8-41e0-a06b-3d48254b1d5d None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:30.948004 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:30.953984 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80096c4b-4f69-4c25-819c-5e8056112f57 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:30.991502 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252db627-87a5-42f5-9f89-b8938f0cce72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:30.992758 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252db627-87a5-42f5-9f89-b8938f0cce72 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:30.992758 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252db627-87a5-42f5-9f89-b8938f0cce72 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:30.992758 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252db627-87a5-42f5-9f89-b8938f0cce72 None admin] PATH_INFO: `/v3/projects` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:30.993297 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252db627-87a5-42f5-9f89-b8938f0cce72 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:18:30.993608 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252db627-87a5-42f5-9f89-b8938f0cce72 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:30.995078 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252db627-87a5-42f5-9f89-b8938f0cce72 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:31.014239 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 259/528] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Sep 9 16:18:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:18:31.015412 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252db627-87a5-42f5-9f89-b8938f0cce72 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:31.024691 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67637ad8-08d8-41e0-a06b-3d48254b1d5d None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:31.075944 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5316b10-b361-4798-97ad-b5cf7c1ce4ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:31.075944 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5316b10-b361-4798-97ad-b5cf7c1ce4ba None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:31.076229 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5316b10-b361-4798-97ad-b5cf7c1ce4ba None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:31.076596 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5316b10-b361-4798-97ad-b5cf7c1ce4ba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:31.103153 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:31.148459 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252db627-87a5-42f5-9f89-b8938f0cce72 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:31.159659 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5316b10-b361-4798-97ad-b5cf7c1ce4ba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:31.161218 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5316b10-b361-4798-97ad-b5cf7c1ce4ba None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:31.185639 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8b7311-1f03-4066-af44-87bea08caf2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:31.186390 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8b7311-1f03-4066-af44-87bea08caf2f None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:31.186783 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8b7311-1f03-4066-af44-87bea08caf2f None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:31.187115 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8b7311-1f03-4066-af44-87bea08caf2f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:31.195424 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8b7311-1f03-4066-af44-87bea08caf2f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:31.196956 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8b7311-1f03-4066-af44-87bea08caf2f None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:31.206349 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:31.210712 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-2d8b7311-1f03-4066-af44-87bea08caf2f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 16:18:31.210712 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:18:31.210712 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:18:31.210712 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:18:31.210712 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:18:31.210712 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:18:31.210712 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:18:31.210712 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:18:31.210712 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:18:31.210712 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:18:31.210712 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:18:31.210712 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:18:31.210712 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 16:18:31.210712 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 16:18:31.210712 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 16:18:31.211726 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 16:18:31.211726 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:18:31.211726 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:18:31.211726 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:18:31.211726 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:18:31.211726 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:18:31.211726 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:18:31.211726 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:18:31.211726 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 16:18:31.211726 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:18:31.211726 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:18:31.211726 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:18:31.211726 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:18:31.211726 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:18:31.211726 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:18:31.211726 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:18:31.211726 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:18:31.212678 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 16:18:31.212678 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 16:18:31.212678 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 16:18:31.212678 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 16:18:31.212678 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 16:18:31.212678 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 16:18:31.212678 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 16:18:31.212678 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 16:18:31.217842 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 260/529] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Sep 9 16:18:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:18:31.218795 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8b7311-1f03-4066-af44-87bea08caf2f None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:31.273152 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 270/530] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Sep 9 16:18:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 16:18:31.274332 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5316b10-b361-4798-97ad-b5cf7c1ce4ba None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:31.332369 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8b7311-1f03-4066-af44-87bea08caf2f None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:31.356558 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:31.371919 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4845619a-a232-4348-9d31-d0293aa7b4ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:31.372708 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4845619a-a232-4348-9d31-d0293aa7b4ee None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:31.373329 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4845619a-a232-4348-9d31-d0293aa7b4ee None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:31.373329 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4845619a-a232-4348-9d31-d0293aa7b4ee None admin] PATH_INFO: `/v3/projects/service` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:31.380712 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4845619a-a232-4348-9d31-d0293aa7b4ee None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:31.382370 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4845619a-a232-4348-9d31-d0293aa7b4ee None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:31.394297 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-4845619a-a232-4348-9d31-d0293aa7b4ee None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 16:18:31.394297 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:18:31.394297 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:18:31.394297 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:18:31.394297 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:18:31.394297 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:18:31.394297 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:18:31.394297 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:18:31.394297 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:18:31.394297 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:18:31.394297 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:18:31.394297 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:18:31.394297 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 16:18:31.394297 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 16:18:31.394297 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 16:18:31.395209 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 16:18:31.395209 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:18:31.395209 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:18:31.395209 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:18:31.395209 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:18:31.395209 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:18:31.395209 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:18:31.395209 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:18:31.395209 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 16:18:31.395209 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:18:31.395209 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:18:31.395209 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:18:31.395209 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:18:31.395209 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:18:31.395209 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:18:31.395209 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:18:31.395209 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:18:31.396061 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 16:18:31.396061 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 16:18:31.396061 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 16:18:31.396061 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 16:18:31.396061 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 16:18:31.396061 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 16:18:31.396061 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 16:18:31.396061 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 16:18:31.400461 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 261/531] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Sep 9 16:18:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:18:31.401306 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4845619a-a232-4348-9d31-d0293aa7b4ee None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:31.401497 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5316b10-b361-4798-97ad-b5cf7c1ce4ba None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:31.442808 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369f4aa3-2b91-46e4-a526-59e3f4af0921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:31.444222 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369f4aa3-2b91-46e4-a526-59e3f4af0921 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:31.444835 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369f4aa3-2b91-46e4-a526-59e3f4af0921 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:31.445277 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369f4aa3-2b91-46e4-a526-59e3f4af0921 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:31.446265 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369f4aa3-2b91-46e4-a526-59e3f4af0921 None admin] RBAC: Adding query filter params (role.id=1966594501e743aebf757851d9cd82a5, scope.project.id=68d6aaafab824657b08ca91f3d46d5f8, user.id=a332b9b4980646a3b14633293f77b505) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:18:31.447118 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369f4aa3-2b91-46e4-a526-59e3f4af0921 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:31.449097 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369f4aa3-2b91-46e4-a526-59e3f4af0921 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:31.457010 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 271/532] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Sep 9 16:18:31 2022] GET /identity/v3/role_assignments?user.id=a332b9b4980646a3b14633293f77b505&scope.project.id=68d6aaafab824657b08ca91f3d46d5f8&role.id=1966594501e743aebf757851d9cd82a5 => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:18:31.458694 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369f4aa3-2b91-46e4-a526-59e3f4af0921 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:31.469629 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:31.530093 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4845619a-a232-4348-9d31-d0293aa7b4ee None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:31.569574 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855d4681-57d7-4211-a227-900ad1ddba6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:31.570186 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855d4681-57d7-4211-a227-900ad1ddba6a None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:31.570492 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855d4681-57d7-4211-a227-900ad1ddba6a None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:31.570759 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855d4681-57d7-4211-a227-900ad1ddba6a None admin] PATH_INFO: `/v3/projects` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:31.571457 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855d4681-57d7-4211-a227-900ad1ddba6a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:18:31.571827 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855d4681-57d7-4211-a227-900ad1ddba6a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:31.573336 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855d4681-57d7-4211-a227-900ad1ddba6a None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:31.589497 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 262/533] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Sep 9 16:18:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:18:31.590499 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855d4681-57d7-4211-a227-900ad1ddba6a None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:31.611235 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369f4aa3-2b91-46e4-a526-59e3f4af0921 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:31.637307 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:31.664678 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef81583c-a5d4-4461-bb88-258eb996e5bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:31.666172 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef81583c-a5d4-4461-bb88-258eb996e5bb None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:31.666616 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef81583c-a5d4-4461-bb88-258eb996e5bb None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:31.667220 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef81583c-a5d4-4461-bb88-258eb996e5bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:31.681295 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef81583c-a5d4-4461-bb88-258eb996e5bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:31.682805 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef81583c-a5d4-4461-bb88-258eb996e5bb None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:31.698963 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-ef81583c-a5d4-4461-bb88-258eb996e5bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 16:18:31.698963 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:18:31.698963 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:18:31.698963 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:18:31.698963 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:18:31.698963 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:18:31.698963 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:18:31.698963 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:18:31.698963 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:18:31.698963 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:18:31.698963 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:18:31.698963 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:18:31.698963 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 16:18:31.698963 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 16:18:31.698963 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 16:18:31.698963 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 16:18:31.700301 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:18:31.700301 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:18:31.700301 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:18:31.700301 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:18:31.700301 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:18:31.700301 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:18:31.700301 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:18:31.700301 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Sep 09 16:18:31.700301 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:18:31.700301 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:18:31.700301 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:18:31.700301 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:18:31.700301 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:18:31.700301 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:18:31.700301 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:18:31.700301 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:18:31.700301 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 16:18:31.701126 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 16:18:31.701126 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 16:18:31.701126 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:18:31.703314 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 272/534] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 16:18:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:18:31.704306 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef81583c-a5d4-4461-bb88-258eb996e5bb None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:31.712237 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855d4681-57d7-4211-a227-900ad1ddba6a None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:31.747927 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc19de0-4b5a-439d-81d4-09b7431fc606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:31.748536 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc19de0-4b5a-439d-81d4-09b7431fc606 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:31.748811 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc19de0-4b5a-439d-81d4-09b7431fc606 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:31.749080 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc19de0-4b5a-439d-81d4-09b7431fc606 None admin] PATH_INFO: `/v3/projects` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:31.749819 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc19de0-4b5a-439d-81d4-09b7431fc606 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:18:31.750130 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc19de0-4b5a-439d-81d4-09b7431fc606 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:31.751590 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc19de0-4b5a-439d-81d4-09b7431fc606 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:31.764255 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 263/535] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Sep 9 16:18:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:18:31.764956 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc19de0-4b5a-439d-81d4-09b7431fc606 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:31.773468 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:31.823253 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef81583c-a5d4-4461-bb88-258eb996e5bb None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:31.861227 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e4bc31-eb98-44cd-80e0-3daeabc3789d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:31.862247 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e4bc31-eb98-44cd-80e0-3daeabc3789d None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:31.862782 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e4bc31-eb98-44cd-80e0-3daeabc3789d None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:31.863265 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e4bc31-eb98-44cd-80e0-3daeabc3789d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:31.864235 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e4bc31-eb98-44cd-80e0-3daeabc3789d None admin] RBAC: Adding query filter params (role.id=1966594501e743aebf757851d9cd82a5, scope.project.id=68d6aaafab824657b08ca91f3d46d5f8, user.id=3ddd42508eee4412ae139cb8526090d6) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:18:31.864739 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e4bc31-eb98-44cd-80e0-3daeabc3789d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:31.866736 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e4bc31-eb98-44cd-80e0-3daeabc3789d None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:31.869526 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:31.872360 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc19de0-4b5a-439d-81d4-09b7431fc606 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:31.878658 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 273/536] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Sep 9 16:18:31 2022] GET /identity/v3/role_assignments?user.id=3ddd42508eee4412ae139cb8526090d6&scope.project.id=68d6aaafab824657b08ca91f3d46d5f8&role.id=1966594501e743aebf757851d9cd82a5 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:18:31.879870 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e4bc31-eb98-44cd-80e0-3daeabc3789d None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:31.910232 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb47ed0-50b7-4db7-9ad8-da459eb8ed54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:31.910882 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb47ed0-50b7-4db7-9ad8-da459eb8ed54 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:31.911157 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb47ed0-50b7-4db7-9ad8-da459eb8ed54 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:31.911439 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb47ed0-50b7-4db7-9ad8-da459eb8ed54 None admin] PATH_INFO: `/v3/domains` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:31.912069 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb47ed0-50b7-4db7-9ad8-da459eb8ed54 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:18:31.912370 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb47ed0-50b7-4db7-9ad8-da459eb8ed54 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:31.913748 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb47ed0-50b7-4db7-9ad8-da459eb8ed54 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:31.926032 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 264/537] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Sep 9 16:18:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:18:31.938334 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb47ed0-50b7-4db7-9ad8-da459eb8ed54 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:32.027416 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e4bc31-eb98-44cd-80e0-3daeabc3789d None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:32.051169 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:32.056643 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb47ed0-50b7-4db7-9ad8-da459eb8ed54 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:32.069749 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499649c1-0b51-4555-8379-85096ca6e7bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:32.070752 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499649c1-0b51-4555-8379-85096ca6e7bf None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:32.071262 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499649c1-0b51-4555-8379-85096ca6e7bf None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:32.071772 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499649c1-0b51-4555-8379-85096ca6e7bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:32.072864 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499649c1-0b51-4555-8379-85096ca6e7bf None admin] RBAC: Adding query filter params (role.id=1966594501e743aebf757851d9cd82a5, scope.project.id=68d6aaafab824657b08ca91f3d46d5f8, user.id=8078e791ba68460f8b3aeafb4b79b73a) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:18:32.073446 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499649c1-0b51-4555-8379-85096ca6e7bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:32.075151 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499649c1-0b51-4555-8379-85096ca6e7bf None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:32.082281 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 274/538] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Sep 9 16:18:31 2022] GET /identity/v3/role_assignments?user.id=8078e791ba68460f8b3aeafb4b79b73a&scope.project.id=68d6aaafab824657b08ca91f3d46d5f8&role.id=1966594501e743aebf757851d9cd82a5 => generated 259 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:18:32.102615 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac90af9-c635-4109-9a7f-45eb19f4a0c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:32.103266 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac90af9-c635-4109-9a7f-45eb19f4a0c5 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:32.103548 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac90af9-c635-4109-9a7f-45eb19f4a0c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:32.103819 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac90af9-c635-4109-9a7f-45eb19f4a0c5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:32.116897 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac90af9-c635-4109-9a7f-45eb19f4a0c5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:32.118470 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac90af9-c635-4109-9a7f-45eb19f4a0c5 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:32.131944 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-5ac90af9-c635-4109-9a7f-45eb19f4a0c5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 16:18:32.131944 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:18:32.131944 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:18:32.131944 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:18:32.131944 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:18:32.131944 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:18:32.131944 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:18:32.131944 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:18:32.131944 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:18:32.131944 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:18:32.131944 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:18:32.131944 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:18:32.131944 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 16:18:32.131944 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 16:18:32.131944 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 16:18:32.132852 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 16:18:32.132852 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:18:32.132852 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:18:32.132852 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:18:32.132852 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:18:32.132852 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:18:32.132852 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:18:32.132852 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:18:32.132852 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 16:18:32.132852 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:18:32.132852 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:18:32.132852 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:18:32.132852 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:18:32.132852 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:18:32.132852 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:18:32.132852 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:18:32.132852 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:18:32.133695 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 16:18:32.133695 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 16:18:32.133695 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 16:18:32.133695 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 16:18:32.133695 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 16:18:32.133695 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 16:18:32.133695 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 16:18:32.133695 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 16:18:32.133695 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 265/539] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Sep 9 16:18:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:18:32.139352 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499649c1-0b51-4555-8379-85096ca6e7bf None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:32.307419 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499649c1-0b51-4555-8379-85096ca6e7bf None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:32.348544 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e83dc03-50bb-4b40-8d13-759c92d99613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:32.349088 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e83dc03-50bb-4b40-8d13-759c92d99613 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:32.349368 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e83dc03-50bb-4b40-8d13-759c92d99613 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:32.349641 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e83dc03-50bb-4b40-8d13-759c92d99613 None admin] PATH_INFO: `/v3/projects` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:32.350420 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e83dc03-50bb-4b40-8d13-759c92d99613 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:18:32.350725 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e83dc03-50bb-4b40-8d13-759c92d99613 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:32.352166 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e83dc03-50bb-4b40-8d13-759c92d99613 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:32.370829 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 275/540] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Sep 9 16:18:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:18:32.376560 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac90af9-c635-4109-9a7f-45eb19f4a0c5 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:32.402419 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:32.485467 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac90af9-c635-4109-9a7f-45eb19f4a0c5 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:32.522605 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7f2a33-c52c-4fc3-b1b2-6c4a3ca10af9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:32.523229 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7f2a33-c52c-4fc3-b1b2-6c4a3ca10af9 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:32.523509 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7f2a33-c52c-4fc3-b1b2-6c4a3ca10af9 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:32.523782 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7f2a33-c52c-4fc3-b1b2-6c4a3ca10af9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:32.524516 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7f2a33-c52c-4fc3-b1b2-6c4a3ca10af9 None admin] RBAC: Adding query filter params (role.id=1966594501e743aebf757851d9cd82a5, scope.project.id=68d6aaafab824657b08ca91f3d46d5f8, user.id=d5f44bfdd5214e8d84a2c0a5b1fd9b84) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:18:32.524822 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7f2a33-c52c-4fc3-b1b2-6c4a3ca10af9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:32.526287 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7f2a33-c52c-4fc3-b1b2-6c4a3ca10af9 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:32.532654 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 266/541] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Sep 9 16:18:32 2022] GET /identity/v3/role_assignments?user.id=d5f44bfdd5214e8d84a2c0a5b1fd9b84&scope.project.id=68d6aaafab824657b08ca91f3d46d5f8&role.id=1966594501e743aebf757851d9cd82a5 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:18:33.230929 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd356d11-ee5a-482a-9b7f-8787d8435896 None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:33.231976 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd356d11-ee5a-482a-9b7f-8787d8435896 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:33.232449 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd356d11-ee5a-482a-9b7f-8787d8435896 None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:33.234370 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 276/542] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:18:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:18:33.240448 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf32218-e693-45af-838f-ca62088cdf91 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:33.241236 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf32218-e693-45af-838f-ca62088cdf91 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:33.241701 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf32218-e693-45af-838f-ca62088cdf91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:33.265331 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-7cf32218-e693-45af-838f-ca62088cdf91 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:18:33.266843 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-7cf32218-e693-45af-838f-ca62088cdf91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:18:33.384296 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 267/543] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:18:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 16:18:33.828626 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd356d11-ee5a-482a-9b7f-8787d8435896 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:33.896914 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:33.979355 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd356d11-ee5a-482a-9b7f-8787d8435896 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:34.022794 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf933ff-21ec-4aa0-a0ec-3b286941ef37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:34.023420 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf933ff-21ec-4aa0-a0ec-3b286941ef37 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:34.023702 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf933ff-21ec-4aa0-a0ec-3b286941ef37 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:34.023971 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf933ff-21ec-4aa0-a0ec-3b286941ef37 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:34.034986 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf933ff-21ec-4aa0-a0ec-3b286941ef37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 16:18:34.039797 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-9bf933ff-21ec-4aa0-a0ec-3b286941ef37 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 16:18:34.039797 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:18:34.039797 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:18:34.039797 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:18:34.039797 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:18:34.039797 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:18:34.039797 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:18:34.039797 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:18:34.039797 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:18:34.039797 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:18:34.039797 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:18:34.039797 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:18:34.039797 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 16:18:34.039797 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 16:18:34.039797 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 16:18:34.039797 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 16:18:34.040664 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 16:18:34.040664 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 16:18:34.040664 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 16:18:34.040664 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 16:18:34.040664 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:18:34.040664 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:18:34.040664 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:18:34.040664 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:18:34.040664 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:18:34.040664 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:18:34.040664 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:18:34.040664 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Sep 09 16:18:34.040664 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:18:34.040664 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:18:34.040664 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:18:34.040664 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:18:34.041675 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:18:34.041675 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:18:34.041675 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:18:34.041675 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:18:34.041675 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 16:18:34.041675 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 16:18:34.041675 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 16:18:34.041675 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 16:18:34.041675 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 16:18:34.041675 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 16:18:34.041675 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 16:18:34.041675 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:18:34.041675 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 277/544] 10.222.0.27 () {56 vars in 1102 bytes} [Fri Sep 9 16:18:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:18:34.046668 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf32218-e693-45af-838f-ca62088cdf91 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:34.059061 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6144886-76fa-415d-8188-d312085be3ae None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:34.059818 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6144886-76fa-415d-8188-d312085be3ae None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:34.060265 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6144886-76fa-415d-8188-d312085be3ae None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:34.063003 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 278/545] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:18:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 16:18:34.067095 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f888696-a6a3-4b99-a35f-2dd55ddf40ae None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:34.067615 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f888696-a6a3-4b99-a35f-2dd55ddf40ae None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:34.068120 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f888696-a6a3-4b99-a35f-2dd55ddf40ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:34.081531 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:34.093153 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-9f888696-a6a3-4b99-a35f-2dd55ddf40ae None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:18:34.094628 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-9f888696-a6a3-4b99-a35f-2dd55ddf40ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:18:34.209758 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf32218-e693-45af-838f-ca62088cdf91 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:34.229472 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 279/546] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:18:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 16:18:34.262929 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426f616f-8dd7-47ea-9b8e-b0a8a68d24ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:34.263563 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426f616f-8dd7-47ea-9b8e-b0a8a68d24ad None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:34.263792 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426f616f-8dd7-47ea-9b8e-b0a8a68d24ad None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:34.264058 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426f616f-8dd7-47ea-9b8e-b0a8a68d24ad None admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:34.264773 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426f616f-8dd7-47ea-9b8e-b0a8a68d24ad None admin] RBAC: Adding query filter params (name=service) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:18:34.265071 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426f616f-8dd7-47ea-9b8e-b0a8a68d24ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:34.266498 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426f616f-8dd7-47ea-9b8e-b0a8a68d24ad None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:34.277871 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 268/547] 10.222.0.27 () {56 vars in 1103 bytes} [Fri Sep 9 16:18:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:18:34.286327 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f888696-a6a3-4b99-a35f-2dd55ddf40ae None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:34.337805 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:34.438862 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f888696-a6a3-4b99-a35f-2dd55ddf40ae None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:34.490097 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63900380-830c-4442-b5ca-d6a3c63b8649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:34.490753 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63900380-830c-4442-b5ca-d6a3c63b8649 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:34.491029 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63900380-830c-4442-b5ca-d6a3c63b8649 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:34.491294 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63900380-830c-4442-b5ca-d6a3c63b8649 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:34.510000 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63900380-830c-4442-b5ca-d6a3c63b8649 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:34.511513 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63900380-830c-4442-b5ca-d6a3c63b8649 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:34.529011 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-63900380-830c-4442-b5ca-d6a3c63b8649 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 16:18:34.529011 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:18:34.529011 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:18:34.529011 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:18:34.529011 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:18:34.529011 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:18:34.529011 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:18:34.529011 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:18:34.529011 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:18:34.529011 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:18:34.529011 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:18:34.529011 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:18:34.529011 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 16:18:34.529011 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 16:18:34.529011 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 16:18:34.529011 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 16:18:34.529943 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:18:34.529943 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:18:34.529943 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:18:34.529943 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:18:34.529943 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:18:34.529943 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:18:34.529943 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:18:34.529943 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Sep 09 16:18:34.529943 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:18:34.529943 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:18:34.529943 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:18:34.529943 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:18:34.529943 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:18:34.529943 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:18:34.529943 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:18:34.529943 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:18:34.529943 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 16:18:34.530841 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 16:18:34.530841 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 16:18:34.530841 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:18:34.534559 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 280/548] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 16:18:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:18:34.536694 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426f616f-8dd7-47ea-9b8e-b0a8a68d24ad None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:34.622502 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:34.641604 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63900380-830c-4442-b5ca-d6a3c63b8649 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:34.646910 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426f616f-8dd7-47ea-9b8e-b0a8a68d24ad None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:34.682125 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1a0b73-af1b-4866-a7a4-e9b427f5a0ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:34.682778 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1a0b73-af1b-4866-a7a4-e9b427f5a0ec None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:34.683056 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1a0b73-af1b-4866-a7a4-e9b427f5a0ec None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:34.683324 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1a0b73-af1b-4866-a7a4-e9b427f5a0ec None admin] PATH_INFO: `/v3/domains` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:34.683961 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1a0b73-af1b-4866-a7a4-e9b427f5a0ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:18:34.684510 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1a0b73-af1b-4866-a7a4-e9b427f5a0ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:34.685895 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1a0b73-af1b-4866-a7a4-e9b427f5a0ec None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:34.716731 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 269/549] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Sep 9 16:18:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:18:34.733535 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1a0b73-af1b-4866-a7a4-e9b427f5a0ec None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:34.770117 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:34.788946 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63900380-830c-4442-b5ca-d6a3c63b8649 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:34.825521 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3458b04d-9950-4bad-9323-62269733f956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:34.826252 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3458b04d-9950-4bad-9323-62269733f956 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:34.826557 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3458b04d-9950-4bad-9323-62269733f956 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:34.826823 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3458b04d-9950-4bad-9323-62269733f956 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:34.839017 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3458b04d-9950-4bad-9323-62269733f956 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 16:18:34.844977 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-3458b04d-9950-4bad-9323-62269733f956 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 16:18:34.844977 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:18:34.844977 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:18:34.844977 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:18:34.844977 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:18:34.844977 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:18:34.844977 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:18:34.844977 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:18:34.844977 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:18:34.844977 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:18:34.844977 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:18:34.844977 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:18:34.844977 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 16:18:34.844977 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 16:18:34.844977 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 16:18:34.844977 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 16:18:34.846984 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 16:18:34.846984 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 16:18:34.846984 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 16:18:34.846984 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 16:18:34.846984 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:18:34.846984 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:18:34.846984 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:18:34.846984 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:18:34.846984 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:18:34.846984 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:18:34.846984 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:18:34.846984 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Sep 09 16:18:34.846984 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:18:34.846984 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:18:34.846984 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:18:34.846984 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:18:34.849053 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:18:34.849053 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:18:34.849053 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:18:34.849053 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:18:34.849053 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 16:18:34.849053 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 16:18:34.849053 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 16:18:34.849053 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 16:18:34.849053 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 16:18:34.849053 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 16:18:34.849053 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 16:18:34.849053 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:18:34.849053 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 281/550] 10.222.0.27 () {56 vars in 1102 bytes} [Fri Sep 9 16:18:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 16:18:34.852877 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3458b04d-9950-4bad-9323-62269733f956 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:34.892993 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1a0b73-af1b-4866-a7a4-e9b427f5a0ec None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:34.928408 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a666b93-d993-4029-a526-a44e58ffb0d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:34.929053 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a666b93-d993-4029-a526-a44e58ffb0d7 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:34.929332 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a666b93-d993-4029-a526-a44e58ffb0d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:34.929600 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a666b93-d993-4029-a526-a44e58ffb0d7 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:34.933472 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:34.944673 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a666b93-d993-4029-a526-a44e58ffb0d7 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:34.946354 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a666b93-d993-4029-a526-a44e58ffb0d7 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:34.960242 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-4a666b93-d993-4029-a526-a44e58ffb0d7 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 09 16:18:34.960242 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:18:34.960242 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:18:34.960242 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:18:34.960242 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:18:34.960242 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:18:34.960242 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:18:34.960242 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:18:34.960242 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:18:34.960242 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:18:34.960242 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:18:34.960242 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:18:34.960242 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 16:18:34.960242 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 16:18:34.960242 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 16:18:34.960242 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 16:18:34.962575 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:18:34.962575 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:18:34.962575 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 16:18:34.962575 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 16:18:34.962575 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 16:18:34.962575 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 16:18:34.962575 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:18:34.962575 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:18:34.962575 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:18:34.962575 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:18:34.962575 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:18:34.962575 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 16:18:34.962575 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:18:34.962575 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:18:34.962575 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:18:34.962575 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:18:34.962575 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:18:34.962575 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:18:34.965013 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:18:34.965013 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:18:34.965013 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 16:18:34.965013 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 16:18:34.965013 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 16:18:34.965013 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 16:18:34.965013 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 16:18:34.965013 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 16:18:34.965013 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 09 16:18:34.965013 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 16:18:34.965013 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 270/551] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Sep 9 16:18:34 2022] GET /identity/v3/users/swift => generated 83 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:18:34.965013 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2aaa80-9bd7-49ac-878b-61d87d1e4c94 None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:34.965013 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2aaa80-9bd7-49ac-878b-61d87d1e4c94 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:34.968522 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2aaa80-9bd7-49ac-878b-61d87d1e4c94 None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:34.968522 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 271/552] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:18:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:18:34.971452 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2aaa80-9bd7-49ac-878b-61d87d1e4c94 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:34.981546 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3458b04d-9950-4bad-9323-62269733f956 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:35.029085 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41a10bb-e202-488c-8323-45d2c7433001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:35.029708 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41a10bb-e202-488c-8323-45d2c7433001 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:35.029988 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41a10bb-e202-488c-8323-45d2c7433001 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:35.030260 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41a10bb-e202-488c-8323-45d2c7433001 None admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:35.030957 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41a10bb-e202-488c-8323-45d2c7433001 None admin] RBAC: Adding query filter params (name=service) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:18:35.031260 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41a10bb-e202-488c-8323-45d2c7433001 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:35.032805 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41a10bb-e202-488c-8323-45d2c7433001 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:35.042766 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 282/553] 10.222.0.27 () {56 vars in 1103 bytes} [Fri Sep 9 16:18:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 16:18:35.044584 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644413ab-59b1-4828-8073-0556ca961050 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:35.044955 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644413ab-59b1-4828-8073-0556ca961050 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:35.045372 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644413ab-59b1-4828-8073-0556ca961050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:35.063773 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-644413ab-59b1-4828-8073-0556ca961050 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:18:35.064962 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-644413ab-59b1-4828-8073-0556ca961050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:18:35.067876 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:35.091458 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2aaa80-9bd7-49ac-878b-61d87d1e4c94 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:35.124302 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f05b3d-5541-470c-b88c-d612acf57951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:35.124896 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f05b3d-5541-470c-b88c-d612acf57951 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:35.125168 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f05b3d-5541-470c-b88c-d612acf57951 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:35.125439 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f05b3d-5541-470c-b88c-d612acf57951 None admin] PATH_INFO: `/v3/users` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:35.126140 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f05b3d-5541-470c-b88c-d612acf57951 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:18:35.126467 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f05b3d-5541-470c-b88c-d612acf57951 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:35.128408 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f05b3d-5541-470c-b88c-d612acf57951 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:35.132925 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 283/554] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:18:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 16:18:35.134223 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103ec2db-80e6-4819-8bb1-03ab249859c7 None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:35.134536 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103ec2db-80e6-4819-8bb1-03ab249859c7 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:35.134831 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103ec2db-80e6-4819-8bb1-03ab249859c7 None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:35.136199 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 284/555] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:18:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:18:35.139060 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103ec2db-80e6-4819-8bb1-03ab249859c7 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:35.158747 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 272/556] 10.222.0.27 () {56 vars in 1135 bytes} [Fri Sep 9 16:18:34 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:18:35.160203 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c0fd5a-807e-46b4-9a62-a4de6056950f None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:35.160655 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c0fd5a-807e-46b4-9a62-a4de6056950f None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:35.161131 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c0fd5a-807e-46b4-9a62-a4de6056950f None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:35.162507 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 273/557] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:18:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:18:35.167234 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dd4df6-ac16-43c7-ba3f-9e85ef825982 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:35.167517 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dd4df6-ac16-43c7-ba3f-9e85ef825982 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:35.167788 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dd4df6-ac16-43c7-ba3f-9e85ef825982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:35.188875 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-b5dd4df6-ac16-43c7-ba3f-9e85ef825982 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:18:35.190711 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-b5dd4df6-ac16-43c7-ba3f-9e85ef825982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:18:35.241513 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:35.250789 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103ec2db-80e6-4819-8bb1-03ab249859c7 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:35.259379 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 274/558] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:18:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 16:18:35.260006 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dd4df6-ac16-43c7-ba3f-9e85ef825982 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:35.321719 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34c8875-88c2-4d99-9f81-824359ae4077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:35.323032 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34c8875-88c2-4d99-9f81-824359ae4077 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:35.323524 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34c8875-88c2-4d99-9f81-824359ae4077 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:35.323998 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34c8875-88c2-4d99-9f81-824359ae4077 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:35.331916 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:35.337646 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34c8875-88c2-4d99-9f81-824359ae4077 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:35.339441 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34c8875-88c2-4d99-9f81-824359ae4077 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:35.357722 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-e34c8875-88c2-4d99-9f81-824359ae4077 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 16:18:35.357722 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:18:35.357722 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:18:35.357722 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:18:35.357722 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:18:35.357722 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:18:35.357722 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:18:35.357722 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:18:35.357722 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:18:35.357722 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:18:35.357722 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:18:35.357722 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:18:35.357722 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 16:18:35.357722 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 16:18:35.357722 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 16:18:35.357722 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 16:18:35.358709 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:18:35.358709 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:18:35.358709 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:18:35.358709 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:18:35.358709 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:18:35.358709 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:18:35.358709 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:18:35.358709 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Sep 09 16:18:35.358709 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:18:35.358709 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:18:35.358709 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:18:35.358709 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:18:35.358709 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:18:35.358709 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:18:35.358709 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:18:35.358709 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:18:35.358709 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 16:18:35.365074 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 16:18:35.365074 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 16:18:35.365074 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:18:35.365074 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 285/559] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 16:18:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:18:35.365074 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a8da77-5c94-41e3-95bc-92fc74a06b28 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:35.365074 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a8da77-5c94-41e3-95bc-92fc74a06b28 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:35.365074 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a8da77-5c94-41e3-95bc-92fc74a06b28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:35.382106 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dd4df6-ac16-43c7-ba3f-9e85ef825982 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:35.388830 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-e5a8da77-5c94-41e3-95bc-92fc74a06b28 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:18:35.390751 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-e5a8da77-5c94-41e3-95bc-92fc74a06b28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:18:35.416891 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81feb821-9d68-4d4d-a279-ec25e545373f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:35.417500 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81feb821-9d68-4d4d-a279-ec25e545373f None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:35.417994 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81feb821-9d68-4d4d-a279-ec25e545373f None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:35.418151 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81feb821-9d68-4d4d-a279-ec25e545373f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:35.464976 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 286/560] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:18:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 16:18:35.465920 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a8da77-5c94-41e3-95bc-92fc74a06b28 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:35.475088 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:35.488676 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81feb821-9d68-4d4d-a279-ec25e545373f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:35.490231 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81feb821-9d68-4d4d-a279-ec25e545373f None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:35.597127 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a8da77-5c94-41e3-95bc-92fc74a06b28 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:35.606620 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 275/561] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Sep 9 16:18:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 16:18:35.607874 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81feb821-9d68-4d4d-a279-ec25e545373f None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:35.619735 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:35.635210 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf1a5ba-276b-4774-828b-8f68a2d64f19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:35.635811 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf1a5ba-276b-4774-828b-8f68a2d64f19 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:35.636084 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf1a5ba-276b-4774-828b-8f68a2d64f19 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:35.636349 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf1a5ba-276b-4774-828b-8f68a2d64f19 None admin] PATH_INFO: `/v3/domains` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:35.636969 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf1a5ba-276b-4774-828b-8f68a2d64f19 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:18:35.637261 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf1a5ba-276b-4774-828b-8f68a2d64f19 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:35.638665 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf1a5ba-276b-4774-828b-8f68a2d64f19 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:35.650796 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 287/562] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Sep 9 16:18:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:18:35.655909 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf1a5ba-276b-4774-828b-8f68a2d64f19 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:35.697587 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:35.716089 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81feb821-9d68-4d4d-a279-ec25e545373f None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:35.751397 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0d66de-22bc-45ae-9395-b75c1413ff24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:35.752015 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0d66de-22bc-45ae-9395-b75c1413ff24 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:35.752290 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0d66de-22bc-45ae-9395-b75c1413ff24 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:35.752597 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0d66de-22bc-45ae-9395-b75c1413ff24 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:35.761847 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf1a5ba-276b-4774-828b-8f68a2d64f19 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:35.762748 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0d66de-22bc-45ae-9395-b75c1413ff24 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 16:18:35.767497 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-1d0d66de-22bc-45ae-9395-b75c1413ff24 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 16:18:35.767497 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:18:35.767497 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:18:35.767497 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:18:35.767497 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:18:35.767497 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:18:35.767497 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:18:35.767497 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:18:35.767497 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:18:35.767497 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:18:35.767497 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:18:35.767497 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:18:35.767497 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 16:18:35.767497 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 16:18:35.767497 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 16:18:35.767497 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 16:18:35.768465 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 16:18:35.768465 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 16:18:35.768465 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 16:18:35.768465 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 16:18:35.768465 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:18:35.768465 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:18:35.768465 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:18:35.768465 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:18:35.768465 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:18:35.768465 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:18:35.768465 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:18:35.768465 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 16:18:35.768465 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:18:35.768465 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:18:35.768465 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:18:35.768465 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:18:35.769372 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:18:35.769372 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:18:35.769372 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:18:35.769372 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:18:35.769372 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 16:18:35.769372 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 16:18:35.769372 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 16:18:35.769372 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 16:18:35.769372 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 16:18:35.769372 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 16:18:35.769372 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 16:18:35.769372 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 16:18:35.769372 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 276/563] 10.222.0.27 () {56 vars in 1102 bytes} [Fri Sep 9 16:18:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:18:35.769372 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0d66de-22bc-45ae-9395-b75c1413ff24 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:35.796977 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eead3f4-43e2-495d-b0d7-174388dd8420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:35.797600 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eead3f4-43e2-495d-b0d7-174388dd8420 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:35.797881 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eead3f4-43e2-495d-b0d7-174388dd8420 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:35.798148 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eead3f4-43e2-495d-b0d7-174388dd8420 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:35.808735 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eead3f4-43e2-495d-b0d7-174388dd8420 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 16:18:35.814135 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-6eead3f4-43e2-495d-b0d7-174388dd8420 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 16:18:35.814135 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:18:35.814135 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:18:35.814135 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:18:35.814135 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:18:35.814135 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:18:35.814135 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:18:35.814135 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:18:35.814135 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:18:35.814135 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:18:35.814135 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:18:35.814135 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:18:35.814135 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 16:18:35.814135 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 16:18:35.814135 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 16:18:35.814135 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 16:18:35.815155 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 16:18:35.815155 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 16:18:35.815155 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 16:18:35.815155 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 16:18:35.815155 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:18:35.815155 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:18:35.815155 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:18:35.815155 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:18:35.815155 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:18:35.815155 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:18:35.815155 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:18:35.815155 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Sep 09 16:18:35.815155 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:18:35.815155 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:18:35.815155 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:18:35.815155 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:18:35.815995 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:18:35.815995 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:18:35.815995 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:18:35.815995 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:18:35.815995 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 16:18:35.815995 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 16:18:35.815995 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 16:18:35.815995 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 16:18:35.815995 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 16:18:35.815995 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 16:18:35.815995 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 16:18:35.815995 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:18:35.818441 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 288/564] 10.222.0.27 () {56 vars in 1102 bytes} [Fri Sep 9 16:18:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:18:35.819741 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eead3f4-43e2-495d-b0d7-174388dd8420 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:35.861474 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:35.868352 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0d66de-22bc-45ae-9395-b75c1413ff24 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:35.901588 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2deff9-b242-4f68-bca2-39b25ffa95de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:35.902197 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2deff9-b242-4f68-bca2-39b25ffa95de None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:35.902500 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2deff9-b242-4f68-bca2-39b25ffa95de None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:35.902768 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2deff9-b242-4f68-bca2-39b25ffa95de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:35.912877 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2deff9-b242-4f68-bca2-39b25ffa95de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:35.914340 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2deff9-b242-4f68-bca2-39b25ffa95de None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:35.916824 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:35.919584 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eead3f4-43e2-495d-b0d7-174388dd8420 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:35.930105 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-be2deff9-b242-4f68-bca2-39b25ffa95de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 16:18:35.930105 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:18:35.930105 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:18:35.930105 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:18:35.930105 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:18:35.930105 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:18:35.930105 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:18:35.930105 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:18:35.930105 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:18:35.930105 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:18:35.930105 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:18:35.930105 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:18:35.930105 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 16:18:35.930105 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 16:18:35.930105 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 16:18:35.930105 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 16:18:35.931198 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:18:35.931198 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:18:35.931198 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:18:35.931198 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:18:35.931198 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:18:35.931198 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:18:35.931198 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:18:35.931198 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 16:18:35.931198 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:18:35.931198 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:18:35.931198 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:18:35.931198 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:18:35.931198 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:18:35.931198 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:18:35.931198 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:18:35.931198 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:18:35.931198 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 16:18:35.932114 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 16:18:35.932114 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 16:18:35.932114 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 16:18:35.932114 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 277/565] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 16:18:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:18:35.932114 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2deff9-b242-4f68-bca2-39b25ffa95de None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:35.956753 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe00a1b4-b21c-4154-b2aa-379d9e1135f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:35.957311 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe00a1b4-b21c-4154-b2aa-379d9e1135f4 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:35.957587 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe00a1b4-b21c-4154-b2aa-379d9e1135f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:35.957855 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe00a1b4-b21c-4154-b2aa-379d9e1135f4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:35.965068 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe00a1b4-b21c-4154-b2aa-379d9e1135f4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:35.966528 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe00a1b4-b21c-4154-b2aa-379d9e1135f4 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:35.977833 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-fe00a1b4-b21c-4154-b2aa-379d9e1135f4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 09 16:18:35.977833 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:18:35.977833 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:18:35.977833 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:18:35.977833 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:18:35.977833 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:18:35.977833 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:18:35.977833 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:18:35.977833 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:18:35.977833 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:18:35.977833 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:18:35.977833 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:18:35.977833 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 16:18:35.977833 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 16:18:35.977833 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 16:18:35.977833 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 16:18:35.978874 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:18:35.978874 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:18:35.978874 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 16:18:35.978874 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 16:18:35.978874 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 16:18:35.978874 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 16:18:35.978874 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:18:35.978874 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:18:35.978874 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:18:35.978874 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:18:35.978874 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:18:35.978874 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Sep 09 16:18:35.978874 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:18:35.978874 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:18:35.978874 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:18:35.978874 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:18:35.978874 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:18:35.978874 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:18:35.979807 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:18:35.979807 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:18:35.979807 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 16:18:35.979807 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 16:18:35.979807 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 16:18:35.979807 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 16:18:35.979807 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 16:18:35.979807 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 16:18:35.979807 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 09 16:18:35.979807 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:18:35.979807 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 289/566] 10.222.0.27 () {56 vars in 1093 bytes} [Fri Sep 9 16:18:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:18:35.979807 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe00a1b4-b21c-4154-b2aa-379d9e1135f4 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:36.032424 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2deff9-b242-4f68-bca2-39b25ffa95de None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:36.065740 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941cc17f-27ae-4922-9e83-749774a90cbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:36.066369 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941cc17f-27ae-4922-9e83-749774a90cbe None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:36.066649 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941cc17f-27ae-4922-9e83-749774a90cbe None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:36.066921 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941cc17f-27ae-4922-9e83-749774a90cbe None admin] PATH_INFO: `/v3/roles/service` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:36.073057 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:36.076020 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe00a1b4-b21c-4154-b2aa-379d9e1135f4 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:36.079018 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941cc17f-27ae-4922-9e83-749774a90cbe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 16:18:36.086483 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-941cc17f-27ae-4922-9e83-749774a90cbe None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 16:18:36.086483 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:18:36.086483 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:18:36.086483 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:18:36.086483 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:18:36.086483 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:18:36.086483 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:18:36.086483 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:18:36.086483 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:18:36.086483 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:18:36.086483 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:18:36.086483 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:18:36.086483 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 16:18:36.086483 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 16:18:36.086483 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 16:18:36.086483 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 16:18:36.087527 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 16:18:36.087527 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 16:18:36.087527 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 16:18:36.087527 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 16:18:36.087527 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:18:36.087527 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:18:36.087527 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:18:36.087527 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:18:36.087527 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:18:36.087527 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:18:36.087527 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:18:36.087527 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 16:18:36.087527 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:18:36.087527 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:18:36.087527 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:18:36.087527 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:18:36.088928 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:18:36.088928 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:18:36.088928 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:18:36.088928 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:18:36.088928 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 16:18:36.088928 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 16:18:36.088928 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 16:18:36.088928 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 16:18:36.088928 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 16:18:36.088928 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 16:18:36.088928 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 16:18:36.088928 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 16:18:36.088928 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 278/567] 10.222.0.27 () {56 vars in 1102 bytes} [Fri Sep 9 16:18:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:18:36.088928 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941cc17f-27ae-4922-9e83-749774a90cbe None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:36.112435 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adf0c6f-eff4-4ce5-a10d-0c9cbeac1aef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:36.113032 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adf0c6f-eff4-4ce5-a10d-0c9cbeac1aef None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:36.113312 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adf0c6f-eff4-4ce5-a10d-0c9cbeac1aef None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:36.113574 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adf0c6f-eff4-4ce5-a10d-0c9cbeac1aef None admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:36.114209 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adf0c6f-eff4-4ce5-a10d-0c9cbeac1aef None admin] RBAC: Adding query filter params (name=service) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:18:36.114532 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adf0c6f-eff4-4ce5-a10d-0c9cbeac1aef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:36.115887 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adf0c6f-eff4-4ce5-a10d-0c9cbeac1aef None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:36.123399 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 290/568] 10.222.0.27 () {56 vars in 1103 bytes} [Fri Sep 9 16:18:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:18:36.124157 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adf0c6f-eff4-4ce5-a10d-0c9cbeac1aef None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:36.142938 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:36.186617 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941cc17f-27ae-4922-9e83-749774a90cbe None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:36.219211 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bf939c-119e-4645-9d0f-5c4d4ef750d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:36.219740 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bf939c-119e-4645-9d0f-5c4d4ef750d1 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:36.220019 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bf939c-119e-4645-9d0f-5c4d4ef750d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:36.220294 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bf939c-119e-4645-9d0f-5c4d4ef750d1 None admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:36.220946 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bf939c-119e-4645-9d0f-5c4d4ef750d1 None admin] RBAC: Adding query filter params (name=service) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:18:36.221340 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bf939c-119e-4645-9d0f-5c4d4ef750d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:36.223239 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bf939c-119e-4645-9d0f-5c4d4ef750d1 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:36.223695 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adf0c6f-eff4-4ce5-a10d-0c9cbeac1aef None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:36.231044 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 279/569] 10.222.0.27 () {56 vars in 1103 bytes} [Fri Sep 9 16:18:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:18:36.231822 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bf939c-119e-4645-9d0f-5c4d4ef750d1 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:36.256645 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fccfd3-6c84-427c-b80e-ec0aa413515c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:36.257244 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fccfd3-6c84-427c-b80e-ec0aa413515c None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:36.257517 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fccfd3-6c84-427c-b80e-ec0aa413515c None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:36.257785 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fccfd3-6c84-427c-b80e-ec0aa413515c None admin] PATH_INFO: `/v3/domains` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:36.258433 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fccfd3-6c84-427c-b80e-ec0aa413515c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:18:36.258731 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fccfd3-6c84-427c-b80e-ec0aa413515c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:36.260348 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fccfd3-6c84-427c-b80e-ec0aa413515c None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:36.272073 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 291/570] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Sep 9 16:18:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:18:36.272837 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fccfd3-6c84-427c-b80e-ec0aa413515c None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:36.300317 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:36.335764 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bf939c-119e-4645-9d0f-5c4d4ef750d1 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:36.352242 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:36.369352 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9347e8-acf3-40be-ba49-21c58810d414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:36.369952 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9347e8-acf3-40be-ba49-21c58810d414 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:36.370229 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9347e8-acf3-40be-ba49-21c58810d414 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:36.370530 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9347e8-acf3-40be-ba49-21c58810d414 None admin] PATH_INFO: `/v3/users` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:36.371257 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9347e8-acf3-40be-ba49-21c58810d414 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:18:36.371561 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9347e8-acf3-40be-ba49-21c58810d414 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:36.372988 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9347e8-acf3-40be-ba49-21c58810d414 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:36.379601 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fccfd3-6c84-427c-b80e-ec0aa413515c None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:36.390232 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 280/571] 10.222.0.27 () {56 vars in 1133 bytes} [Fri Sep 9 16:18:36 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:18:36.391132 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9347e8-acf3-40be-ba49-21c58810d414 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:36.419161 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424a5174-16d2-49e3-a267-21be6e3673c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:36.419761 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424a5174-16d2-49e3-a267-21be6e3673c1 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:36.420036 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424a5174-16d2-49e3-a267-21be6e3673c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:36.420363 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424a5174-16d2-49e3-a267-21be6e3673c1 None admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:36.421013 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424a5174-16d2-49e3-a267-21be6e3673c1 None admin] RBAC: Adding query filter params (name=service) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:18:36.421309 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424a5174-16d2-49e3-a267-21be6e3673c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:36.422700 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424a5174-16d2-49e3-a267-21be6e3673c1 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:36.431008 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 292/572] 10.222.0.27 () {56 vars in 1103 bytes} [Fri Sep 9 16:18:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:18:36.431779 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424a5174-16d2-49e3-a267-21be6e3673c1 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:36.490769 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9347e8-acf3-40be-ba49-21c58810d414 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:36.512393 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:36.523497 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9708cb49-663a-42a1-ba0e-1f506722c302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:36.524116 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9708cb49-663a-42a1-ba0e-1f506722c302 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:36.524396 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9708cb49-663a-42a1-ba0e-1f506722c302 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:36.524666 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9708cb49-663a-42a1-ba0e-1f506722c302 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:36.527786 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424a5174-16d2-49e3-a267-21be6e3673c1 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:36.534906 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9708cb49-663a-42a1-ba0e-1f506722c302 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:36.536407 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9708cb49-663a-42a1-ba0e-1f506722c302 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:36.553079 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-9708cb49-663a-42a1-ba0e-1f506722c302 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 16:18:36.553079 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:18:36.553079 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:18:36.553079 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:18:36.553079 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:18:36.553079 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:18:36.553079 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:18:36.553079 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:18:36.553079 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:18:36.553079 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:18:36.553079 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:18:36.553079 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:18:36.553079 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 16:18:36.553079 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 16:18:36.553079 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 16:18:36.553079 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 16:18:36.554181 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:18:36.554181 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:18:36.554181 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:18:36.554181 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:18:36.554181 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:18:36.554181 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:18:36.554181 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:18:36.554181 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 16:18:36.554181 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:18:36.554181 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:18:36.554181 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:18:36.554181 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:18:36.554181 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:18:36.554181 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:18:36.554181 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:18:36.554181 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:18:36.554181 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 16:18:36.555116 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 16:18:36.555116 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 16:18:36.555116 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 16:18:36.555116 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 281/573] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 16:18:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:18:36.555116 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9708cb49-663a-42a1-ba0e-1f506722c302 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:36.565988 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54310ffc-0778-4a13-9f16-aea47d944d42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:36.566632 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54310ffc-0778-4a13-9f16-aea47d944d42 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:36.566907 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54310ffc-0778-4a13-9f16-aea47d944d42 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:36.567173 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54310ffc-0778-4a13-9f16-aea47d944d42 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:36.577721 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54310ffc-0778-4a13-9f16-aea47d944d42 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:36.579189 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54310ffc-0778-4a13-9f16-aea47d944d42 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:36.583321 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:36.593106 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-54310ffc-0778-4a13-9f16-aea47d944d42 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 16:18:36.593106 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:18:36.593106 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:18:36.593106 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:18:36.593106 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:18:36.593106 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:18:36.593106 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:18:36.593106 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:18:36.593106 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:18:36.593106 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:18:36.593106 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:18:36.593106 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:18:36.593106 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 16:18:36.593106 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 16:18:36.593106 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 16:18:36.593106 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 16:18:36.594126 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:18:36.594126 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:18:36.594126 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:18:36.594126 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:18:36.594126 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:18:36.594126 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:18:36.594126 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:18:36.594126 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Sep 09 16:18:36.594126 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:18:36.594126 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:18:36.594126 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:18:36.594126 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:18:36.594126 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:18:36.594126 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:18:36.594126 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:18:36.594126 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:18:36.594126 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 16:18:36.595046 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 16:18:36.595046 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 16:18:36.595046 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:18:36.595046 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 293/574] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 16:18:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:18:36.595046 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54310ffc-0778-4a13-9f16-aea47d944d42 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:36.658401 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9708cb49-663a-42a1-ba0e-1f506722c302 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:36.691223 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b961696-d538-4bb4-a63d-88db26088b44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:36.691839 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b961696-d538-4bb4-a63d-88db26088b44 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:36.692118 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b961696-d538-4bb4-a63d-88db26088b44 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:36.692387 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b961696-d538-4bb4-a63d-88db26088b44 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:36.698899 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b961696-d538-4bb4-a63d-88db26088b44 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:36.699897 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54310ffc-0778-4a13-9f16-aea47d944d42 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:36.700340 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b961696-d538-4bb4-a63d-88db26088b44 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:36.712844 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-0b961696-d538-4bb4-a63d-88db26088b44 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 16:18:36.712844 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:18:36.712844 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:18:36.712844 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:18:36.712844 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:18:36.712844 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:18:36.712844 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:18:36.712844 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:18:36.712844 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:18:36.712844 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:18:36.712844 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:18:36.712844 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:18:36.712844 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 16:18:36.712844 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 16:18:36.712844 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 16:18:36.713813 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 16:18:36.713813 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:18:36.713813 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:18:36.713813 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:18:36.713813 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:18:36.713813 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:18:36.713813 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:18:36.713813 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:18:36.713813 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 16:18:36.713813 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:18:36.713813 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:18:36.713813 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:18:36.713813 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:18:36.713813 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:18:36.713813 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:18:36.713813 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:18:36.713813 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:18:36.715146 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 16:18:36.715146 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 16:18:36.715146 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 16:18:36.715146 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 16:18:36.715146 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 16:18:36.715146 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 16:18:36.715146 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 16:18:36.715146 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 16:18:36.715146 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 282/575] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Sep 9 16:18:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:18:36.715146 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b961696-d538-4bb4-a63d-88db26088b44 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:36.738374 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e0c9b4-5a38-4a72-9c2e-48859d746791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:36.739004 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e0c9b4-5a38-4a72-9c2e-48859d746791 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:36.739287 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e0c9b4-5a38-4a72-9c2e-48859d746791 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:36.739561 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e0c9b4-5a38-4a72-9c2e-48859d746791 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:36.742200 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:36.750659 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e0c9b4-5a38-4a72-9c2e-48859d746791 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:36.752111 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e0c9b4-5a38-4a72-9c2e-48859d746791 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:36.765943 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-b6e0c9b4-5a38-4a72-9c2e-48859d746791 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 16:18:36.765943 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:18:36.765943 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:18:36.765943 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:18:36.765943 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:18:36.765943 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:18:36.765943 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:18:36.765943 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:18:36.765943 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:18:36.765943 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:18:36.765943 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:18:36.765943 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:18:36.765943 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 16:18:36.765943 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 16:18:36.765943 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 16:18:36.765943 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 16:18:36.766918 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:18:36.766918 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:18:36.766918 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:18:36.766918 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:18:36.766918 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:18:36.766918 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:18:36.766918 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:18:36.766918 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Sep 09 16:18:36.766918 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:18:36.766918 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:18:36.766918 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:18:36.766918 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:18:36.766918 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:18:36.766918 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:18:36.766918 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:18:36.766918 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:18:36.766918 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 16:18:36.767825 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 16:18:36.767825 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 16:18:36.767825 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:18:36.767825 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 294/576] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 16:18:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:18:36.767825 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e0c9b4-5a38-4a72-9c2e-48859d746791 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:36.801151 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:36.813813 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b961696-d538-4bb4-a63d-88db26088b44 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:36.846124 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d67780-c03e-4b17-992c-fef177a45103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:36.847312 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d67780-c03e-4b17-992c-fef177a45103 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:36.847586 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d67780-c03e-4b17-992c-fef177a45103 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:36.847853 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d67780-c03e-4b17-992c-fef177a45103 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:36.858025 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d67780-c03e-4b17-992c-fef177a45103 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:36.859513 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d67780-c03e-4b17-992c-fef177a45103 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:36.869335 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e0c9b4-5a38-4a72-9c2e-48859d746791 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:36.873145 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-25d67780-c03e-4b17-992c-fef177a45103 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 16:18:36.873145 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:18:36.873145 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:18:36.873145 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:18:36.873145 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:18:36.873145 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:18:36.873145 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:18:36.873145 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:18:36.873145 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:18:36.873145 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:18:36.873145 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:18:36.873145 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:18:36.873145 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 16:18:36.873145 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 16:18:36.873145 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 16:18:36.873145 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 16:18:36.874211 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:18:36.874211 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:18:36.874211 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:18:36.874211 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:18:36.874211 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:18:36.874211 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:18:36.874211 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:18:36.874211 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 16:18:36.874211 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:18:36.874211 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:18:36.874211 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:18:36.874211 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:18:36.874211 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:18:36.874211 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:18:36.874211 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:18:36.874211 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:18:36.874211 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 16:18:36.875150 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 16:18:36.875150 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 16:18:36.875150 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 16:18:36.875150 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 283/577] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 16:18:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:18:36.875150 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d67780-c03e-4b17-992c-fef177a45103 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:36.902532 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d64c42-f812-4993-8c54-2d85d27fd075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:36.903134 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d64c42-f812-4993-8c54-2d85d27fd075 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:36.903413 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d64c42-f812-4993-8c54-2d85d27fd075 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:36.903683 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d64c42-f812-4993-8c54-2d85d27fd075 None admin] PATH_INFO: `/v3/domains` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:36.904364 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d64c42-f812-4993-8c54-2d85d27fd075 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:18:36.904664 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d64c42-f812-4993-8c54-2d85d27fd075 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:36.906009 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d64c42-f812-4993-8c54-2d85d27fd075 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:36.918327 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 295/578] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Sep 9 16:18:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:18:36.919091 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d64c42-f812-4993-8c54-2d85d27fd075 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:36.977040 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:36.979261 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d67780-c03e-4b17-992c-fef177a45103 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:37.012632 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dd7397-0e64-40c0-b8d7-d3471188340c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:37.013157 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dd7397-0e64-40c0-b8d7-d3471188340c None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:37.013431 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dd7397-0e64-40c0-b8d7-d3471188340c None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:37.013699 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dd7397-0e64-40c0-b8d7-d3471188340c None admin] PATH_INFO: `/v3/domains` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:37.014341 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dd7397-0e64-40c0-b8d7-d3471188340c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:18:37.014649 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dd7397-0e64-40c0-b8d7-d3471188340c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:37.016028 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dd7397-0e64-40c0-b8d7-d3471188340c None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:37.025135 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:37.028275 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d64c42-f812-4993-8c54-2d85d27fd075 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:37.028810 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 284/579] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Sep 9 16:18:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:18:37.029780 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dd7397-0e64-40c0-b8d7-d3471188340c None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:37.064334 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5fc949-9fc5-4ad7-92e0-ebfbc6032c59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:37.065436 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5fc949-9fc5-4ad7-92e0-ebfbc6032c59 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:37.065723 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5fc949-9fc5-4ad7-92e0-ebfbc6032c59 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:37.065990 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5fc949-9fc5-4ad7-92e0-ebfbc6032c59 None admin] PATH_INFO: `/v3/projects` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:37.066699 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5fc949-9fc5-4ad7-92e0-ebfbc6032c59 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:18:37.067001 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5fc949-9fc5-4ad7-92e0-ebfbc6032c59 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:37.068431 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5fc949-9fc5-4ad7-92e0-ebfbc6032c59 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:37.079624 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 296/580] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Sep 9 16:18:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:18:37.080404 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5fc949-9fc5-4ad7-92e0-ebfbc6032c59 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:37.126263 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dd7397-0e64-40c0-b8d7-d3471188340c None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:37.160113 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9a2ab3-c62a-4949-8229-1a3eb770bea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:37.160938 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9a2ab3-c62a-4949-8229-1a3eb770bea1 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:37.161369 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9a2ab3-c62a-4949-8229-1a3eb770bea1 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:37.161638 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9a2ab3-c62a-4949-8229-1a3eb770bea1 None admin] PATH_INFO: `/v3/domains` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:37.162270 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9a2ab3-c62a-4949-8229-1a3eb770bea1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:18:37.162596 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9a2ab3-c62a-4949-8229-1a3eb770bea1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:37.163976 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9a2ab3-c62a-4949-8229-1a3eb770bea1 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:37.174517 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 285/581] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Sep 9 16:18:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:18:37.175288 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9a2ab3-c62a-4949-8229-1a3eb770bea1 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:37.184978 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5fc949-9fc5-4ad7-92e0-ebfbc6032c59 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:37.194138 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:37.219504 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4c2b8f-03be-4f99-8155-db7041f6be6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:37.220100 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4c2b8f-03be-4f99-8155-db7041f6be6e None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:37.220375 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4c2b8f-03be-4f99-8155-db7041f6be6e None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:37.220642 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4c2b8f-03be-4f99-8155-db7041f6be6e None admin] PATH_INFO: `/v3/domains` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:37.221296 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4c2b8f-03be-4f99-8155-db7041f6be6e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:18:37.221593 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4c2b8f-03be-4f99-8155-db7041f6be6e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:37.223005 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4c2b8f-03be-4f99-8155-db7041f6be6e None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:37.234183 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 297/582] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Sep 9 16:18:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:18:37.236172 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:37.237128 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4c2b8f-03be-4f99-8155-db7041f6be6e None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:37.284271 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9a2ab3-c62a-4949-8229-1a3eb770bea1 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:37.317919 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b97e29-d748-4736-88da-f090de7010f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:37.318664 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b97e29-d748-4736-88da-f090de7010f5 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:37.318941 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b97e29-d748-4736-88da-f090de7010f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:37.319211 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b97e29-d748-4736-88da-f090de7010f5 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:37.326491 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b97e29-d748-4736-88da-f090de7010f5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:37.327939 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b97e29-d748-4736-88da-f090de7010f5 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:37.339122 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4c2b8f-03be-4f99-8155-db7041f6be6e None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:37.339305 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-f6b97e29-d748-4736-88da-f090de7010f5 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 09 16:18:37.339305 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:18:37.339305 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:18:37.339305 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:18:37.339305 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:18:37.339305 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:18:37.339305 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:18:37.339305 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:18:37.339305 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:18:37.339305 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:18:37.339305 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:18:37.339305 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:18:37.339305 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 16:18:37.339305 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 16:18:37.339305 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 16:18:37.339305 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 16:18:37.340435 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:18:37.340435 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:18:37.340435 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 16:18:37.340435 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 16:18:37.340435 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 16:18:37.340435 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 16:18:37.340435 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:18:37.340435 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:18:37.340435 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:18:37.340435 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:18:37.340435 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:18:37.340435 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 16:18:37.340435 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:18:37.340435 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:18:37.340435 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:18:37.340435 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:18:37.340435 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:18:37.340435 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:18:37.341502 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:18:37.341502 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:18:37.341502 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 16:18:37.341502 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 16:18:37.341502 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 16:18:37.341502 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 16:18:37.341502 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 16:18:37.341502 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 16:18:37.341502 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 09 16:18:37.341502 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 16:18:37.341502 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 286/583] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Sep 9 16:18:37 2022] GET /identity/v3/users/glance => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:18:37.341502 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b97e29-d748-4736-88da-f090de7010f5 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:37.376156 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11764b9c-fd98-42ee-a0f7-2e06bbaf1855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:37.376781 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11764b9c-fd98-42ee-a0f7-2e06bbaf1855 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:37.377061 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11764b9c-fd98-42ee-a0f7-2e06bbaf1855 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:37.377328 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11764b9c-fd98-42ee-a0f7-2e06bbaf1855 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:37.384658 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11764b9c-fd98-42ee-a0f7-2e06bbaf1855 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:37.386098 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11764b9c-fd98-42ee-a0f7-2e06bbaf1855 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:37.397869 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-11764b9c-fd98-42ee-a0f7-2e06bbaf1855 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 09 16:18:37.397869 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:18:37.397869 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:18:37.397869 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:18:37.397869 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:18:37.397869 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:18:37.397869 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:18:37.397869 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:18:37.397869 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:18:37.397869 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:18:37.397869 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:18:37.397869 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:18:37.397869 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 16:18:37.397869 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 16:18:37.397869 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 16:18:37.397869 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 16:18:37.398866 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:18:37.398866 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:18:37.398866 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 16:18:37.398866 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 16:18:37.398866 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 16:18:37.398866 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 16:18:37.398866 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:18:37.398866 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:18:37.398866 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:18:37.398866 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:18:37.398866 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:18:37.398866 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Sep 09 16:18:37.398866 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:18:37.398866 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:18:37.398866 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:18:37.398866 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:18:37.398866 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:18:37.398866 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:18:37.399802 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:18:37.399802 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:18:37.399802 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 16:18:37.399802 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 16:18:37.399802 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 16:18:37.399802 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 16:18:37.399802 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 16:18:37.399802 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 16:18:37.399802 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 09 16:18:37.399802 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:18:37.399802 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 298/584] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Sep 9 16:18:37 2022] GET /identity/v3/users/cinder => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:18:37.399802 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11764b9c-fd98-42ee-a0f7-2e06bbaf1855 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:37.430174 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:37.443100 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b97e29-d748-4736-88da-f090de7010f5 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:37.462536 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:37.476646 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc9f3c9-7ae9-4402-ad4a-9414144daa79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:37.477233 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc9f3c9-7ae9-4402-ad4a-9414144daa79 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:37.477505 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc9f3c9-7ae9-4402-ad4a-9414144daa79 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:37.477769 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc9f3c9-7ae9-4402-ad4a-9414144daa79 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:37.478505 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc9f3c9-7ae9-4402-ad4a-9414144daa79 None admin] RBAC: Adding query filter params (role.id=1966594501e743aebf757851d9cd82a5, scope.project.id=68d6aaafab824657b08ca91f3d46d5f8, user.id=a2350bbc4a194c2dab2e3be830fd0eba) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:18:37.478806 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc9f3c9-7ae9-4402-ad4a-9414144daa79 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:37.480222 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc9f3c9-7ae9-4402-ad4a-9414144daa79 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:37.485588 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 287/585] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Sep 9 16:18:37 2022] GET /identity/v3/role_assignments?user.id=a2350bbc4a194c2dab2e3be830fd0eba&scope.project.id=68d6aaafab824657b08ca91f3d46d5f8&role.id=1966594501e743aebf757851d9cd82a5 => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:18:37.486388 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc9f3c9-7ae9-4402-ad4a-9414144daa79 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:37.501987 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11764b9c-fd98-42ee-a0f7-2e06bbaf1855 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:37.540887 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37ea39e-2610-4fa1-94ba-41ef60a1eb0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:37.541449 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37ea39e-2610-4fa1-94ba-41ef60a1eb0d None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:37.541731 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37ea39e-2610-4fa1-94ba-41ef60a1eb0d None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:37.542004 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37ea39e-2610-4fa1-94ba-41ef60a1eb0d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:37.550043 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37ea39e-2610-4fa1-94ba-41ef60a1eb0d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:37.551602 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37ea39e-2610-4fa1-94ba-41ef60a1eb0d None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:37.564845 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-d37ea39e-2610-4fa1-94ba-41ef60a1eb0d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 16:18:37.564845 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:18:37.564845 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:18:37.564845 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:18:37.564845 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:18:37.564845 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:18:37.564845 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:18:37.564845 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:18:37.564845 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:18:37.564845 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:18:37.564845 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:18:37.564845 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:18:37.564845 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 16:18:37.564845 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 16:18:37.564845 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 16:18:37.566484 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 16:18:37.566484 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:18:37.566484 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:18:37.566484 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:18:37.566484 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:18:37.566484 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:18:37.566484 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:18:37.566484 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:18:37.566484 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Sep 09 16:18:37.566484 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:18:37.566484 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:18:37.566484 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:18:37.566484 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:18:37.566484 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:18:37.566484 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:18:37.566484 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:18:37.566484 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:18:37.567369 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 16:18:37.567369 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 16:18:37.567369 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 16:18:37.567369 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 16:18:37.567369 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 16:18:37.567369 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 16:18:37.567369 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 16:18:37.567369 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:18:37.571421 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 299/586] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Sep 9 16:18:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:18:37.572398 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37ea39e-2610-4fa1-94ba-41ef60a1eb0d None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:37.607846 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc9f3c9-7ae9-4402-ad4a-9414144daa79 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:37.645846 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4ebe3b-eb72-484f-9b37-abae566a8809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:37.646524 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4ebe3b-eb72-484f-9b37-abae566a8809 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:37.646805 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4ebe3b-eb72-484f-9b37-abae566a8809 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:37.647075 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4ebe3b-eb72-484f-9b37-abae566a8809 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:37.655292 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4ebe3b-eb72-484f-9b37-abae566a8809 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:37.656836 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4ebe3b-eb72-484f-9b37-abae566a8809 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:37.668422 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-2e4ebe3b-eb72-484f-9b37-abae566a8809 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 09 16:18:37.668422 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:18:37.668422 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:18:37.668422 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:18:37.668422 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:18:37.668422 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:18:37.668422 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:18:37.668422 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:18:37.668422 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:18:37.668422 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:18:37.668422 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:18:37.668422 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:18:37.668422 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 16:18:37.668422 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 16:18:37.668422 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 16:18:37.668422 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 16:18:37.669376 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:18:37.669376 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:18:37.669376 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 16:18:37.669376 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 16:18:37.669376 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 16:18:37.669376 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 16:18:37.669376 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:18:37.669376 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:18:37.669376 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:18:37.669376 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:18:37.669376 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:18:37.669376 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 16:18:37.669376 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:18:37.669376 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:18:37.669376 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:18:37.669376 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:18:37.669376 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:18:37.669376 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:18:37.671034 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:18:37.671034 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:18:37.671034 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 16:18:37.671034 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 16:18:37.671034 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 16:18:37.671034 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 16:18:37.671034 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 16:18:37.671034 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 16:18:37.671034 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 09 16:18:37.671034 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 16:18:37.671034 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 288/587] 10.222.0.27 () {56 vars in 1102 bytes} [Fri Sep 9 16:18:37 2022] GET /identity/v3/users/neutron => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:18:37.671034 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4ebe3b-eb72-484f-9b37-abae566a8809 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:37.682347 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:37.694930 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37ea39e-2610-4fa1-94ba-41ef60a1eb0d None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:37.722205 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:37.730527 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bcb7e2-1f31-4a74-8dc5-26cbf71367db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:37.731138 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bcb7e2-1f31-4a74-8dc5-26cbf71367db None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:37.731417 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bcb7e2-1f31-4a74-8dc5-26cbf71367db None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:37.731689 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bcb7e2-1f31-4a74-8dc5-26cbf71367db None admin] PATH_INFO: `/v3/users` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:37.732408 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bcb7e2-1f31-4a74-8dc5-26cbf71367db None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:18:37.732712 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bcb7e2-1f31-4a74-8dc5-26cbf71367db None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:37.734139 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bcb7e2-1f31-4a74-8dc5-26cbf71367db None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:37.752638 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 300/588] 10.222.0.27 () {56 vars in 1137 bytes} [Fri Sep 9 16:18:37 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:18:37.753966 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bcb7e2-1f31-4a74-8dc5-26cbf71367db None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:37.782548 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4ebe3b-eb72-484f-9b37-abae566a8809 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:37.818499 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c9abf6-d239-4f91-b620-62aa50cd051a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:37.819282 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c9abf6-d239-4f91-b620-62aa50cd051a None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:37.819561 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c9abf6-d239-4f91-b620-62aa50cd051a None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:37.819835 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c9abf6-d239-4f91-b620-62aa50cd051a None admin] PATH_INFO: `/v3/users` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:37.821013 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c9abf6-d239-4f91-b620-62aa50cd051a None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:18:37.821332 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c9abf6-d239-4f91-b620-62aa50cd051a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:37.823093 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c9abf6-d239-4f91-b620-62aa50cd051a None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:37.843035 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 289/589] 10.222.0.27 () {56 vars in 1137 bytes} [Fri Sep 9 16:18:37 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:18:37.843864 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c9abf6-d239-4f91-b620-62aa50cd051a None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:37.866430 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bcb7e2-1f31-4a74-8dc5-26cbf71367db None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:37.902519 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ba574f-e66b-43b1-81e2-e74d6818a585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:37.903181 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ba574f-e66b-43b1-81e2-e74d6818a585 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:37.903403 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ba574f-e66b-43b1-81e2-e74d6818a585 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:37.903676 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ba574f-e66b-43b1-81e2-e74d6818a585 None admin] PATH_INFO: `/v3/projects` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:37.904353 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ba574f-e66b-43b1-81e2-e74d6818a585 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:18:37.904664 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ba574f-e66b-43b1-81e2-e74d6818a585 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:37.906223 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ba574f-e66b-43b1-81e2-e74d6818a585 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:37.923024 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 301/590] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Sep 9 16:18:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:18:37.923024 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ba574f-e66b-43b1-81e2-e74d6818a585 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:37.933710 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:37.949620 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c9abf6-d239-4f91-b620-62aa50cd051a None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:37.951254 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:37.988407 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c18a37f-0c6f-4f32-b099-c9a3937c22c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:37.989115 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c18a37f-0c6f-4f32-b099-c9a3937c22c4 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:37.989396 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c18a37f-0c6f-4f32-b099-c9a3937c22c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:37.989663 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c18a37f-0c6f-4f32-b099-c9a3937c22c4 None admin] PATH_INFO: `/v3/users` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:37.990431 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c18a37f-0c6f-4f32-b099-c9a3937c22c4 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:18:37.990727 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c18a37f-0c6f-4f32-b099-c9a3937c22c4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:37.992173 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c18a37f-0c6f-4f32-b099-c9a3937c22c4 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:38.010846 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 290/591] 10.222.0.27 () {56 vars in 1139 bytes} [Fri Sep 9 16:18:37 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:18:38.011688 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c18a37f-0c6f-4f32-b099-c9a3937c22c4 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:38.042402 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ba574f-e66b-43b1-81e2-e74d6818a585 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:38.078089 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d475e5-a578-4386-a914-d988a1ddcae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:38.078665 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d475e5-a578-4386-a914-d988a1ddcae1 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:38.078949 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d475e5-a578-4386-a914-d988a1ddcae1 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:38.079227 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d475e5-a578-4386-a914-d988a1ddcae1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:38.089868 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d475e5-a578-4386-a914-d988a1ddcae1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:38.091341 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d475e5-a578-4386-a914-d988a1ddcae1 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:38.105707 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-d1d475e5-a578-4386-a914-d988a1ddcae1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 16:18:38.105707 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:18:38.105707 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:18:38.105707 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:18:38.105707 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:18:38.105707 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:18:38.105707 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:18:38.105707 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:18:38.105707 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:18:38.105707 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:18:38.105707 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:18:38.105707 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:18:38.105707 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 16:18:38.105707 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 16:18:38.105707 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 16:18:38.105707 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 16:18:38.106725 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:18:38.106725 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:18:38.106725 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:18:38.106725 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:18:38.106725 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:18:38.106725 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:18:38.106725 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:18:38.106725 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Sep 09 16:18:38.106725 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:18:38.106725 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:18:38.106725 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:18:38.106725 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:18:38.106725 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:18:38.106725 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:18:38.106725 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:18:38.106725 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:18:38.106725 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 16:18:38.107653 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 16:18:38.107653 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 16:18:38.107653 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:18:38.107653 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 302/592] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 16:18:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:18:38.107653 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d475e5-a578-4386-a914-d988a1ddcae1 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:38.117395 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c18a37f-0c6f-4f32-b099-c9a3937c22c4 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:38.150977 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68084f02-fd4f-4f9b-8da6-e08cabe09730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:38.151600 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68084f02-fd4f-4f9b-8da6-e08cabe09730 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:38.151876 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68084f02-fd4f-4f9b-8da6-e08cabe09730 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:38.152144 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68084f02-fd4f-4f9b-8da6-e08cabe09730 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:38.163163 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68084f02-fd4f-4f9b-8da6-e08cabe09730 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:38.164741 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68084f02-fd4f-4f9b-8da6-e08cabe09730 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:38.172084 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:38.180469 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-68084f02-fd4f-4f9b-8da6-e08cabe09730 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 16:18:38.180469 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:18:38.180469 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:18:38.180469 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:18:38.180469 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:18:38.180469 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:18:38.180469 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:18:38.180469 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:18:38.180469 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:18:38.180469 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:18:38.180469 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:18:38.180469 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:18:38.180469 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 16:18:38.180469 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 16:18:38.180469 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 16:18:38.180469 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 16:18:38.181464 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:18:38.181464 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:18:38.181464 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:18:38.181464 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:18:38.181464 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:18:38.181464 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:18:38.181464 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:18:38.181464 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 16:18:38.181464 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:18:38.181464 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:18:38.181464 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:18:38.181464 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:18:38.181464 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:18:38.181464 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:18:38.181464 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:18:38.181464 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:18:38.181464 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 16:18:38.187568 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 16:18:38.187568 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 16:18:38.187568 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 16:18:38.187568 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 291/593] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 16:18:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:18:38.187568 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68084f02-fd4f-4f9b-8da6-e08cabe09730 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:38.209233 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:38.243287 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d475e5-a578-4386-a914-d988a1ddcae1 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:38.300254 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178fb654-5b40-49d5-ae9c-6f6b5755e3ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:38.300913 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178fb654-5b40-49d5-ae9c-6f6b5755e3ac None admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:38.301192 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178fb654-5b40-49d5-ae9c-6f6b5755e3ac None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:38.301469 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178fb654-5b40-49d5-ae9c-6f6b5755e3ac None admin] PATH_INFO: `/v3/projects/68d6aaafab824657b08ca91f3d46d5f8/users/a332b9b4980646a3b14633293f77b505/roles/1966594501e743aebf757851d9cd82a5` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:38.328224 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68084f02-fd4f-4f9b-8da6-e08cabe09730 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:38.333139 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178fb654-5b40-49d5-ae9c-6f6b5755e3ac None admin] RBAC: Authorizing `identity:create_grant(project_id=68d6aaafab824657b08ca91f3d46d5f8, user_id=a332b9b4980646a3b14633293f77b505, role_id=1966594501e743aebf757851d9cd82a5)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:38.334645 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178fb654-5b40-49d5-ae9c-6f6b5755e3ac None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:38.351497 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 303/594] 10.222.0.27 () {58 vars in 1439 bytes} [Fri Sep 9 16:18:38 2022] PUT /identity/v3/projects/68d6aaafab824657b08ca91f3d46d5f8/users/a332b9b4980646a3b14633293f77b505/roles/1966594501e743aebf757851d9cd82a5 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:18:38.354535 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178fb654-5b40-49d5-ae9c-6f6b5755e3ac None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:38.375021 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4bc31c-57eb-4329-b980-f78af342d677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:38.376063 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4bc31c-57eb-4329-b980-f78af342d677 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:38.376599 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4bc31c-57eb-4329-b980-f78af342d677 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:38.377169 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4bc31c-57eb-4329-b980-f78af342d677 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:38.391233 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4bc31c-57eb-4329-b980-f78af342d677 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:38.393817 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4bc31c-57eb-4329-b980-f78af342d677 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:38.411745 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-cf4bc31c-57eb-4329-b980-f78af342d677 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 16:18:38.411745 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:18:38.411745 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:18:38.411745 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:18:38.411745 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:18:38.411745 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:18:38.411745 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:18:38.411745 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:18:38.411745 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:18:38.411745 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:18:38.411745 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:18:38.411745 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:18:38.411745 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 16:18:38.411745 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 16:18:38.411745 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 16:18:38.411745 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 16:18:38.412792 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:18:38.412792 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:18:38.412792 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:18:38.412792 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:18:38.412792 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:18:38.412792 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:18:38.412792 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:18:38.412792 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 16:18:38.412792 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:18:38.412792 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:18:38.412792 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:18:38.412792 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:18:38.412792 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:18:38.412792 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:18:38.412792 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:18:38.412792 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:18:38.412792 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 16:18:38.413711 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 16:18:38.413711 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 16:18:38.413711 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 16:18:38.420754 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 292/595] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 16:18:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:18:38.422145 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4bc31c-57eb-4329-b980-f78af342d677 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:38.473284 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178fb654-5b40-49d5-ae9c-6f6b5755e3ac None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:38.483535 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:38.500932 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:38.512704 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be02836-60e5-49fa-bcf5-a624a6d7996b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:38.513257 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be02836-60e5-49fa-bcf5-a624a6d7996b None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:38.513534 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be02836-60e5-49fa-bcf5-a624a6d7996b None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:38.513806 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be02836-60e5-49fa-bcf5-a624a6d7996b None admin] PATH_INFO: `/v3/domains` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:38.514496 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be02836-60e5-49fa-bcf5-a624a6d7996b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:18:38.514801 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be02836-60e5-49fa-bcf5-a624a6d7996b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:38.516194 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be02836-60e5-49fa-bcf5-a624a6d7996b None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:38.530019 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 304/596] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Sep 9 16:18:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:18:38.535064 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be02836-60e5-49fa-bcf5-a624a6d7996b None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:38.550822 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4bc31c-57eb-4329-b980-f78af342d677 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:38.594467 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584e00ec-f211-479a-8e4a-4a9e25cedd76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:38.595451 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584e00ec-f211-479a-8e4a-4a9e25cedd76 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:38.596056 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584e00ec-f211-479a-8e4a-4a9e25cedd76 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:38.597198 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584e00ec-f211-479a-8e4a-4a9e25cedd76 None admin] PATH_INFO: `/v3/domains` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:38.598050 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584e00ec-f211-479a-8e4a-4a9e25cedd76 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:18:38.598593 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584e00ec-f211-479a-8e4a-4a9e25cedd76 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:38.600399 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584e00ec-f211-479a-8e4a-4a9e25cedd76 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:38.614053 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 293/597] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Sep 9 16:18:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:18:38.619561 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584e00ec-f211-479a-8e4a-4a9e25cedd76 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:38.640129 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be02836-60e5-49fa-bcf5-a624a6d7996b None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:38.675289 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e692b7e-9445-4d2c-88b8-8c89a80da8d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:38.675900 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e692b7e-9445-4d2c-88b8-8c89a80da8d7 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:38.676179 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e692b7e-9445-4d2c-88b8-8c89a80da8d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:38.676441 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e692b7e-9445-4d2c-88b8-8c89a80da8d7 None admin] PATH_INFO: `/v3/domains` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:38.677071 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e692b7e-9445-4d2c-88b8-8c89a80da8d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:18:38.677367 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e692b7e-9445-4d2c-88b8-8c89a80da8d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:38.678929 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e692b7e-9445-4d2c-88b8-8c89a80da8d7 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:38.691506 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 305/598] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Sep 9 16:18:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:18:38.692341 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e692b7e-9445-4d2c-88b8-8c89a80da8d7 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:38.725927 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:38.737811 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584e00ec-f211-479a-8e4a-4a9e25cedd76 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:38.765464 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:38.781496 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3547bc6-235c-4d04-bfe8-b101eef0c320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:38.782813 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3547bc6-235c-4d04-bfe8-b101eef0c320 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:38.784335 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3547bc6-235c-4d04-bfe8-b101eef0c320 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:38.785091 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3547bc6-235c-4d04-bfe8-b101eef0c320 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:38.794858 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3547bc6-235c-4d04-bfe8-b101eef0c320 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:38.796327 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3547bc6-235c-4d04-bfe8-b101eef0c320 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:38.807737 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e692b7e-9445-4d2c-88b8-8c89a80da8d7 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:38.811425 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-c3547bc6-235c-4d04-bfe8-b101eef0c320 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 16:18:38.811425 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:18:38.811425 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:18:38.811425 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:18:38.811425 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:18:38.811425 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:18:38.811425 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:18:38.811425 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:18:38.811425 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:18:38.811425 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:18:38.811425 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:18:38.811425 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:18:38.811425 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 16:18:38.811425 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 16:18:38.811425 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 16:18:38.812288 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 16:18:38.812288 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:18:38.812288 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:18:38.812288 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:18:38.812288 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:18:38.812288 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:18:38.812288 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:18:38.812288 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:18:38.812288 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 16:18:38.812288 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:18:38.812288 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:18:38.812288 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:18:38.812288 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:18:38.812288 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:18:38.812288 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:18:38.812288 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:18:38.812288 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:18:38.813180 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 16:18:38.813180 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 16:18:38.813180 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 16:18:38.813180 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 16:18:38.813180 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 16:18:38.813180 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 16:18:38.813180 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 16:18:38.813180 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 16:18:38.813180 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 294/599] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Sep 9 16:18:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:18:38.813180 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3547bc6-235c-4d04-bfe8-b101eef0c320 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:38.851510 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf827c8e-0198-481a-8dee-3b3f1a1bbae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:38.852640 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf827c8e-0198-481a-8dee-3b3f1a1bbae0 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:38.853335 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf827c8e-0198-481a-8dee-3b3f1a1bbae0 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:38.853826 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf827c8e-0198-481a-8dee-3b3f1a1bbae0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:38.861625 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf827c8e-0198-481a-8dee-3b3f1a1bbae0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:38.864135 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf827c8e-0198-481a-8dee-3b3f1a1bbae0 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:38.878258 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-cf827c8e-0198-481a-8dee-3b3f1a1bbae0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 16:18:38.878258 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:18:38.878258 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:18:38.878258 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:18:38.878258 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:18:38.878258 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:18:38.878258 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:18:38.878258 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:18:38.878258 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:18:38.878258 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:18:38.878258 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:18:38.878258 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:18:38.878258 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 16:18:38.878258 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 16:18:38.878258 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 16:18:38.879199 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 16:18:38.879199 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:18:38.879199 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:18:38.879199 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:18:38.879199 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:18:38.879199 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:18:38.879199 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:18:38.879199 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:18:38.879199 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Sep 09 16:18:38.879199 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:18:38.879199 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:18:38.879199 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:18:38.879199 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:18:38.879199 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:18:38.879199 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:18:38.879199 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:18:38.879199 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:18:38.880090 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 16:18:38.880090 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 16:18:38.880090 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 16:18:38.880090 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 16:18:38.880090 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 16:18:38.880090 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 16:18:38.880090 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 16:18:38.880090 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:18:38.886998 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 306/600] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Sep 9 16:18:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:18:38.887684 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf827c8e-0198-481a-8dee-3b3f1a1bbae0 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:38.932424 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3547bc6-235c-4d04-bfe8-b101eef0c320 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:38.984668 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a64ebc-abea-40d1-94e6-d2be20f203da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:38.985224 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:38.985336 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a64ebc-abea-40d1-94e6-d2be20f203da None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:38.985606 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a64ebc-abea-40d1-94e6-d2be20f203da None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:38.985878 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a64ebc-abea-40d1-94e6-d2be20f203da None admin] PATH_INFO: `/v3/projects/service` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:38.994224 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a64ebc-abea-40d1-94e6-d2be20f203da None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:38.995796 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a64ebc-abea-40d1-94e6-d2be20f203da None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:39.002608 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf827c8e-0198-481a-8dee-3b3f1a1bbae0 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:39.007170 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-35a64ebc-abea-40d1-94e6-d2be20f203da None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 16:18:39.007170 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:18:39.007170 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:18:39.007170 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:18:39.007170 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:18:39.007170 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:18:39.007170 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:18:39.007170 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:18:39.007170 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:18:39.007170 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:18:39.007170 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:18:39.007170 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:18:39.007170 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 16:18:39.007170 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 16:18:39.007170 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 16:18:39.008054 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 16:18:39.008054 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:18:39.008054 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:18:39.008054 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:18:39.008054 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:18:39.008054 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:18:39.008054 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:18:39.008054 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:18:39.008054 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 16:18:39.008054 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:18:39.008054 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:18:39.008054 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:18:39.008054 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:18:39.008054 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:18:39.008054 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:18:39.008054 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:18:39.008054 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:18:39.008946 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 16:18:39.008946 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 16:18:39.008946 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 16:18:39.008946 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 16:18:39.008946 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 16:18:39.008946 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 16:18:39.008946 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 16:18:39.008946 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 16:18:39.013178 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 295/601] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Sep 9 16:18:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:18:39.013792 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a64ebc-abea-40d1-94e6-d2be20f203da None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:39.056409 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603c8fd7-35cc-432e-99ca-ed96477a0b00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:39.057438 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603c8fd7-35cc-432e-99ca-ed96477a0b00 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:39.057922 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603c8fd7-35cc-432e-99ca-ed96477a0b00 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:39.058448 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603c8fd7-35cc-432e-99ca-ed96477a0b00 None admin] PATH_INFO: `/v3/projects` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:39.059587 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603c8fd7-35cc-432e-99ca-ed96477a0b00 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:18:39.060855 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603c8fd7-35cc-432e-99ca-ed96477a0b00 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:39.063009 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603c8fd7-35cc-432e-99ca-ed96477a0b00 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:39.067114 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:39.083520 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 307/602] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Sep 9 16:18:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:18:39.084826 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603c8fd7-35cc-432e-99ca-ed96477a0b00 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:39.129967 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a64ebc-abea-40d1-94e6-d2be20f203da None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:39.165814 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec5e292-5161-496d-9960-7aa17d496657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:39.166279 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec5e292-5161-496d-9960-7aa17d496657 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:39.166581 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec5e292-5161-496d-9960-7aa17d496657 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:39.166850 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec5e292-5161-496d-9960-7aa17d496657 None admin] PATH_INFO: `/v3/projects` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:39.167550 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec5e292-5161-496d-9960-7aa17d496657 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:18:39.167836 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec5e292-5161-496d-9960-7aa17d496657 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:39.169262 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec5e292-5161-496d-9960-7aa17d496657 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:39.186477 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 296/603] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Sep 9 16:18:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:18:39.186477 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec5e292-5161-496d-9960-7aa17d496657 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:39.222483 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603c8fd7-35cc-432e-99ca-ed96477a0b00 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:39.258259 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb01170-310d-4523-99c2-2b0c6b9c5ff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:39.258775 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb01170-310d-4523-99c2-2b0c6b9c5ff7 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:39.259054 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb01170-310d-4523-99c2-2b0c6b9c5ff7 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:39.259326 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb01170-310d-4523-99c2-2b0c6b9c5ff7 None admin] PATH_INFO: `/v3/projects` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:39.260052 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb01170-310d-4523-99c2-2b0c6b9c5ff7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:18:39.260441 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb01170-310d-4523-99c2-2b0c6b9c5ff7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:39.261871 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb01170-310d-4523-99c2-2b0c6b9c5ff7 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:39.280589 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 308/604] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Sep 9 16:18:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:18:39.281521 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb01170-310d-4523-99c2-2b0c6b9c5ff7 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:39.296463 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:39.324459 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec5e292-5161-496d-9960-7aa17d496657 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:39.327129 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:39.373074 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c70e16-8973-4856-88a4-ca4d1d8dfa5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:39.374586 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c70e16-8973-4856-88a4-ca4d1d8dfa5a None admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:39.375168 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c70e16-8973-4856-88a4-ca4d1d8dfa5a None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:39.375697 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c70e16-8973-4856-88a4-ca4d1d8dfa5a None admin] PATH_INFO: `/v3/projects/68d6aaafab824657b08ca91f3d46d5f8/users/3ddd42508eee4412ae139cb8526090d6/roles/1966594501e743aebf757851d9cd82a5` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:39.396417 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c70e16-8973-4856-88a4-ca4d1d8dfa5a None admin] RBAC: Authorizing `identity:create_grant(project_id=68d6aaafab824657b08ca91f3d46d5f8, user_id=3ddd42508eee4412ae139cb8526090d6, role_id=1966594501e743aebf757851d9cd82a5)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:39.396853 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb01170-310d-4523-99c2-2b0c6b9c5ff7 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:39.398281 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c70e16-8973-4856-88a4-ca4d1d8dfa5a None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:39.417425 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 297/605] 10.222.0.27 () {58 vars in 1439 bytes} [Fri Sep 9 16:18:39 2022] PUT /identity/v3/projects/68d6aaafab824657b08ca91f3d46d5f8/users/3ddd42508eee4412ae139cb8526090d6/roles/1966594501e743aebf757851d9cd82a5 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:18:39.418511 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c70e16-8973-4856-88a4-ca4d1d8dfa5a None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:39.463733 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb04d5a-e7e9-4697-a98e-1859d9fb4c01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:39.464644 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb04d5a-e7e9-4697-a98e-1859d9fb4c01 None admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:39.465018 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb04d5a-e7e9-4697-a98e-1859d9fb4c01 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:39.465389 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb04d5a-e7e9-4697-a98e-1859d9fb4c01 None admin] PATH_INFO: `/v3/projects/68d6aaafab824657b08ca91f3d46d5f8/users/8078e791ba68460f8b3aeafb4b79b73a/roles/1966594501e743aebf757851d9cd82a5` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:39.527267 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb04d5a-e7e9-4697-a98e-1859d9fb4c01 None admin] RBAC: Authorizing `identity:create_grant(project_id=68d6aaafab824657b08ca91f3d46d5f8, user_id=8078e791ba68460f8b3aeafb4b79b73a, role_id=1966594501e743aebf757851d9cd82a5)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:39.528995 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb04d5a-e7e9-4697-a98e-1859d9fb4c01 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:39.553040 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c70e16-8973-4856-88a4-ca4d1d8dfa5a None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:39.592739 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 309/606] 10.222.0.27 () {58 vars in 1439 bytes} [Fri Sep 9 16:18:39 2022] PUT /identity/v3/projects/68d6aaafab824657b08ca91f3d46d5f8/users/8078e791ba68460f8b3aeafb4b79b73a/roles/1966594501e743aebf757851d9cd82a5 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:18:39.603206 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb902c70-5b50-4c18-8e20-b4fe35b53c1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:39.604152 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb902c70-5b50-4c18-8e20-b4fe35b53c1f None admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:39.604618 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb902c70-5b50-4c18-8e20-b4fe35b53c1f None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:39.605041 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb902c70-5b50-4c18-8e20-b4fe35b53c1f None admin] PATH_INFO: `/v3/projects/68d6aaafab824657b08ca91f3d46d5f8/users/d5f44bfdd5214e8d84a2c0a5b1fd9b84/roles/1966594501e743aebf757851d9cd82a5` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:39.636061 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb902c70-5b50-4c18-8e20-b4fe35b53c1f None admin] RBAC: Authorizing `identity:create_grant(project_id=68d6aaafab824657b08ca91f3d46d5f8, user_id=d5f44bfdd5214e8d84a2c0a5b1fd9b84, role_id=1966594501e743aebf757851d9cd82a5)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:39.637792 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb902c70-5b50-4c18-8e20-b4fe35b53c1f None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:39.654968 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 298/607] 10.222.0.27 () {58 vars in 1439 bytes} [Fri Sep 9 16:18:39 2022] PUT /identity/v3/projects/68d6aaafab824657b08ca91f3d46d5f8/users/d5f44bfdd5214e8d84a2c0a5b1fd9b84/roles/1966594501e743aebf757851d9cd82a5 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:18:39.676495 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdbdf5e-261d-48e6-ab30-920959652502 None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:39.676774 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdbdf5e-261d-48e6-ab30-920959652502 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:39.677047 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdbdf5e-261d-48e6-ab30-920959652502 None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:39.679922 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 310/608] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:18:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:18:39.686080 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3223b84f-2c6a-48ca-885c-7a7ea894358b None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:39.686633 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3223b84f-2c6a-48ca-885c-7a7ea894358b None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:39.687096 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3223b84f-2c6a-48ca-885c-7a7ea894358b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:39.698495 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:39.713763 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-3223b84f-2c6a-48ca-885c-7a7ea894358b None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:18:39.715088 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-3223b84f-2c6a-48ca-885c-7a7ea894358b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:18:39.802507 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 299/609] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:18:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 16:18:40.073964 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdbdf5e-261d-48e6-ab30-920959652502 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:40.152289 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:40.219957 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdbdf5e-261d-48e6-ab30-920959652502 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:40.270166 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce024719-3456-4373-9906-d53c355f547c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:40.271198 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce024719-3456-4373-9906-d53c355f547c None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:40.271818 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce024719-3456-4373-9906-d53c355f547c None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:40.272289 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce024719-3456-4373-9906-d53c355f547c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:40.288930 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce024719-3456-4373-9906-d53c355f547c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 16:18:40.294062 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-ce024719-3456-4373-9906-d53c355f547c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 16:18:40.294062 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:18:40.294062 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:18:40.294062 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:18:40.294062 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:18:40.294062 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:18:40.294062 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:18:40.294062 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:18:40.294062 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:18:40.294062 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:18:40.294062 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:18:40.294062 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:18:40.294062 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 16:18:40.294062 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 16:18:40.294062 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 16:18:40.294062 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 16:18:40.295024 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 16:18:40.295024 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 16:18:40.295024 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 16:18:40.295024 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 16:18:40.295024 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:18:40.295024 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:18:40.295024 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:18:40.295024 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:18:40.295024 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:18:40.295024 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:18:40.295024 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:18:40.295024 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Sep 09 16:18:40.295024 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:18:40.295024 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:18:40.295024 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:18:40.295024 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:18:40.295865 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:18:40.295865 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:18:40.295865 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:18:40.295865 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:18:40.295865 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 16:18:40.295865 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 16:18:40.295865 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 16:18:40.295865 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 16:18:40.295865 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 16:18:40.295865 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 16:18:40.295865 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 16:18:40.295865 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:18:40.298169 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 311/610] 10.222.0.27 () {56 vars in 1102 bytes} [Fri Sep 9 16:18:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:18:40.307418 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3223b84f-2c6a-48ca-885c-7a7ea894358b None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:40.448984 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3223b84f-2c6a-48ca-885c-7a7ea894358b None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:40.492037 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b8dc04-1238-4a19-ac0b-32fab4518805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:40.492636 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b8dc04-1238-4a19-ac0b-32fab4518805 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:40.492968 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b8dc04-1238-4a19-ac0b-32fab4518805 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:40.493239 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b8dc04-1238-4a19-ac0b-32fab4518805 None admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:40.493878 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b8dc04-1238-4a19-ac0b-32fab4518805 None admin] RBAC: Adding query filter params (name=service) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:18:40.494172 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b8dc04-1238-4a19-ac0b-32fab4518805 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:40.495556 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b8dc04-1238-4a19-ac0b-32fab4518805 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:40.496850 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:40.510657 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 300/611] 10.222.0.27 () {56 vars in 1103 bytes} [Fri Sep 9 16:18:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:18:40.516336 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce024719-3456-4373-9906-d53c355f547c None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:40.677989 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce024719-3456-4373-9906-d53c355f547c None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:40.696190 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:40.716245 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f3ff47-7762-472a-b3ee-e52548531981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:40.716805 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f3ff47-7762-472a-b3ee-e52548531981 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:40.717081 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f3ff47-7762-472a-b3ee-e52548531981 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:40.717353 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f3ff47-7762-472a-b3ee-e52548531981 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:40.728215 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f3ff47-7762-472a-b3ee-e52548531981 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:40.729667 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f3ff47-7762-472a-b3ee-e52548531981 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:40.748557 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-79f3ff47-7762-472a-b3ee-e52548531981 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 16:18:40.748557 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:18:40.748557 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:18:40.748557 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:18:40.748557 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:18:40.748557 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:18:40.748557 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:18:40.748557 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:18:40.748557 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:18:40.748557 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:18:40.748557 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:18:40.748557 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:18:40.748557 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 16:18:40.748557 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 16:18:40.748557 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 16:18:40.748557 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 16:18:40.749548 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:18:40.749548 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:18:40.749548 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:18:40.749548 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:18:40.749548 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:18:40.749548 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:18:40.749548 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:18:40.749548 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Sep 09 16:18:40.749548 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:18:40.749548 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:18:40.749548 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:18:40.749548 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:18:40.749548 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:18:40.749548 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:18:40.749548 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:18:40.749548 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:18:40.749548 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 16:18:40.750489 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 16:18:40.750489 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 16:18:40.750489 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:18:40.750489 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 312/612] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 16:18:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:18:40.763411 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b8dc04-1238-4a19-ac0b-32fab4518805 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:40.897621 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b8dc04-1238-4a19-ac0b-32fab4518805 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:40.937926 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315f2a55-ad36-4842-8635-affa74ddd828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:40.938544 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315f2a55-ad36-4842-8635-affa74ddd828 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:40.938819 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315f2a55-ad36-4842-8635-affa74ddd828 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:40.939087 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315f2a55-ad36-4842-8635-affa74ddd828 None admin] PATH_INFO: `/v3/domains` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:40.939707 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315f2a55-ad36-4842-8635-affa74ddd828 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:18:40.940535 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315f2a55-ad36-4842-8635-affa74ddd828 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:40.941896 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315f2a55-ad36-4842-8635-affa74ddd828 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:40.954002 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 301/613] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Sep 9 16:18:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:18:40.959911 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f3ff47-7762-472a-b3ee-e52548531981 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:41.107262 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef402f9-cfb6-4d45-a09c-3afa5364c5dc None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:41.107974 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef402f9-cfb6-4d45-a09c-3afa5364c5dc None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:41.108459 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef402f9-cfb6-4d45-a09c-3afa5364c5dc None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:41.110422 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 302/614] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:18:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:18:41.116736 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cff74c-0c1d-4918-bf30-d5f606ae7a85 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:41.117021 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cff74c-0c1d-4918-bf30-d5f606ae7a85 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:41.117297 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cff74c-0c1d-4918-bf30-d5f606ae7a85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:41.136385 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f3ff47-7762-472a-b3ee-e52548531981 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:41.154696 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-05cff74c-0c1d-4918-bf30-d5f606ae7a85 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:18:41.155890 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-05cff74c-0c1d-4918-bf30-d5f606ae7a85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:18:41.176018 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356ad08d-b8f7-4c8f-a26c-d624f2eddc9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:41.176650 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356ad08d-b8f7-4c8f-a26c-d624f2eddc9b None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:41.176929 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356ad08d-b8f7-4c8f-a26c-d624f2eddc9b None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:41.177199 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356ad08d-b8f7-4c8f-a26c-d624f2eddc9b None admin] PATH_INFO: `/v3/users/swift` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:41.194532 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356ad08d-b8f7-4c8f-a26c-d624f2eddc9b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:41.195978 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356ad08d-b8f7-4c8f-a26c-d624f2eddc9b None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:41.216765 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-356ad08d-b8f7-4c8f-a26c-d624f2eddc9b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 09 16:18:41.216765 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:18:41.216765 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:18:41.216765 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:18:41.216765 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:18:41.216765 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:18:41.216765 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:18:41.216765 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:18:41.216765 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:18:41.216765 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:18:41.216765 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:18:41.216765 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:18:41.216765 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 16:18:41.216765 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 16:18:41.216765 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 16:18:41.216765 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 16:18:41.217753 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:18:41.217753 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:18:41.217753 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 16:18:41.217753 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 16:18:41.217753 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 16:18:41.217753 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 16:18:41.217753 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:18:41.217753 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:18:41.217753 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:18:41.217753 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:18:41.217753 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:18:41.217753 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Sep 09 16:18:41.217753 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:18:41.217753 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:18:41.217753 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:18:41.217753 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:18:41.217753 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:18:41.217753 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:18:41.218796 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:18:41.218796 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:18:41.218796 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 16:18:41.218796 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 16:18:41.218796 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 16:18:41.218796 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 16:18:41.218796 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 16:18:41.218796 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 16:18:41.218796 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 09 16:18:41.218796 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:18:41.218796 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 313/615] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Sep 9 16:18:40 2022] GET /identity/v3/users/swift => generated 83 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:18:41.225432 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356ad08d-b8f7-4c8f-a26c-d624f2eddc9b None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:41.261463 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:41.287868 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:41.305943 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 303/616] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:18:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 16:18:41.375645 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356ad08d-b8f7-4c8f-a26c-d624f2eddc9b None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:41.416185 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19ad570-32c1-4348-b897-bd3511009047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:41.416805 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19ad570-32c1-4348-b897-bd3511009047 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:41.417084 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19ad570-32c1-4348-b897-bd3511009047 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:41.417359 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19ad570-32c1-4348-b897-bd3511009047 None admin] PATH_INFO: `/v3/users` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:41.418088 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19ad570-32c1-4348-b897-bd3511009047 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:18:41.418415 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19ad570-32c1-4348-b897-bd3511009047 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:41.419944 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19ad570-32c1-4348-b897-bd3511009047 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:41.444528 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 314/617] 10.222.0.27 () {56 vars in 1135 bytes} [Fri Sep 9 16:18:41 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:18:41.450569 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cff74c-0c1d-4918-bf30-d5f606ae7a85 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:41.579116 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cff74c-0c1d-4918-bf30-d5f606ae7a85 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:41.632184 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19ad570-32c1-4348-b897-bd3511009047 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:41.635060 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bd45cd-45f1-4da7-bfc6-49960fa6b7bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:41.635726 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bd45cd-45f1-4da7-bfc6-49960fa6b7bd None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:41.636004 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bd45cd-45f1-4da7-bfc6-49960fa6b7bd None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:41.636275 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bd45cd-45f1-4da7-bfc6-49960fa6b7bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:41.648988 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bd45cd-45f1-4da7-bfc6-49960fa6b7bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:41.648988 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bd45cd-45f1-4da7-bfc6-49960fa6b7bd None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:41.671453 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-15bd45cd-45f1-4da7-bfc6-49960fa6b7bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 16:18:41.671453 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:18:41.671453 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:18:41.671453 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:18:41.671453 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:18:41.671453 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:18:41.671453 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:18:41.671453 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:18:41.671453 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:18:41.671453 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:18:41.671453 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:18:41.671453 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:18:41.671453 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 16:18:41.671453 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 16:18:41.671453 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 16:18:41.671453 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 16:18:41.672454 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:18:41.672454 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:18:41.672454 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:18:41.672454 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:18:41.672454 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:18:41.672454 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:18:41.672454 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:18:41.672454 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 16:18:41.672454 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:18:41.672454 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:18:41.672454 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:18:41.672454 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:18:41.672454 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:18:41.672454 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:18:41.672454 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:18:41.672454 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:18:41.672454 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 16:18:41.673347 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 16:18:41.673347 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 16:18:41.673347 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 16:18:41.676266 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 304/618] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 16:18:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:18:41.680389 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bd45cd-45f1-4da7-bfc6-49960fa6b7bd None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:41.748281 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:41.762795 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:41.782342 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19ad570-32c1-4348-b897-bd3511009047 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:41.813738 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f732067f-d52a-4a37-b324-c8d6b47abd24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:41.814399 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f732067f-d52a-4a37-b324-c8d6b47abd24 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:41.814677 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f732067f-d52a-4a37-b324-c8d6b47abd24 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:41.814981 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f732067f-d52a-4a37-b324-c8d6b47abd24 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:41.825529 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f732067f-d52a-4a37-b324-c8d6b47abd24 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 16:18:41.830418 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-f732067f-d52a-4a37-b324-c8d6b47abd24 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 16:18:41.830418 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:18:41.830418 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:18:41.830418 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:18:41.830418 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:18:41.830418 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:18:41.830418 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:18:41.830418 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:18:41.830418 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:18:41.830418 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:18:41.830418 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:18:41.830418 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:18:41.830418 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 16:18:41.830418 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 16:18:41.830418 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 16:18:41.830418 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 16:18:41.831567 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 16:18:41.831567 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 16:18:41.831567 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 16:18:41.831567 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 16:18:41.831567 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:18:41.831567 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:18:41.831567 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:18:41.831567 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:18:41.831567 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:18:41.831567 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:18:41.831567 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:18:41.831567 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Sep 09 16:18:41.831567 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:18:41.831567 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:18:41.831567 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:18:41.831567 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:18:41.837280 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:18:41.837280 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:18:41.837280 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:18:41.837280 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:18:41.837280 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 16:18:41.837280 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 16:18:41.837280 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 16:18:41.837280 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 16:18:41.837280 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 16:18:41.837280 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 16:18:41.837280 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 16:18:41.837280 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:18:41.837280 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 315/619] 10.222.0.27 () {56 vars in 1102 bytes} [Fri Sep 9 16:18:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 16:18:41.839656 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f732067f-d52a-4a37-b324-c8d6b47abd24 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:41.852254 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bd45cd-45f1-4da7-bfc6-49960fa6b7bd None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:41.888131 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dca289e-0437-4b4d-9486-8e77244fc689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:41.889177 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dca289e-0437-4b4d-9486-8e77244fc689 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:41.889748 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dca289e-0437-4b4d-9486-8e77244fc689 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:41.890234 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dca289e-0437-4b4d-9486-8e77244fc689 None admin] PATH_INFO: `/v3/domains` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:41.891110 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dca289e-0437-4b4d-9486-8e77244fc689 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:18:41.891629 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dca289e-0437-4b4d-9486-8e77244fc689 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:41.893775 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dca289e-0437-4b4d-9486-8e77244fc689 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:41.913570 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 305/620] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Sep 9 16:18:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:18:41.919114 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dca289e-0437-4b4d-9486-8e77244fc689 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:42.051276 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f732067f-d52a-4a37-b324-c8d6b47abd24 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:42.085354 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dca289e-0437-4b4d-9486-8e77244fc689 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:42.090628 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adca2d28-3fad-46d5-857e-f252ff300baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:42.091232 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adca2d28-3fad-46d5-857e-f252ff300baf None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:42.091507 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adca2d28-3fad-46d5-857e-f252ff300baf None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:42.091774 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adca2d28-3fad-46d5-857e-f252ff300baf None admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:42.092422 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adca2d28-3fad-46d5-857e-f252ff300baf None admin] RBAC: Adding query filter params (name=service) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:18:42.092719 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adca2d28-3fad-46d5-857e-f252ff300baf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:42.094084 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adca2d28-3fad-46d5-857e-f252ff300baf None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:42.102958 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:42.110609 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 316/621] 10.222.0.27 () {56 vars in 1103 bytes} [Fri Sep 9 16:18:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:18:42.110609 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b42ec1-f1a3-449d-8a11-43b4663b48dc None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:42.110609 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b42ec1-f1a3-449d-8a11-43b4663b48dc None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:42.110609 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b42ec1-f1a3-449d-8a11-43b4663b48dc None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:42.114414 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 317/622] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:18:42 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:18:42.116168 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b42ec1-f1a3-449d-8a11-43b4663b48dc None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:42.132741 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:42.134175 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af35c05-7a68-48a8-978c-7414c4a009eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:42.135187 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af35c05-7a68-48a8-978c-7414c4a009eb None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:42.135654 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af35c05-7a68-48a8-978c-7414c4a009eb None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:42.136108 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af35c05-7a68-48a8-978c-7414c4a009eb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:42.144359 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af35c05-7a68-48a8-978c-7414c4a009eb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:42.146055 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af35c05-7a68-48a8-978c-7414c4a009eb None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:42.157693 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-5af35c05-7a68-48a8-978c-7414c4a009eb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 16:18:42.157693 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:18:42.157693 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:18:42.157693 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:18:42.157693 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:18:42.157693 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:18:42.157693 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:18:42.157693 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:18:42.157693 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:18:42.157693 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:18:42.157693 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:18:42.157693 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:18:42.157693 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 16:18:42.157693 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 16:18:42.157693 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 16:18:42.159368 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 16:18:42.159368 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:18:42.159368 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:18:42.159368 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:18:42.159368 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:18:42.159368 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:18:42.159368 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:18:42.159368 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:18:42.159368 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 16:18:42.159368 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:18:42.159368 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:18:42.159368 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:18:42.159368 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:18:42.159368 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:18:42.159368 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:18:42.159368 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:18:42.159368 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:18:42.160267 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 16:18:42.160267 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 16:18:42.160267 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 16:18:42.160267 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 16:18:42.160267 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 16:18:42.160267 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 16:18:42.160267 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 16:18:42.160267 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 16:18:42.162550 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 306/623] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Sep 9 16:18:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 16:18:42.163981 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb23026-c96b-4a57-9448-3e3624e36660 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:42.164393 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb23026-c96b-4a57-9448-3e3624e36660 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:42.164792 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb23026-c96b-4a57-9448-3e3624e36660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:42.183591 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-5bb23026-c96b-4a57-9448-3e3624e36660 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:18:42.185384 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-5bb23026-c96b-4a57-9448-3e3624e36660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:18:42.243706 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b42ec1-f1a3-449d-8a11-43b4663b48dc None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:42.268866 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 307/624] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:18:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 16:18:42.270036 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb23026-c96b-4a57-9448-3e3624e36660 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:42.310724 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaaba57-966a-44e2-823b-917e4b6f1438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:42.312316 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaaba57-966a-44e2-823b-917e4b6f1438 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:42.312806 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaaba57-966a-44e2-823b-917e4b6f1438 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:42.313271 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaaba57-966a-44e2-823b-917e4b6f1438 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:42.334103 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaaba57-966a-44e2-823b-917e4b6f1438 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:42.336110 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaaba57-966a-44e2-823b-917e4b6f1438 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:42.361591 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-8eaaba57-966a-44e2-823b-917e4b6f1438 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 16:18:42.361591 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:18:42.361591 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:18:42.361591 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:18:42.361591 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:18:42.361591 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:18:42.361591 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:18:42.361591 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:18:42.361591 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:18:42.361591 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:18:42.361591 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:18:42.361591 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:18:42.361591 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 16:18:42.361591 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 16:18:42.361591 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 16:18:42.361591 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 16:18:42.363219 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:18:42.363219 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:18:42.363219 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:18:42.363219 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:18:42.363219 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:18:42.363219 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:18:42.363219 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:18:42.363219 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Sep 09 16:18:42.363219 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:18:42.363219 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:18:42.363219 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:18:42.363219 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:18:42.363219 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:18:42.363219 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:18:42.363219 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:18:42.363219 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:18:42.363219 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 16:18:42.364109 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 16:18:42.364109 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 16:18:42.364109 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:18:42.369548 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 318/625] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 16:18:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:18:42.372210 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d370022-884b-4d36-8fff-4966fc7be092 None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:42.372502 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d370022-884b-4d36-8fff-4966fc7be092 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:42.372779 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d370022-884b-4d36-8fff-4966fc7be092 None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:42.374881 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 319/626] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:18:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 16:18:42.375717 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d370022-884b-4d36-8fff-4966fc7be092 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:42.412311 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:42.428306 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb23026-c96b-4a57-9448-3e3624e36660 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:42.455176 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:42.472732 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26968c4-e9f5-4e66-bc46-dec2275cb343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:42.473356 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26968c4-e9f5-4e66-bc46-dec2275cb343 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:42.473637 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26968c4-e9f5-4e66-bc46-dec2275cb343 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:42.473909 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26968c4-e9f5-4e66-bc46-dec2275cb343 None admin] PATH_INFO: `/v3/projects` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:42.474631 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26968c4-e9f5-4e66-bc46-dec2275cb343 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:18:42.474936 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26968c4-e9f5-4e66-bc46-dec2275cb343 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:42.476375 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26968c4-e9f5-4e66-bc46-dec2275cb343 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:42.498349 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 308/627] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Sep 9 16:18:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:18:42.498349 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4622318b-5623-41ba-9fc7-549f42eb1d59 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:42.498349 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4622318b-5623-41ba-9fc7-549f42eb1d59 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:42.498349 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4622318b-5623-41ba-9fc7-549f42eb1d59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:42.514065 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-4622318b-5623-41ba-9fc7-549f42eb1d59 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:18:42.515282 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-4622318b-5623-41ba-9fc7-549f42eb1d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:18:42.519108 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d370022-884b-4d36-8fff-4966fc7be092 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:42.556816 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb1c5e3-0eed-48aa-bec4-cb5d183b4cb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:42.557422 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb1c5e3-0eed-48aa-bec4-cb5d183b4cb6 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:42.557700 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb1c5e3-0eed-48aa-bec4-cb5d183b4cb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:42.557960 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb1c5e3-0eed-48aa-bec4-cb5d183b4cb6 None admin] PATH_INFO: `/v3/domains` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:42.559062 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb1c5e3-0eed-48aa-bec4-cb5d183b4cb6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:18:42.559603 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb1c5e3-0eed-48aa-bec4-cb5d183b4cb6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:42.561405 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb1c5e3-0eed-48aa-bec4-cb5d183b4cb6 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:42.575326 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 320/628] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Sep 9 16:18:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:18:42.576553 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f0cd00-2712-4d29-ada1-8a5afd46e349 None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:42.576838 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f0cd00-2712-4d29-ada1-8a5afd46e349 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:42.577106 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f0cd00-2712-4d29-ada1-8a5afd46e349 None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:42.578476 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 321/629] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:18:42 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:18:42.583072 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f0cd00-2712-4d29-ada1-8a5afd46e349 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:42.590455 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 309/630] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:18:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 16:18:42.590455 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4622318b-5623-41ba-9fc7-549f42eb1d59 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:42.674498 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:42.695656 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f0cd00-2712-4d29-ada1-8a5afd46e349 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:42.698913 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4622318b-5623-41ba-9fc7-549f42eb1d59 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:42.719791 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:42.732781 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab572bb-adae-4c8d-9f81-05e58a4ca01f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:42.733430 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab572bb-adae-4c8d-9f81-05e58a4ca01f None admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:42.733708 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab572bb-adae-4c8d-9f81-05e58a4ca01f None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:42.733979 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab572bb-adae-4c8d-9f81-05e58a4ca01f None admin] PATH_INFO: `/v3/projects/68d6aaafab824657b08ca91f3d46d5f8/users/a2350bbc4a194c2dab2e3be830fd0eba/roles/1966594501e743aebf757851d9cd82a5` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:42.737729 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0056099-e7a7-4104-8509-b765657c1713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:42.737729 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0056099-e7a7-4104-8509-b765657c1713 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:42.738013 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0056099-e7a7-4104-8509-b765657c1713 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:42.738281 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0056099-e7a7-4104-8509-b765657c1713 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:42.745324 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0056099-e7a7-4104-8509-b765657c1713 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:42.746860 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0056099-e7a7-4104-8509-b765657c1713 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:42.751102 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab572bb-adae-4c8d-9f81-05e58a4ca01f None admin] RBAC: Authorizing `identity:create_grant(project_id=68d6aaafab824657b08ca91f3d46d5f8, user_id=a2350bbc4a194c2dab2e3be830fd0eba, role_id=1966594501e743aebf757851d9cd82a5)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:42.752573 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab572bb-adae-4c8d-9f81-05e58a4ca01f None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:42.758953 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-b0056099-e7a7-4104-8509-b765657c1713 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 09 16:18:42.758953 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:18:42.758953 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:18:42.758953 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:18:42.758953 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:18:42.758953 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:18:42.758953 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:18:42.758953 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:18:42.758953 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:18:42.758953 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:18:42.758953 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:18:42.758953 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:18:42.758953 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 16:18:42.758953 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 16:18:42.758953 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 16:18:42.758953 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 16:18:42.760171 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:18:42.760171 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:18:42.760171 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 16:18:42.760171 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 16:18:42.760171 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 16:18:42.760171 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 16:18:42.760171 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:18:42.760171 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:18:42.760171 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:18:42.760171 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:18:42.760171 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:18:42.760171 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 16:18:42.760171 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:18:42.760171 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:18:42.760171 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:18:42.760171 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:18:42.760171 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:18:42.760171 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:18:42.761795 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:18:42.761795 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:18:42.761795 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 16:18:42.761795 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 16:18:42.761795 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 16:18:42.761795 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 16:18:42.761795 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 16:18:42.761795 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 16:18:42.761795 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 09 16:18:42.761795 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 16:18:42.765076 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 310/631] 10.222.0.27 () {56 vars in 1093 bytes} [Fri Sep 9 16:18:42 2022] GET /identity/v3/users/nova => generated 82 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:18:42.766472 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a2e5fd-10b8-4041-9033-406efe14824a None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:42.766762 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a2e5fd-10b8-4041-9033-406efe14824a None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:42.767029 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a2e5fd-10b8-4041-9033-406efe14824a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:42.771863 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 322/632] 10.222.0.27 () {58 vars in 1439 bytes} [Fri Sep 9 16:18:42 2022] PUT /identity/v3/projects/68d6aaafab824657b08ca91f3d46d5f8/users/a2350bbc4a194c2dab2e3be830fd0eba/roles/1966594501e743aebf757851d9cd82a5 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:18:42.773222 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab572bb-adae-4c8d-9f81-05e58a4ca01f None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:42.798687 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-29a2e5fd-10b8-4041-9033-406efe14824a None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:18:42.800561 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-29a2e5fd-10b8-4041-9033-406efe14824a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:18:42.883776 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 311/633] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:18:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 16:18:42.885483 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a2e5fd-10b8-4041-9033-406efe14824a None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:42.912651 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab572bb-adae-4c8d-9f81-05e58a4ca01f None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:42.960071 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74747a8d-60dc-49e7-b6b7-ff9faf38f79c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:42.960633 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74747a8d-60dc-49e7-b6b7-ff9faf38f79c None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:42.960916 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74747a8d-60dc-49e7-b6b7-ff9faf38f79c None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:42.961183 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74747a8d-60dc-49e7-b6b7-ff9faf38f79c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:42.969373 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:42.975141 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74747a8d-60dc-49e7-b6b7-ff9faf38f79c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 16:18:42.980001 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-74747a8d-60dc-49e7-b6b7-ff9faf38f79c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 16:18:42.980001 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:18:42.980001 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:18:42.980001 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:18:42.980001 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:18:42.980001 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:18:42.980001 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:18:42.980001 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:18:42.980001 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:18:42.980001 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:18:42.980001 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:18:42.980001 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:18:42.980001 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 16:18:42.980001 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 16:18:42.980001 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 16:18:42.980001 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 16:18:42.980951 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 16:18:42.980951 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 16:18:42.980951 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 16:18:42.980951 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 16:18:42.980951 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:18:42.980951 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:18:42.980951 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:18:42.980951 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:18:42.980951 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:18:42.980951 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:18:42.980951 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:18:42.980951 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Sep 09 16:18:42.980951 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:18:42.980951 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:18:42.980951 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:18:42.980951 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:18:42.987284 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:18:42.987284 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:18:42.987284 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:18:42.987284 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:18:42.987284 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 16:18:42.987284 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 16:18:42.987284 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 16:18:42.987284 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 16:18:42.987284 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 16:18:42.987284 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 16:18:42.987284 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 16:18:42.987284 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:18:42.987284 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 323/634] 10.222.0.27 () {56 vars in 1102 bytes} [Fri Sep 9 16:18:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:18:42.987284 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74747a8d-60dc-49e7-b6b7-ff9faf38f79c None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:43.023118 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a2e5fd-10b8-4041-9033-406efe14824a None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:43.024441 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:43.066122 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddffded-8f62-4313-9a02-23743c228e10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:43.067287 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddffded-8f62-4313-9a02-23743c228e10 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:43.068178 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddffded-8f62-4313-9a02-23743c228e10 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:43.068607 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddffded-8f62-4313-9a02-23743c228e10 None admin] PATH_INFO: `/v3/users` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:43.069732 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddffded-8f62-4313-9a02-23743c228e10 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:18:43.070468 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddffded-8f62-4313-9a02-23743c228e10 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:43.072786 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddffded-8f62-4313-9a02-23743c228e10 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:43.101366 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 312/635] 10.222.0.27 () {56 vars in 1133 bytes} [Fri Sep 9 16:18:42 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:18:43.102917 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddffded-8f62-4313-9a02-23743c228e10 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:43.121089 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74747a8d-60dc-49e7-b6b7-ff9faf38f79c None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:43.162784 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6047924e-665f-4273-aadb-fbdfee536bfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:43.163512 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6047924e-665f-4273-aadb-fbdfee536bfa None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:43.163860 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6047924e-665f-4273-aadb-fbdfee536bfa None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:43.164200 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6047924e-665f-4273-aadb-fbdfee536bfa None admin] PATH_INFO: `/v3/roles/service` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:43.176328 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6047924e-665f-4273-aadb-fbdfee536bfa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 16:18:43.182190 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-6047924e-665f-4273-aadb-fbdfee536bfa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 16:18:43.182190 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:18:43.182190 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:18:43.182190 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:18:43.182190 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:18:43.182190 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:18:43.182190 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:18:43.182190 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:18:43.182190 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:18:43.182190 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:18:43.182190 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:18:43.182190 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:18:43.182190 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 16:18:43.182190 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 16:18:43.182190 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 16:18:43.182190 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 16:18:43.183360 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 16:18:43.183360 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 16:18:43.183360 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 16:18:43.183360 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 16:18:43.183360 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:18:43.183360 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:18:43.183360 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:18:43.183360 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:18:43.183360 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:18:43.183360 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:18:43.183360 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:18:43.183360 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Sep 09 16:18:43.183360 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:18:43.183360 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:18:43.183360 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:18:43.183360 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:18:43.184328 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:18:43.184328 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:18:43.184328 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:18:43.184328 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:18:43.184328 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 16:18:43.184328 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 16:18:43.184328 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 16:18:43.184328 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 16:18:43.184328 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 16:18:43.184328 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 16:18:43.184328 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 16:18:43.184328 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:18:43.184328 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 324/636] 10.222.0.27 () {56 vars in 1102 bytes} [Fri Sep 9 16:18:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:18:43.184328 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6047924e-665f-4273-aadb-fbdfee536bfa None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:43.231970 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddffded-8f62-4313-9a02-23743c228e10 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:43.260806 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:43.271216 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b512e10-bcdb-4977-b252-58f2e8e113b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:43.271819 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b512e10-bcdb-4977-b252-58f2e8e113b6 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:43.272096 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b512e10-bcdb-4977-b252-58f2e8e113b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:43.272364 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b512e10-bcdb-4977-b252-58f2e8e113b6 None admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:43.273015 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b512e10-bcdb-4977-b252-58f2e8e113b6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:18:43.273314 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b512e10-bcdb-4977-b252-58f2e8e113b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:43.274719 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b512e10-bcdb-4977-b252-58f2e8e113b6 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:43.289046 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 313/637] 10.222.0.27 () {56 vars in 1103 bytes} [Fri Sep 9 16:18:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:18:43.289970 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b512e10-bcdb-4977-b252-58f2e8e113b6 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:43.291614 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:43.303168 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6047924e-665f-4273-aadb-fbdfee536bfa None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:43.339750 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58121c7-1850-480e-9050-97a01d49e2cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:43.340358 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58121c7-1850-480e-9050-97a01d49e2cb None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:43.340631 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58121c7-1850-480e-9050-97a01d49e2cb None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:43.340900 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58121c7-1850-480e-9050-97a01d49e2cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:43.401719 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b512e10-bcdb-4977-b252-58f2e8e113b6 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:43.415636 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58121c7-1850-480e-9050-97a01d49e2cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:43.417226 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58121c7-1850-480e-9050-97a01d49e2cb None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:43.441836 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d314fe14-ac51-445c-996c-01c5a4aa0657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:43.442739 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d314fe14-ac51-445c-996c-01c5a4aa0657 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:43.443023 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d314fe14-ac51-445c-996c-01c5a4aa0657 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:43.443296 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d314fe14-ac51-445c-996c-01c5a4aa0657 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:43.456888 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d314fe14-ac51-445c-996c-01c5a4aa0657 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 16:18:43.463732 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-d314fe14-ac51-445c-996c-01c5a4aa0657 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 16:18:43.463732 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:18:43.463732 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:18:43.463732 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:18:43.463732 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:18:43.463732 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:18:43.463732 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:18:43.463732 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:18:43.463732 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:18:43.463732 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:18:43.463732 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:18:43.463732 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:18:43.463732 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 16:18:43.463732 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 16:18:43.463732 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 16:18:43.463732 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 16:18:43.464834 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 16:18:43.464834 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 16:18:43.464834 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 16:18:43.464834 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 16:18:43.464834 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:18:43.464834 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:18:43.464834 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:18:43.464834 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:18:43.464834 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:18:43.464834 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:18:43.464834 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:18:43.464834 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 16:18:43.464834 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:18:43.464834 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:18:43.464834 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:18:43.464834 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:18:43.465714 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:18:43.465714 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:18:43.465714 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:18:43.465714 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:18:43.465714 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 16:18:43.465714 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 16:18:43.465714 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 16:18:43.465714 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 16:18:43.465714 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 16:18:43.465714 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 16:18:43.465714 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 16:18:43.465714 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 16:18:43.465714 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 314/638] 10.222.0.27 () {56 vars in 1102 bytes} [Fri Sep 9 16:18:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:18:43.466474 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d314fe14-ac51-445c-996c-01c5a4aa0657 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:43.519783 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:43.522826 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:43.532073 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 325/639] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Sep 9 16:18:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 16:18:43.533407 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58121c7-1850-480e-9050-97a01d49e2cb None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:43.586436 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d314fe14-ac51-445c-996c-01c5a4aa0657 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:43.625816 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6cdb47-b173-4a91-a88b-e3a2584b2559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:43.626464 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6cdb47-b173-4a91-a88b-e3a2584b2559 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:43.626743 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6cdb47-b173-4a91-a88b-e3a2584b2559 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:43.627010 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6cdb47-b173-4a91-a88b-e3a2584b2559 None admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:43.628222 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6cdb47-b173-4a91-a88b-e3a2584b2559 None admin] RBAC: Adding query filter params (name=service) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:18:43.628518 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6cdb47-b173-4a91-a88b-e3a2584b2559 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:43.629883 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6cdb47-b173-4a91-a88b-e3a2584b2559 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:43.638108 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 315/640] 10.222.0.27 () {56 vars in 1103 bytes} [Fri Sep 9 16:18:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:18:43.638746 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6cdb47-b173-4a91-a88b-e3a2584b2559 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:43.647629 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58121c7-1850-480e-9050-97a01d49e2cb None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:43.682146 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7329f9bf-4a23-460a-9ff4-23abcf2dc23a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:43.682796 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7329f9bf-4a23-460a-9ff4-23abcf2dc23a None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:43.683073 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7329f9bf-4a23-460a-9ff4-23abcf2dc23a None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:43.683337 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7329f9bf-4a23-460a-9ff4-23abcf2dc23a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:43.694634 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7329f9bf-4a23-460a-9ff4-23abcf2dc23a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:43.696133 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7329f9bf-4a23-460a-9ff4-23abcf2dc23a None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:43.712888 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-7329f9bf-4a23-460a-9ff4-23abcf2dc23a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 16:18:43.712888 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:18:43.712888 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:18:43.712888 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:18:43.712888 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:18:43.712888 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:18:43.712888 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:18:43.712888 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:18:43.712888 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:18:43.712888 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:18:43.712888 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:18:43.712888 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:18:43.712888 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 16:18:43.712888 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 16:18:43.712888 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 16:18:43.712888 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 16:18:43.713934 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:18:43.713934 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:18:43.713934 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:18:43.713934 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:18:43.713934 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:18:43.713934 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:18:43.713934 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:18:43.713934 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Sep 09 16:18:43.713934 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:18:43.713934 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:18:43.713934 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:18:43.713934 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:18:43.713934 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:18:43.713934 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:18:43.713934 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:18:43.713934 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:18:43.713934 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 16:18:43.715261 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 16:18:43.715261 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 16:18:43.715261 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:18:43.715261 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 326/641] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 16:18:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:18:43.715261 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7329f9bf-4a23-460a-9ff4-23abcf2dc23a None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:43.751595 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6cdb47-b173-4a91-a88b-e3a2584b2559 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:43.762147 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:43.763178 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:43.787445 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e676803-4329-4a7f-a1ea-170d74a9940c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:43.787964 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e676803-4329-4a7f-a1ea-170d74a9940c None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:43.788238 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e676803-4329-4a7f-a1ea-170d74a9940c None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:43.788507 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e676803-4329-4a7f-a1ea-170d74a9940c None admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:43.789149 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e676803-4329-4a7f-a1ea-170d74a9940c None admin] RBAC: Adding query filter params (name=service) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:18:43.789442 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e676803-4329-4a7f-a1ea-170d74a9940c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:43.792317 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e676803-4329-4a7f-a1ea-170d74a9940c None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:43.811439 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 316/642] 10.222.0.27 () {56 vars in 1103 bytes} [Fri Sep 9 16:18:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:18:43.811439 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e676803-4329-4a7f-a1ea-170d74a9940c None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:43.824720 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7329f9bf-4a23-460a-9ff4-23abcf2dc23a None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:43.866116 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd5b872-af04-4c95-97c6-66143a994d00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:43.866771 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd5b872-af04-4c95-97c6-66143a994d00 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:43.867048 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd5b872-af04-4c95-97c6-66143a994d00 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:43.867317 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd5b872-af04-4c95-97c6-66143a994d00 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:43.878467 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd5b872-af04-4c95-97c6-66143a994d00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:43.879902 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd5b872-af04-4c95-97c6-66143a994d00 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:43.893660 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-8dd5b872-af04-4c95-97c6-66143a994d00 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 16:18:43.893660 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:18:43.893660 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:18:43.893660 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:18:43.893660 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:18:43.893660 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:18:43.893660 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:18:43.893660 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:18:43.893660 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:18:43.893660 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:18:43.893660 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:18:43.893660 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:18:43.893660 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 16:18:43.893660 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 16:18:43.893660 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 16:18:43.893660 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 16:18:43.894748 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:18:43.894748 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:18:43.894748 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:18:43.894748 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:18:43.894748 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:18:43.894748 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:18:43.894748 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:18:43.894748 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Sep 09 16:18:43.894748 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:18:43.894748 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:18:43.894748 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:18:43.894748 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:18:43.894748 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:18:43.894748 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:18:43.894748 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:18:43.894748 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:18:43.894748 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 16:18:43.895653 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 16:18:43.895653 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 16:18:43.895653 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:18:43.895653 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 327/643] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 16:18:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:18:43.895653 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd5b872-af04-4c95-97c6-66143a994d00 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:43.916591 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e676803-4329-4a7f-a1ea-170d74a9940c None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:43.951471 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9522a5-6cbb-4504-8899-f3f1f767443c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:43.952103 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9522a5-6cbb-4504-8899-f3f1f767443c None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:43.952388 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9522a5-6cbb-4504-8899-f3f1f767443c None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:43.952661 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9522a5-6cbb-4504-8899-f3f1f767443c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:43.963580 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9522a5-6cbb-4504-8899-f3f1f767443c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:43.965031 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9522a5-6cbb-4504-8899-f3f1f767443c None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:43.979715 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-db9522a5-6cbb-4504-8899-f3f1f767443c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 16:18:43.979715 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:18:43.979715 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:18:43.979715 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:18:43.979715 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:18:43.979715 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:18:43.979715 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:18:43.979715 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:18:43.979715 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:18:43.979715 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:18:43.979715 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:18:43.979715 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:18:43.979715 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 16:18:43.979715 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 16:18:43.979715 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 16:18:43.979715 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 16:18:43.980665 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:18:43.980665 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:18:43.980665 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:18:43.980665 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:18:43.980665 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:18:43.980665 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:18:43.980665 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:18:43.980665 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 16:18:43.980665 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:18:43.980665 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:18:43.980665 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:18:43.980665 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:18:43.980665 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:18:43.980665 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:18:43.980665 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:18:43.980665 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:18:43.980665 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 16:18:43.981718 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 16:18:43.981718 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 16:18:43.981718 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 16:18:43.981718 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 317/644] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 16:18:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:18:43.981718 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9522a5-6cbb-4504-8899-f3f1f767443c None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:44.003924 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:44.008291 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:44.010201 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd5b872-af04-4c95-97c6-66143a994d00 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:44.044634 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf27b80-34ff-4ee6-b7e0-7bb986d49930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:44.045163 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf27b80-34ff-4ee6-b7e0-7bb986d49930 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:44.045439 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf27b80-34ff-4ee6-b7e0-7bb986d49930 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:44.045707 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf27b80-34ff-4ee6-b7e0-7bb986d49930 None admin] PATH_INFO: `/v3/domains` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:44.046417 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf27b80-34ff-4ee6-b7e0-7bb986d49930 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:18:44.046723 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf27b80-34ff-4ee6-b7e0-7bb986d49930 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:44.048236 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf27b80-34ff-4ee6-b7e0-7bb986d49930 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:44.066191 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 328/645] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Sep 9 16:18:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:18:44.066191 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf27b80-34ff-4ee6-b7e0-7bb986d49930 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:44.091219 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9522a5-6cbb-4504-8899-f3f1f767443c None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:44.125389 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae3cd80-7b04-4164-a607-16a0b6d45991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:44.126167 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae3cd80-7b04-4164-a607-16a0b6d45991 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:44.126575 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae3cd80-7b04-4164-a607-16a0b6d45991 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:44.126971 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae3cd80-7b04-4164-a607-16a0b6d45991 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:44.137753 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae3cd80-7b04-4164-a607-16a0b6d45991 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:44.139434 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae3cd80-7b04-4164-a607-16a0b6d45991 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:44.156086 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-8ae3cd80-7b04-4164-a607-16a0b6d45991 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 16:18:44.156086 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:18:44.156086 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:18:44.156086 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:18:44.156086 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:18:44.156086 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:18:44.156086 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:18:44.156086 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:18:44.156086 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:18:44.156086 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:18:44.156086 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:18:44.156086 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:18:44.156086 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 16:18:44.156086 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 16:18:44.156086 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 16:18:44.156086 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 16:18:44.157270 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:18:44.157270 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:18:44.157270 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:18:44.157270 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:18:44.157270 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:18:44.157270 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:18:44.157270 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:18:44.157270 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 16:18:44.157270 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:18:44.157270 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:18:44.157270 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:18:44.157270 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:18:44.157270 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:18:44.157270 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:18:44.157270 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:18:44.157270 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:18:44.157270 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 16:18:44.158394 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 16:18:44.158394 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 16:18:44.158394 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 16:18:44.159663 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 318/646] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 16:18:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:18:44.160373 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae3cd80-7b04-4164-a607-16a0b6d45991 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:44.185726 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf27b80-34ff-4ee6-b7e0-7bb986d49930 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:44.223190 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5db5a9f-d7f1-43cc-86aa-e6473ea8fac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:44.223902 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5db5a9f-d7f1-43cc-86aa-e6473ea8fac8 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:44.224249 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5db5a9f-d7f1-43cc-86aa-e6473ea8fac8 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:44.224636 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5db5a9f-d7f1-43cc-86aa-e6473ea8fac8 None admin] PATH_INFO: `/v3/domains` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:44.225347 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5db5a9f-d7f1-43cc-86aa-e6473ea8fac8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:18:44.225718 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5db5a9f-d7f1-43cc-86aa-e6473ea8fac8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:44.227203 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5db5a9f-d7f1-43cc-86aa-e6473ea8fac8 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:44.243687 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 329/647] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Sep 9 16:18:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:18:44.243687 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5db5a9f-d7f1-43cc-86aa-e6473ea8fac8 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:44.243930 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:44.266654 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae3cd80-7b04-4164-a607-16a0b6d45991 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:44.266841 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:44.303639 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b60d111-0e41-414d-833f-0d3b78f5367b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:44.304180 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b60d111-0e41-414d-833f-0d3b78f5367b None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:44.304456 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b60d111-0e41-414d-833f-0d3b78f5367b None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:44.304724 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b60d111-0e41-414d-833f-0d3b78f5367b None admin] PATH_INFO: `/v3/domains` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:44.305707 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b60d111-0e41-414d-833f-0d3b78f5367b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:18:44.306010 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b60d111-0e41-414d-833f-0d3b78f5367b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:44.307971 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b60d111-0e41-414d-833f-0d3b78f5367b None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:44.319800 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 319/648] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Sep 9 16:18:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:18:44.324195 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b60d111-0e41-414d-833f-0d3b78f5367b None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:44.368139 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5db5a9f-d7f1-43cc-86aa-e6473ea8fac8 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:44.404385 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f43f23a-779e-46f9-8cfb-d11ac8874b5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:44.405310 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f43f23a-779e-46f9-8cfb-d11ac8874b5e None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:44.405695 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f43f23a-779e-46f9-8cfb-d11ac8874b5e None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:44.406657 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f43f23a-779e-46f9-8cfb-d11ac8874b5e None admin] PATH_INFO: `/v3/users/glance` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:44.415370 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f43f23a-779e-46f9-8cfb-d11ac8874b5e None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:44.416803 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f43f23a-779e-46f9-8cfb-d11ac8874b5e None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:44.428997 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-6f43f23a-779e-46f9-8cfb-d11ac8874b5e None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 09 16:18:44.428997 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:18:44.428997 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:18:44.428997 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:18:44.428997 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:18:44.428997 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:18:44.428997 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:18:44.428997 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:18:44.428997 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:18:44.428997 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:18:44.428997 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:18:44.428997 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:18:44.428997 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 16:18:44.428997 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 16:18:44.428997 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 16:18:44.428997 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 16:18:44.429916 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:18:44.429916 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:18:44.429916 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 16:18:44.429916 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 16:18:44.429916 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 16:18:44.429916 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 16:18:44.429916 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:18:44.429916 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:18:44.429916 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:18:44.429916 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:18:44.429916 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:18:44.429916 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Sep 09 16:18:44.429916 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:18:44.429916 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:18:44.429916 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:18:44.429916 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:18:44.429916 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:18:44.429916 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:18:44.430911 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:18:44.430911 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:18:44.430911 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 16:18:44.430911 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 16:18:44.430911 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 16:18:44.430911 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 16:18:44.430911 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 16:18:44.430911 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 16:18:44.430911 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 09 16:18:44.430911 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:18:44.430911 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 330/649] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Sep 9 16:18:44 2022] GET /identity/v3/users/glance => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:18:44.430911 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f43f23a-779e-46f9-8cfb-d11ac8874b5e None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:44.441318 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b60d111-0e41-414d-833f-0d3b78f5367b None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:44.486014 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbf98d8-6484-4397-86cb-60e80b88b9ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:44.486649 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbf98d8-6484-4397-86cb-60e80b88b9ee None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:44.486926 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbf98d8-6484-4397-86cb-60e80b88b9ee None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:44.487197 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbf98d8-6484-4397-86cb-60e80b88b9ee None admin] PATH_INFO: `/v3/domains` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:44.487830 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbf98d8-6484-4397-86cb-60e80b88b9ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:18:44.488129 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbf98d8-6484-4397-86cb-60e80b88b9ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:44.489515 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbf98d8-6484-4397-86cb-60e80b88b9ee None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:44.492789 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:44.507880 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 320/650] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Sep 9 16:18:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:18:44.508732 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbf98d8-6484-4397-86cb-60e80b88b9ee None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:44.521900 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:44.545812 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f43f23a-779e-46f9-8cfb-d11ac8874b5e None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:44.581688 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91515875-037a-454f-9c68-a42b47554b76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:44.582357 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91515875-037a-454f-9c68-a42b47554b76 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:44.582705 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91515875-037a-454f-9c68-a42b47554b76 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:44.583040 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91515875-037a-454f-9c68-a42b47554b76 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:44.589842 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91515875-037a-454f-9c68-a42b47554b76 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:44.591399 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91515875-037a-454f-9c68-a42b47554b76 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:44.602832 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-91515875-037a-454f-9c68-a42b47554b76 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 16:18:44.602832 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:18:44.602832 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:18:44.602832 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:18:44.602832 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:18:44.602832 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:18:44.602832 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:18:44.602832 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:18:44.602832 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:18:44.602832 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:18:44.602832 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:18:44.602832 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:18:44.602832 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 16:18:44.602832 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 16:18:44.602832 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 16:18:44.603926 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 16:18:44.603926 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:18:44.603926 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:18:44.603926 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:18:44.603926 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:18:44.603926 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:18:44.603926 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:18:44.603926 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:18:44.603926 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Sep 09 16:18:44.603926 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:18:44.603926 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:18:44.603926 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:18:44.603926 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:18:44.603926 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:18:44.603926 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:18:44.603926 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:18:44.603926 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:18:44.604998 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 16:18:44.604998 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 16:18:44.604998 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 16:18:44.604998 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 16:18:44.604998 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 16:18:44.604998 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 16:18:44.604998 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 16:18:44.604998 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:18:44.605739 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 331/651] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Sep 9 16:18:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:18:44.606605 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91515875-037a-454f-9c68-a42b47554b76 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:44.616419 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbf98d8-6484-4397-86cb-60e80b88b9ee None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:44.651058 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67b5dd7-d522-45c1-9735-1773da1413c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:44.651772 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67b5dd7-d522-45c1-9735-1773da1413c7 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:44.652120 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67b5dd7-d522-45c1-9735-1773da1413c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:44.652453 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67b5dd7-d522-45c1-9735-1773da1413c7 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:44.660142 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67b5dd7-d522-45c1-9735-1773da1413c7 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:44.661672 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67b5dd7-d522-45c1-9735-1773da1413c7 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:44.672725 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-d67b5dd7-d522-45c1-9735-1773da1413c7 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 09 16:18:44.672725 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:18:44.672725 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:18:44.672725 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:18:44.672725 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:18:44.672725 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:18:44.672725 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:18:44.672725 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:18:44.672725 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:18:44.672725 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:18:44.672725 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:18:44.672725 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:18:44.672725 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 16:18:44.672725 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 16:18:44.672725 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 16:18:44.672725 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 16:18:44.673859 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:18:44.673859 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:18:44.673859 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 16:18:44.673859 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 16:18:44.673859 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 16:18:44.673859 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 16:18:44.673859 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:18:44.673859 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:18:44.673859 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:18:44.673859 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:18:44.673859 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:18:44.673859 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 16:18:44.673859 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:18:44.673859 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:18:44.673859 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:18:44.673859 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:18:44.673859 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:18:44.673859 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:18:44.675172 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:18:44.675172 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:18:44.675172 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 16:18:44.675172 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 16:18:44.675172 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 16:18:44.675172 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 16:18:44.675172 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 16:18:44.675172 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 16:18:44.675172 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 09 16:18:44.675172 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 16:18:44.676373 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 321/652] 10.222.0.27 () {56 vars in 1102 bytes} [Fri Sep 9 16:18:44 2022] GET /identity/v3/users/neutron => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:18:44.677136 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67b5dd7-d522-45c1-9735-1773da1413c7 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:44.724299 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91515875-037a-454f-9c68-a42b47554b76 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:44.734832 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:44.760349 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6d9a72-a706-4133-99fe-8616300622ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:44.761209 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6d9a72-a706-4133-99fe-8616300622ad None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:44.761436 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6d9a72-a706-4133-99fe-8616300622ad None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:44.761774 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6d9a72-a706-4133-99fe-8616300622ad None admin] PATH_INFO: `/v3/users` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:44.762584 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6d9a72-a706-4133-99fe-8616300622ad None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:18:44.762999 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6d9a72-a706-4133-99fe-8616300622ad None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:44.764315 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6d9a72-a706-4133-99fe-8616300622ad None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:44.767696 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:44.788311 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 332/653] 10.222.0.27 () {56 vars in 1137 bytes} [Fri Sep 9 16:18:44 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:18:44.788311 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6d9a72-a706-4133-99fe-8616300622ad None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:44.788609 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67b5dd7-d522-45c1-9735-1773da1413c7 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:44.825905 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37dd84e-30ef-4968-9d0f-250e138acb57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:44.826680 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37dd84e-30ef-4968-9d0f-250e138acb57 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:44.827046 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37dd84e-30ef-4968-9d0f-250e138acb57 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:44.827452 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37dd84e-30ef-4968-9d0f-250e138acb57 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:44.835544 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37dd84e-30ef-4968-9d0f-250e138acb57 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:44.837002 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37dd84e-30ef-4968-9d0f-250e138acb57 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:44.849047 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-b37dd84e-30ef-4968-9d0f-250e138acb57 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 09 16:18:44.849047 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:18:44.849047 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:18:44.849047 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:18:44.849047 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:18:44.849047 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:18:44.849047 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:18:44.849047 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:18:44.849047 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:18:44.849047 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:18:44.849047 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:18:44.849047 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:18:44.849047 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 16:18:44.849047 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 16:18:44.849047 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 16:18:44.849047 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 16:18:44.850204 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:18:44.850204 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:18:44.850204 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 16:18:44.850204 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 16:18:44.850204 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 16:18:44.850204 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 16:18:44.850204 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:18:44.850204 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:18:44.850204 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:18:44.850204 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:18:44.850204 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:18:44.850204 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 16:18:44.850204 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:18:44.850204 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:18:44.850204 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:18:44.850204 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:18:44.850204 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:18:44.850204 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:18:44.851414 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:18:44.851414 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:18:44.851414 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 16:18:44.851414 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 16:18:44.851414 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 16:18:44.851414 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 16:18:44.851414 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 16:18:44.851414 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 16:18:44.851414 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 09 16:18:44.851414 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 16:18:44.852067 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 322/654] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Sep 9 16:18:44 2022] GET /identity/v3/users/cinder => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:18:44.857049 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37dd84e-30ef-4968-9d0f-250e138acb57 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:44.917024 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6d9a72-a706-4133-99fe-8616300622ad None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:44.954685 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f48b53-5e44-4fc9-bd08-65999ea30f37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:44.955297 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f48b53-5e44-4fc9-bd08-65999ea30f37 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:44.955578 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f48b53-5e44-4fc9-bd08-65999ea30f37 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:44.955844 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f48b53-5e44-4fc9-bd08-65999ea30f37 None admin] PATH_INFO: `/v3/projects` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:44.956526 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f48b53-5e44-4fc9-bd08-65999ea30f37 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:18:44.956833 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f48b53-5e44-4fc9-bd08-65999ea30f37 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:44.958339 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f48b53-5e44-4fc9-bd08-65999ea30f37 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:44.963714 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37dd84e-30ef-4968-9d0f-250e138acb57 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:44.974838 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 333/655] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Sep 9 16:18:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:18:44.974838 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f48b53-5e44-4fc9-bd08-65999ea30f37 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:44.985933 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:45.007687 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11717854-4b65-4d12-92f6-69c57058e4dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:45.008368 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11717854-4b65-4d12-92f6-69c57058e4dd None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:45.008714 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11717854-4b65-4d12-92f6-69c57058e4dd None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:45.009085 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11717854-4b65-4d12-92f6-69c57058e4dd None admin] PATH_INFO: `/v3/users` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:45.009894 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11717854-4b65-4d12-92f6-69c57058e4dd None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:18:45.010270 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11717854-4b65-4d12-92f6-69c57058e4dd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:45.011815 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11717854-4b65-4d12-92f6-69c57058e4dd None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:45.029591 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 323/656] 10.222.0.27 () {56 vars in 1139 bytes} [Fri Sep 9 16:18:44 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:18:45.030425 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11717854-4b65-4d12-92f6-69c57058e4dd None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:45.034530 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:45.076300 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f48b53-5e44-4fc9-bd08-65999ea30f37 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:45.109593 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d6c31a-da13-4849-ab49-ad5aca4fd19c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:45.110130 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d6c31a-da13-4849-ab49-ad5aca4fd19c None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:45.110437 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d6c31a-da13-4849-ab49-ad5aca4fd19c None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:45.110710 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d6c31a-da13-4849-ab49-ad5aca4fd19c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:45.127036 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11717854-4b65-4d12-92f6-69c57058e4dd None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:45.160795 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0245043b-3713-4044-9971-0f76cac06ebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:45.161391 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0245043b-3713-4044-9971-0f76cac06ebc None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:45.161670 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0245043b-3713-4044-9971-0f76cac06ebc None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:45.161953 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0245043b-3713-4044-9971-0f76cac06ebc None admin] PATH_INFO: `/v3/users` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:45.162695 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0245043b-3713-4044-9971-0f76cac06ebc None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:18:45.163014 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0245043b-3713-4044-9971-0f76cac06ebc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:45.164425 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0245043b-3713-4044-9971-0f76cac06ebc None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:45.177414 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d6c31a-da13-4849-ab49-ad5aca4fd19c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:45.178902 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d6c31a-da13-4849-ab49-ad5aca4fd19c None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:45.181393 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 324/657] 10.222.0.27 () {56 vars in 1137 bytes} [Fri Sep 9 16:18:45 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:18:45.182105 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0245043b-3713-4044-9971-0f76cac06ebc None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:45.212273 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:45.233008 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:45.278732 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 334/658] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Sep 9 16:18:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 16:18:45.279994 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1607b85-4aaf-40fb-9de9-b41b39609e72 None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:45.280277 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1607b85-4aaf-40fb-9de9-b41b39609e72 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:45.280551 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1607b85-4aaf-40fb-9de9-b41b39609e72 None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:45.282067 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 335/659] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:18:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:18:45.282805 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1607b85-4aaf-40fb-9de9-b41b39609e72 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:45.290467 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0245043b-3713-4044-9971-0f76cac06ebc None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:45.324204 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76687c6-7616-4ca4-8d23-2f4539eebdbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:45.324796 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76687c6-7616-4ca4-8d23-2f4539eebdbe None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:45.325071 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76687c6-7616-4ca4-8d23-2f4539eebdbe None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:45.325341 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76687c6-7616-4ca4-8d23-2f4539eebdbe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:45.326043 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76687c6-7616-4ca4-8d23-2f4539eebdbe None admin] RBAC: Adding query filter params (role.id=1966594501e743aebf757851d9cd82a5, scope.project.id=68d6aaafab824657b08ca91f3d46d5f8, user.id=a332b9b4980646a3b14633293f77b505) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:18:45.326378 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76687c6-7616-4ca4-8d23-2f4539eebdbe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:45.327797 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76687c6-7616-4ca4-8d23-2f4539eebdbe None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:45.333627 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 325/660] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Sep 9 16:18:45 2022] GET /identity/v3/role_assignments?user.id=a332b9b4980646a3b14633293f77b505&scope.project.id=68d6aaafab824657b08ca91f3d46d5f8&role.id=1966594501e743aebf757851d9cd82a5 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:18:45.334231 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76687c6-7616-4ca4-8d23-2f4539eebdbe None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:45.399972 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1607b85-4aaf-40fb-9de9-b41b39609e72 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:45.439834 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeb19c3-1c8d-4c6e-a348-8493d98e8c85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:45.440449 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeb19c3-1c8d-4c6e-a348-8493d98e8c85 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:45.440724 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeb19c3-1c8d-4c6e-a348-8493d98e8c85 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:45.440996 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeb19c3-1c8d-4c6e-a348-8493d98e8c85 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:45.459727 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:45.468353 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76687c6-7616-4ca4-8d23-2f4539eebdbe None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:45.470956 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:45.509537 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a267377b-8aad-4837-8b98-b74f57f6e04c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:45.510289 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a267377b-8aad-4837-8b98-b74f57f6e04c None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:45.510692 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a267377b-8aad-4837-8b98-b74f57f6e04c None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:45.511023 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a267377b-8aad-4837-8b98-b74f57f6e04c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:45.525306 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaeb19c3-1c8d-4c6e-a348-8493d98e8c85 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:45.526834 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaeb19c3-1c8d-4c6e-a348-8493d98e8c85 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:45.593098 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a267377b-8aad-4837-8b98-b74f57f6e04c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:45.595488 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a267377b-8aad-4837-8b98-b74f57f6e04c None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:45.635066 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 336/661] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Sep 9 16:18:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 16:18:45.636142 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeb19c3-1c8d-4c6e-a348-8493d98e8c85 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:45.695095 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:45.698733 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:45.708828 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 326/662] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Sep 9 16:18:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 16:18:45.710971 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f19645f-ca8b-45aa-ba25-69dcc1203733 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:45.711469 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f19645f-ca8b-45aa-ba25-69dcc1203733 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:45.711924 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f19645f-ca8b-45aa-ba25-69dcc1203733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:45.734586 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-7f19645f-ca8b-45aa-ba25-69dcc1203733 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:18:45.735835 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-7f19645f-ca8b-45aa-ba25-69dcc1203733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:18:45.747068 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeb19c3-1c8d-4c6e-a348-8493d98e8c85 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:45.783062 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15af131e-cee1-4423-a97b-169a0f9a1d9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:45.784241 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15af131e-cee1-4423-a97b-169a0f9a1d9b None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:45.784527 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15af131e-cee1-4423-a97b-169a0f9a1d9b None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:45.784796 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15af131e-cee1-4423-a97b-169a0f9a1d9b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:45.795151 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15af131e-cee1-4423-a97b-169a0f9a1d9b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:45.797135 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15af131e-cee1-4423-a97b-169a0f9a1d9b None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:45.803819 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 327/663] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:18:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 16:18:45.804938 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f19645f-ca8b-45aa-ba25-69dcc1203733 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:45.820416 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-15af131e-cee1-4423-a97b-169a0f9a1d9b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 16:18:45.820416 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:18:45.820416 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:18:45.820416 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:18:45.820416 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:18:45.820416 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:18:45.820416 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:18:45.820416 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:18:45.820416 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:18:45.820416 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:18:45.820416 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:18:45.820416 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:18:45.820416 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 16:18:45.820416 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 16:18:45.820416 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 16:18:45.820416 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 16:18:45.821570 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:18:45.821570 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:18:45.821570 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:18:45.821570 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:18:45.821570 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:18:45.821570 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:18:45.821570 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:18:45.821570 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Sep 09 16:18:45.821570 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:18:45.821570 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:18:45.821570 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:18:45.821570 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:18:45.821570 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:18:45.821570 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:18:45.821570 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:18:45.821570 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:18:45.821570 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 16:18:45.822777 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 16:18:45.822777 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 16:18:45.822777 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:18:45.824326 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 337/664] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 16:18:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:18:45.825536 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15af131e-cee1-4423-a97b-169a0f9a1d9b None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:45.914735 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f19645f-ca8b-45aa-ba25-69dcc1203733 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:45.937754 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15af131e-cee1-4423-a97b-169a0f9a1d9b None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:45.942669 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:45.945595 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:45.953471 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0755815-e629-4185-8739-eb474c9b4954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:45.954133 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0755815-e629-4185-8739-eb474c9b4954 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:45.954435 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0755815-e629-4185-8739-eb474c9b4954 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:45.954747 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0755815-e629-4185-8739-eb474c9b4954 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:45.967404 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0755815-e629-4185-8739-eb474c9b4954 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:45.969039 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0755815-e629-4185-8739-eb474c9b4954 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:45.975580 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfdb86a-6ac4-4c2c-8bf7-22417645bc8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:45.976203 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfdb86a-6ac4-4c2c-8bf7-22417645bc8a None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:45.976475 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfdb86a-6ac4-4c2c-8bf7-22417645bc8a None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:45.976743 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfdb86a-6ac4-4c2c-8bf7-22417645bc8a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:45.985502 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-b0755815-e629-4185-8739-eb474c9b4954 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 16:18:45.985502 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:18:45.985502 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:18:45.985502 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:18:45.985502 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:18:45.985502 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:18:45.985502 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:18:45.985502 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:18:45.985502 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:18:45.985502 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:18:45.985502 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:18:45.985502 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:18:45.985502 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 16:18:45.985502 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 16:18:45.985502 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 16:18:45.985502 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 16:18:45.986445 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:18:45.986445 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:18:45.986445 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:18:45.986445 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:18:45.986445 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:18:45.986445 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:18:45.986445 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:18:45.986445 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 16:18:45.986445 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:18:45.986445 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:18:45.986445 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:18:45.986445 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:18:45.986445 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:18:45.986445 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:18:45.986445 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:18:45.986445 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:18:45.986445 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 16:18:45.987387 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 16:18:45.987387 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 16:18:45.987387 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 16:18:45.988433 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfdb86a-6ac4-4c2c-8bf7-22417645bc8a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:45.989879 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfdb86a-6ac4-4c2c-8bf7-22417645bc8a None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:45.990448 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 328/665] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 16:18:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:18:45.991589 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0755815-e629-4185-8739-eb474c9b4954 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:46.006592 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-5cfdb86a-6ac4-4c2c-8bf7-22417645bc8a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 16:18:46.006592 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:18:46.006592 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:18:46.006592 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:18:46.006592 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:18:46.006592 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:18:46.006592 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:18:46.006592 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:18:46.006592 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:18:46.006592 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:18:46.006592 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:18:46.006592 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:18:46.006592 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 16:18:46.006592 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 16:18:46.006592 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 16:18:46.006592 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 16:18:46.007533 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:18:46.007533 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:18:46.007533 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:18:46.007533 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:18:46.007533 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:18:46.007533 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:18:46.007533 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:18:46.007533 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Sep 09 16:18:46.007533 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:18:46.007533 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:18:46.007533 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:18:46.007533 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:18:46.007533 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:18:46.007533 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:18:46.007533 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:18:46.007533 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:18:46.007533 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 16:18:46.008413 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 16:18:46.008413 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 16:18:46.008413 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:18:46.008413 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 338/666] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 16:18:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:18:46.009087 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfdb86a-6ac4-4c2c-8bf7-22417645bc8a None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:46.104528 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0755815-e629-4185-8739-eb474c9b4954 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:46.124434 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfdb86a-6ac4-4c2c-8bf7-22417645bc8a None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:46.142999 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f5a104-3c5f-4a82-9583-a43c8f2f41c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:46.143604 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f5a104-3c5f-4a82-9583-a43c8f2f41c4 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:46.143880 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f5a104-3c5f-4a82-9583-a43c8f2f41c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:46.144150 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f5a104-3c5f-4a82-9583-a43c8f2f41c4 None admin] PATH_INFO: `/v3/domains` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:46.144786 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f5a104-3c5f-4a82-9583-a43c8f2f41c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:18:46.145084 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f5a104-3c5f-4a82-9583-a43c8f2f41c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:46.146921 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f5a104-3c5f-4a82-9583-a43c8f2f41c4 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:46.158480 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 329/667] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Sep 9 16:18:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:18:46.159805 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f5a104-3c5f-4a82-9583-a43c8f2f41c4 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:46.166531 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6ee1a1-ddb5-42b0-ae27-a6aa2f89d874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:46.167145 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6ee1a1-ddb5-42b0-ae27-a6aa2f89d874 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:46.167422 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6ee1a1-ddb5-42b0-ae27-a6aa2f89d874 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:46.167691 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6ee1a1-ddb5-42b0-ae27-a6aa2f89d874 None admin] PATH_INFO: `/v3/domains` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:46.168336 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6ee1a1-ddb5-42b0-ae27-a6aa2f89d874 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:18:46.168616 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6ee1a1-ddb5-42b0-ae27-a6aa2f89d874 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:46.169974 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6ee1a1-ddb5-42b0-ae27-a6aa2f89d874 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:46.187127 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 339/668] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Sep 9 16:18:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:18:46.187127 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6ee1a1-ddb5-42b0-ae27-a6aa2f89d874 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:46.201558 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:46.208452 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:46.263483 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f5a104-3c5f-4a82-9583-a43c8f2f41c4 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:46.303667 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb320c0-45e7-4609-b5ca-18bf1190e149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:46.304281 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb320c0-45e7-4609-b5ca-18bf1190e149 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:46.304593 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb320c0-45e7-4609-b5ca-18bf1190e149 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:46.304897 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb320c0-45e7-4609-b5ca-18bf1190e149 None admin] PATH_INFO: `/v3/domains` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:46.305566 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb320c0-45e7-4609-b5ca-18bf1190e149 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:18:46.305889 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb320c0-45e7-4609-b5ca-18bf1190e149 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:46.307316 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb320c0-45e7-4609-b5ca-18bf1190e149 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:46.308000 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6ee1a1-ddb5-42b0-ae27-a6aa2f89d874 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:46.318824 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 330/669] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Sep 9 16:18:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:18:46.319622 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb320c0-45e7-4609-b5ca-18bf1190e149 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:46.348440 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6f0a9f-9ab3-4375-81eb-f6376950eef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:46.349317 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6f0a9f-9ab3-4375-81eb-f6376950eef5 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:46.349760 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6f0a9f-9ab3-4375-81eb-f6376950eef5 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:46.350290 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6f0a9f-9ab3-4375-81eb-f6376950eef5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:46.361018 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6f0a9f-9ab3-4375-81eb-f6376950eef5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 16:18:46.366909 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-9f6f0a9f-9ab3-4375-81eb-f6376950eef5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 16:18:46.366909 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:18:46.366909 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:18:46.366909 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:18:46.366909 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:18:46.366909 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:18:46.366909 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:18:46.366909 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:18:46.366909 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:18:46.366909 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:18:46.366909 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:18:46.366909 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:18:46.366909 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 16:18:46.366909 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 16:18:46.366909 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 16:18:46.366909 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 16:18:46.368019 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 16:18:46.368019 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 16:18:46.368019 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 16:18:46.368019 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 16:18:46.368019 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:18:46.368019 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:18:46.368019 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:18:46.368019 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:18:46.368019 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:18:46.368019 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:18:46.368019 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:18:46.368019 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Sep 09 16:18:46.368019 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:18:46.368019 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:18:46.368019 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:18:46.368019 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:18:46.369084 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:18:46.369084 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:18:46.369084 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:18:46.369084 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:18:46.369084 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 16:18:46.369084 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 16:18:46.369084 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 16:18:46.369084 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 16:18:46.369084 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 16:18:46.369084 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 16:18:46.369084 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 16:18:46.369084 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:18:46.372842 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 340/670] 10.222.0.27 () {56 vars in 1102 bytes} [Fri Sep 9 16:18:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:18:46.373705 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6f0a9f-9ab3-4375-81eb-f6376950eef5 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:46.422926 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:46.427494 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb320c0-45e7-4609-b5ca-18bf1190e149 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:46.458199 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:46.462922 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9da2475-c3fa-4820-96cb-03a82e720d86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:46.463746 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9da2475-c3fa-4820-96cb-03a82e720d86 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:46.464020 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9da2475-c3fa-4820-96cb-03a82e720d86 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:46.464293 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9da2475-c3fa-4820-96cb-03a82e720d86 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:46.472302 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9da2475-c3fa-4820-96cb-03a82e720d86 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:46.473755 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9da2475-c3fa-4820-96cb-03a82e720d86 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:46.480601 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6f0a9f-9ab3-4375-81eb-f6376950eef5 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:46.487664 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-d9da2475-c3fa-4820-96cb-03a82e720d86 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 16:18:46.487664 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:18:46.487664 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:18:46.487664 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:18:46.487664 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:18:46.487664 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:18:46.487664 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:18:46.487664 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:18:46.487664 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:18:46.487664 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:18:46.487664 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:18:46.487664 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:18:46.487664 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 16:18:46.487664 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 16:18:46.487664 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 16:18:46.488523 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 16:18:46.488523 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:18:46.488523 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:18:46.488523 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:18:46.488523 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:18:46.488523 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:18:46.488523 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:18:46.488523 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:18:46.488523 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 16:18:46.488523 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:18:46.488523 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:18:46.488523 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:18:46.488523 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:18:46.488523 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:18:46.488523 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:18:46.488523 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:18:46.488523 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:18:46.489395 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 16:18:46.489395 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 16:18:46.489395 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 16:18:46.489395 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 16:18:46.489395 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 16:18:46.489395 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 16:18:46.489395 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 16:18:46.489395 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 16:18:46.489395 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 331/671] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Sep 9 16:18:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:18:46.490071 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9da2475-c3fa-4820-96cb-03a82e720d86 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:46.518501 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7af4c63-4b98-4495-ac53-a8fcd4012c66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:46.519126 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7af4c63-4b98-4495-ac53-a8fcd4012c66 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:46.519406 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7af4c63-4b98-4495-ac53-a8fcd4012c66 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:46.519696 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7af4c63-4b98-4495-ac53-a8fcd4012c66 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:46.526618 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7af4c63-4b98-4495-ac53-a8fcd4012c66 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:46.528058 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7af4c63-4b98-4495-ac53-a8fcd4012c66 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:46.540501 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-c7af4c63-4b98-4495-ac53-a8fcd4012c66 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 16:18:46.540501 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:18:46.540501 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:18:46.540501 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:18:46.540501 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:18:46.540501 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:18:46.540501 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:18:46.540501 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:18:46.540501 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:18:46.540501 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:18:46.540501 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:18:46.540501 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:18:46.540501 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 16:18:46.540501 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 16:18:46.540501 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 16:18:46.541474 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 16:18:46.541474 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:18:46.541474 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:18:46.541474 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:18:46.541474 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:18:46.541474 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:18:46.541474 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:18:46.541474 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:18:46.541474 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Sep 09 16:18:46.541474 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:18:46.541474 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:18:46.541474 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:18:46.541474 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:18:46.541474 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:18:46.541474 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:18:46.541474 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:18:46.541474 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:18:46.542445 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 16:18:46.542445 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 16:18:46.542445 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 16:18:46.542445 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 16:18:46.542445 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 16:18:46.542445 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 16:18:46.542445 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 16:18:46.542445 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:18:46.542445 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 341/672] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Sep 9 16:18:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:18:46.542445 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7af4c63-4b98-4495-ac53-a8fcd4012c66 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:46.605724 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9da2475-c3fa-4820-96cb-03a82e720d86 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:46.640075 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8847a487-5a88-4124-b87f-ef7f40ae5175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:46.640706 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8847a487-5a88-4124-b87f-ef7f40ae5175 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:46.640983 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8847a487-5a88-4124-b87f-ef7f40ae5175 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:46.641254 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8847a487-5a88-4124-b87f-ef7f40ae5175 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:46.649286 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8847a487-5a88-4124-b87f-ef7f40ae5175 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:46.650774 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8847a487-5a88-4124-b87f-ef7f40ae5175 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:46.651338 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7af4c63-4b98-4495-ac53-a8fcd4012c66 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:46.662448 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-8847a487-5a88-4124-b87f-ef7f40ae5175 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 16:18:46.662448 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:18:46.662448 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:18:46.662448 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:18:46.662448 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:18:46.662448 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:18:46.662448 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:18:46.662448 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:18:46.662448 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:18:46.662448 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:18:46.662448 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:18:46.662448 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:18:46.662448 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 16:18:46.662448 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 16:18:46.662448 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 16:18:46.663353 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 16:18:46.663353 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:18:46.663353 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:18:46.663353 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:18:46.663353 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:18:46.663353 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:18:46.663353 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:18:46.663353 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:18:46.663353 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 16:18:46.663353 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:18:46.663353 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:18:46.663353 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:18:46.663353 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:18:46.663353 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:18:46.663353 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:18:46.663353 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:18:46.663353 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:18:46.664238 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 16:18:46.664238 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 16:18:46.664238 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 16:18:46.664238 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 16:18:46.664238 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 16:18:46.664238 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 16:18:46.664238 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 16:18:46.664238 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 16:18:46.664238 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 332/673] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Sep 9 16:18:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:18:46.664871 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8847a487-5a88-4124-b87f-ef7f40ae5175 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:46.686485 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:46.695138 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b0c88c-3a78-4e8a-96ff-70040e944610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:46.695929 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b0c88c-3a78-4e8a-96ff-70040e944610 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:46.696347 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b0c88c-3a78-4e8a-96ff-70040e944610 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:46.696784 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b0c88c-3a78-4e8a-96ff-70040e944610 None admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:46.697597 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b0c88c-3a78-4e8a-96ff-70040e944610 None admin] RBAC: Adding query filter params (name=service) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:18:46.697898 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b0c88c-3a78-4e8a-96ff-70040e944610 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:46.699285 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b0c88c-3a78-4e8a-96ff-70040e944610 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:46.704891 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:46.714587 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 342/674] 10.222.0.27 () {56 vars in 1103 bytes} [Fri Sep 9 16:18:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:18:46.715329 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b0c88c-3a78-4e8a-96ff-70040e944610 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:46.775498 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8847a487-5a88-4124-b87f-ef7f40ae5175 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:46.810279 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5af24f-d9af-4ea3-9c69-249fe88f1b32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:46.810888 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5af24f-d9af-4ea3-9c69-249fe88f1b32 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:46.811162 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5af24f-d9af-4ea3-9c69-249fe88f1b32 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:46.811429 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5af24f-d9af-4ea3-9c69-249fe88f1b32 None admin] PATH_INFO: `/v3/projects` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:46.812202 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5af24f-d9af-4ea3-9c69-249fe88f1b32 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:18:46.812400 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5af24f-d9af-4ea3-9c69-249fe88f1b32 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:46.813815 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5af24f-d9af-4ea3-9c69-249fe88f1b32 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:46.819472 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b0c88c-3a78-4e8a-96ff-70040e944610 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:46.832300 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 333/675] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Sep 9 16:18:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:18:46.832300 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5af24f-d9af-4ea3-9c69-249fe88f1b32 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:46.859434 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916006c5-e7b5-4026-a53b-94b59361bdd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:46.860083 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916006c5-e7b5-4026-a53b-94b59361bdd9 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:46.860424 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916006c5-e7b5-4026-a53b-94b59361bdd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:46.860795 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916006c5-e7b5-4026-a53b-94b59361bdd9 None admin] PATH_INFO: `/v3/projects` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:46.861465 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916006c5-e7b5-4026-a53b-94b59361bdd9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:18:46.861902 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916006c5-e7b5-4026-a53b-94b59361bdd9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:46.863507 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916006c5-e7b5-4026-a53b-94b59361bdd9 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:46.876341 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 343/676] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Sep 9 16:18:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:18:46.877185 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916006c5-e7b5-4026-a53b-94b59361bdd9 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:46.910836 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:46.938862 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5af24f-d9af-4ea3-9c69-249fe88f1b32 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:46.939697 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:46.974413 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21099e13-95fb-489d-8424-028b7b9f9c57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:46.975108 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21099e13-95fb-489d-8424-028b7b9f9c57 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:46.975384 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21099e13-95fb-489d-8424-028b7b9f9c57 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:46.975986 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21099e13-95fb-489d-8424-028b7b9f9c57 None admin] PATH_INFO: `/v3/projects` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:46.976713 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21099e13-95fb-489d-8424-028b7b9f9c57 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:18:46.976972 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21099e13-95fb-489d-8424-028b7b9f9c57 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:46.978420 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21099e13-95fb-489d-8424-028b7b9f9c57 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:46.984564 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916006c5-e7b5-4026-a53b-94b59361bdd9 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:46.994448 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 334/677] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Sep 9 16:18:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:18:46.994448 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21099e13-95fb-489d-8424-028b7b9f9c57 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:47.024091 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe55b8df-a552-4be8-9434-ecd77904d9de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:47.024718 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe55b8df-a552-4be8-9434-ecd77904d9de None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:47.024992 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe55b8df-a552-4be8-9434-ecd77904d9de None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:47.025263 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe55b8df-a552-4be8-9434-ecd77904d9de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:47.035644 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe55b8df-a552-4be8-9434-ecd77904d9de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:47.037179 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe55b8df-a552-4be8-9434-ecd77904d9de None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:47.052873 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-fe55b8df-a552-4be8-9434-ecd77904d9de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 16:18:47.052873 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:18:47.052873 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:18:47.052873 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:18:47.052873 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:18:47.052873 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:18:47.052873 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:18:47.052873 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:18:47.052873 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:18:47.052873 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:18:47.052873 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:18:47.052873 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:18:47.052873 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 16:18:47.052873 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 16:18:47.052873 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 16:18:47.052873 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 16:18:47.053831 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:18:47.053831 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:18:47.053831 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:18:47.053831 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:18:47.053831 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:18:47.053831 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:18:47.053831 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:18:47.053831 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Sep 09 16:18:47.053831 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:18:47.053831 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:18:47.053831 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:18:47.053831 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:18:47.053831 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:18:47.053831 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:18:47.053831 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:18:47.053831 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:18:47.053831 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 16:18:47.054763 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 16:18:47.054763 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 16:18:47.054763 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:18:47.054763 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 344/678] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 16:18:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:18:47.054763 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe55b8df-a552-4be8-9434-ecd77904d9de None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:47.104597 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21099e13-95fb-489d-8424-028b7b9f9c57 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:47.138854 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc7cbc1-e5b2-4eb6-b5f7-b0ef071398ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:47.139548 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc7cbc1-e5b2-4eb6-b5f7-b0ef071398ed None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:47.139822 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc7cbc1-e5b2-4eb6-b5f7-b0ef071398ed None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:47.140089 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc7cbc1-e5b2-4eb6-b5f7-b0ef071398ed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:47.140796 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc7cbc1-e5b2-4eb6-b5f7-b0ef071398ed None admin] RBAC: Adding query filter params (role.id=1966594501e743aebf757851d9cd82a5, scope.project.id=68d6aaafab824657b08ca91f3d46d5f8, user.id=3ddd42508eee4412ae139cb8526090d6) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:18:47.141096 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc7cbc1-e5b2-4eb6-b5f7-b0ef071398ed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:47.142553 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc7cbc1-e5b2-4eb6-b5f7-b0ef071398ed None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:47.158343 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 335/679] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Sep 9 16:18:46 2022] GET /identity/v3/role_assignments?user.id=3ddd42508eee4412ae139cb8526090d6&scope.project.id=68d6aaafab824657b08ca91f3d46d5f8&role.id=1966594501e743aebf757851d9cd82a5 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:18:47.158343 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc7cbc1-e5b2-4eb6-b5f7-b0ef071398ed None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:47.161961 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:47.177150 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe55b8df-a552-4be8-9434-ecd77904d9de None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:47.193631 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:47.217681 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2542fb2-a021-4f7f-a099-e7393843a9dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:47.218442 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2542fb2-a021-4f7f-a099-e7393843a9dc None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:47.218793 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2542fb2-a021-4f7f-a099-e7393843a9dc None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:47.219071 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2542fb2-a021-4f7f-a099-e7393843a9dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:47.219802 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2542fb2-a021-4f7f-a099-e7393843a9dc None admin] RBAC: Adding query filter params (role.id=1966594501e743aebf757851d9cd82a5, scope.project.id=68d6aaafab824657b08ca91f3d46d5f8, user.id=d5f44bfdd5214e8d84a2c0a5b1fd9b84) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:18:47.220106 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2542fb2-a021-4f7f-a099-e7393843a9dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:47.221597 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2542fb2-a021-4f7f-a099-e7393843a9dc None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:47.234415 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 345/680] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Sep 9 16:18:47 2022] GET /identity/v3/role_assignments?user.id=d5f44bfdd5214e8d84a2c0a5b1fd9b84&scope.project.id=68d6aaafab824657b08ca91f3d46d5f8&role.id=1966594501e743aebf757851d9cd82a5 => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:18:47.234415 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2542fb2-a021-4f7f-a099-e7393843a9dc None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:47.346113 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc7cbc1-e5b2-4eb6-b5f7-b0ef071398ed None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:47.412517 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a4ad9f-5b08-4b47-8e16-178a612a5a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:47.413139 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a4ad9f-5b08-4b47-8e16-178a612a5a1e None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:47.413424 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a4ad9f-5b08-4b47-8e16-178a612a5a1e None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:47.413693 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a4ad9f-5b08-4b47-8e16-178a612a5a1e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:47.414444 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a4ad9f-5b08-4b47-8e16-178a612a5a1e None admin] RBAC: Adding query filter params (role.id=1966594501e743aebf757851d9cd82a5, scope.project.id=68d6aaafab824657b08ca91f3d46d5f8, user.id=8078e791ba68460f8b3aeafb4b79b73a) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:18:47.414813 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a4ad9f-5b08-4b47-8e16-178a612a5a1e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:47.416305 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a4ad9f-5b08-4b47-8e16-178a612a5a1e None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:47.427442 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 336/681] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Sep 9 16:18:47 2022] GET /identity/v3/role_assignments?user.id=8078e791ba68460f8b3aeafb4b79b73a&scope.project.id=68d6aaafab824657b08ca91f3d46d5f8&role.id=1966594501e743aebf757851d9cd82a5 => generated 608 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:18:47.429170 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2542fb2-a021-4f7f-a099-e7393843a9dc None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:47.476819 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b6e223-6359-4a06-bf96-8671b2d482a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:47.477902 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b6e223-6359-4a06-bf96-8671b2d482a8 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:47.478511 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b6e223-6359-4a06-bf96-8671b2d482a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:47.478999 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b6e223-6359-4a06-bf96-8671b2d482a8 None admin] PATH_INFO: `/v3/domains` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:47.480009 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b6e223-6359-4a06-bf96-8671b2d482a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:18:47.480546 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b6e223-6359-4a06-bf96-8671b2d482a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:47.482269 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b6e223-6359-4a06-bf96-8671b2d482a8 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:47.497974 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 346/682] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Sep 9 16:18:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:18:47.503963 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a4ad9f-5b08-4b47-8e16-178a612a5a1e None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:47.595722 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:47.596563 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8723c29d-8ba8-4585-b109-a42632197bbe None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:47.596819 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8723c29d-8ba8-4585-b109-a42632197bbe None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:47.597873 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8723c29d-8ba8-4585-b109-a42632197bbe None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:47.598633 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 347/683] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:18:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 16:18:47.604199 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c4ed97-60d1-46ef-8b33-3d7b50dea0ad None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:47.604442 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c4ed97-60d1-46ef-8b33-3d7b50dea0ad None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:47.604715 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c4ed97-60d1-46ef-8b33-3d7b50dea0ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:47.635113 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-38c4ed97-60d1-46ef-8b33-3d7b50dea0ad None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:18:47.636303 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-38c4ed97-60d1-46ef-8b33-3d7b50dea0ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:18:47.641439 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a4ad9f-5b08-4b47-8e16-178a612a5a1e None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:47.676777 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:47.692409 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c4dc6d-4170-4c5f-b66a-9620005252c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:47.693394 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c4dc6d-4170-4c5f-b66a-9620005252c2 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:47.694361 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c4dc6d-4170-4c5f-b66a-9620005252c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:47.694865 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c4dc6d-4170-4c5f-b66a-9620005252c2 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:47.709593 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c4dc6d-4170-4c5f-b66a-9620005252c2 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:47.711141 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c4dc6d-4170-4c5f-b66a-9620005252c2 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:47.723656 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-e3c4dc6d-4170-4c5f-b66a-9620005252c2 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 09 16:18:47.723656 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:18:47.723656 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:18:47.723656 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:18:47.723656 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:18:47.723656 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:18:47.723656 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:18:47.723656 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:18:47.723656 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:18:47.723656 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:18:47.723656 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:18:47.723656 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:18:47.723656 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 16:18:47.723656 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 16:18:47.723656 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 16:18:47.723656 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 16:18:47.724666 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:18:47.724666 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:18:47.724666 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 16:18:47.724666 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 16:18:47.724666 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 16:18:47.724666 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 16:18:47.724666 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:18:47.724666 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:18:47.724666 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:18:47.724666 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:18:47.724666 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:18:47.724666 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 16:18:47.724666 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:18:47.724666 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:18:47.724666 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:18:47.724666 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:18:47.724666 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:18:47.724666 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:18:47.726038 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:18:47.726038 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:18:47.726038 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 16:18:47.726038 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 16:18:47.726038 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 16:18:47.726038 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 16:18:47.726038 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 16:18:47.726038 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 16:18:47.726038 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 09 16:18:47.726038 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 16:18:47.726038 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 337/684] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Sep 9 16:18:47 2022] GET /identity/v3/users/swift => generated 83 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:18:47.731053 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c4dc6d-4170-4c5f-b66a-9620005252c2 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:47.736542 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 348/685] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:18:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 16:18:47.858657 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c4dc6d-4170-4c5f-b66a-9620005252c2 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:47.888087 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:47.901724 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29c5f64-2034-4d64-b2ca-5cd554b140fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:47.902386 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29c5f64-2034-4d64-b2ca-5cd554b140fb None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:47.902834 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29c5f64-2034-4d64-b2ca-5cd554b140fb None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:47.903352 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29c5f64-2034-4d64-b2ca-5cd554b140fb None admin] PATH_INFO: `/v3/users` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:47.904092 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29c5f64-2034-4d64-b2ca-5cd554b140fb None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:18:47.904406 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29c5f64-2034-4d64-b2ca-5cd554b140fb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:47.905854 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29c5f64-2034-4d64-b2ca-5cd554b140fb None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:47.925265 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 338/686] 10.222.0.27 () {56 vars in 1135 bytes} [Fri Sep 9 16:18:47 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:18:47.936057 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c4ed97-60d1-46ef-8b33-3d7b50dea0ad None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:48.077171 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c4ed97-60d1-46ef-8b33-3d7b50dea0ad None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:48.128403 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c36332-554a-45ae-b1d3-f6c781190bc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:48.129240 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c36332-554a-45ae-b1d3-f6c781190bc3 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:48.129676 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c36332-554a-45ae-b1d3-f6c781190bc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:48.130085 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c36332-554a-45ae-b1d3-f6c781190bc3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:48.176148 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29c5f64-2034-4d64-b2ca-5cd554b140fb None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:48.182827 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:48.291149 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c36332-554a-45ae-b1d3-f6c781190bc3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:48.293001 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c36332-554a-45ae-b1d3-f6c781190bc3 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:48.298101 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29c5f64-2034-4d64-b2ca-5cd554b140fb None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:48.349152 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c8eb77-3a7d-4d3a-9c86-8a1241c1d3d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:48.349915 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c8eb77-3a7d-4d3a-9c86-8a1241c1d3d0 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:48.350196 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c8eb77-3a7d-4d3a-9c86-8a1241c1d3d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:48.350522 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c8eb77-3a7d-4d3a-9c86-8a1241c1d3d0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:48.371783 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c8eb77-3a7d-4d3a-9c86-8a1241c1d3d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 16:18:48.376637 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-97c8eb77-3a7d-4d3a-9c86-8a1241c1d3d0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 16:18:48.376637 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:18:48.376637 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:18:48.376637 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:18:48.376637 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:18:48.376637 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:18:48.376637 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:18:48.376637 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:18:48.376637 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:18:48.376637 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:18:48.376637 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:18:48.376637 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:18:48.376637 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 16:18:48.376637 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 16:18:48.376637 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 16:18:48.376637 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 16:18:48.378497 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 16:18:48.378497 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 16:18:48.378497 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 16:18:48.378497 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 16:18:48.378497 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:18:48.378497 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:18:48.378497 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:18:48.378497 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:18:48.378497 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:18:48.378497 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:18:48.378497 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:18:48.378497 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 16:18:48.378497 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:18:48.378497 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:18:48.378497 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:18:48.378497 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:18:48.379332 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:18:48.379332 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:18:48.379332 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:18:48.379332 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:18:48.379332 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 16:18:48.379332 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 16:18:48.379332 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 16:18:48.379332 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 16:18:48.379332 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 16:18:48.379332 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 16:18:48.379332 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 16:18:48.379332 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 16:18:48.386764 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 339/687] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Sep 9 16:18:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 16:18:48.387901 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c8eb77-3a7d-4d3a-9c86-8a1241c1d3d0 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:48.446660 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:48.509742 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c8eb77-3a7d-4d3a-9c86-8a1241c1d3d0 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:48.526110 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 349/688] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Sep 9 16:18:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 590 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 16:18:48.531481 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c36332-554a-45ae-b1d3-f6c781190bc3 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:48.591004 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f21ed08-0b23-4132-b785-4300e4ea806b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:48.591625 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f21ed08-0b23-4132-b785-4300e4ea806b None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:48.591905 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f21ed08-0b23-4132-b785-4300e4ea806b None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:48.592182 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f21ed08-0b23-4132-b785-4300e4ea806b None admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:48.592841 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f21ed08-0b23-4132-b785-4300e4ea806b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:18:48.593142 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f21ed08-0b23-4132-b785-4300e4ea806b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:48.594552 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f21ed08-0b23-4132-b785-4300e4ea806b None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:48.611272 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 340/689] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Sep 9 16:18:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:18:48.615336 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:48.617230 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f21ed08-0b23-4132-b785-4300e4ea806b None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:48.678183 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c36332-554a-45ae-b1d3-f6c781190bc3 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:48.746579 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b493b11-4d2a-450b-809e-63473f8a7035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:48.747214 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b493b11-4d2a-450b-809e-63473f8a7035 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:48.747494 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b493b11-4d2a-450b-809e-63473f8a7035 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:48.747765 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b493b11-4d2a-450b-809e-63473f8a7035 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:48.775009 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b493b11-4d2a-450b-809e-63473f8a7035 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:48.776798 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b493b11-4d2a-450b-809e-63473f8a7035 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:48.803467 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f21ed08-0b23-4132-b785-4300e4ea806b None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:48.806682 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-2b493b11-4d2a-450b-809e-63473f8a7035 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 16:18:48.806682 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:18:48.806682 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:18:48.806682 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:18:48.806682 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:18:48.806682 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:18:48.806682 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:18:48.806682 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:18:48.806682 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:18:48.806682 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:18:48.806682 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:18:48.806682 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:18:48.806682 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 16:18:48.806682 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 16:18:48.806682 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 16:18:48.806682 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 16:18:48.807591 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:18:48.807591 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:18:48.807591 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:18:48.807591 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:18:48.807591 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:18:48.807591 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:18:48.807591 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:18:48.807591 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Sep 09 16:18:48.807591 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:18:48.807591 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:18:48.807591 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:18:48.807591 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:18:48.807591 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:18:48.807591 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:18:48.807591 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:18:48.807591 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:18:48.807591 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 16:18:48.808497 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 16:18:48.808497 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 16:18:48.808497 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:18:48.812381 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 350/690] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 16:18:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:18:48.816210 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:48.817012 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b493b11-4d2a-450b-809e-63473f8a7035 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:48.872433 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c87cab-f87e-4d24-83b6-77ad50b13b10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:48.873061 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c87cab-f87e-4d24-83b6-77ad50b13b10 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:48.873332 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c87cab-f87e-4d24-83b6-77ad50b13b10 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:48.873595 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c87cab-f87e-4d24-83b6-77ad50b13b10 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:48.895667 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c87cab-f87e-4d24-83b6-77ad50b13b10 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:48.897110 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c87cab-f87e-4d24-83b6-77ad50b13b10 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:48.926651 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-95c87cab-f87e-4d24-83b6-77ad50b13b10 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 16:18:48.926651 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:18:48.926651 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:18:48.926651 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:18:48.926651 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:18:48.926651 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:18:48.926651 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:18:48.926651 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:18:48.926651 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:18:48.926651 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:18:48.926651 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:18:48.926651 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:18:48.926651 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 16:18:48.926651 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 16:18:48.926651 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 16:18:48.926651 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 16:18:48.927643 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:18:48.927643 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:18:48.927643 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:18:48.927643 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:18:48.927643 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:18:48.927643 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:18:48.927643 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:18:48.927643 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 16:18:48.927643 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:18:48.927643 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:18:48.927643 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:18:48.927643 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:18:48.927643 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:18:48.927643 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:18:48.927643 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:18:48.927643 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:18:48.927643 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 16:18:48.928662 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 16:18:48.928662 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 16:18:48.928662 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 16:18:48.934853 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 341/691] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 16:18:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:18:48.936755 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c87cab-f87e-4d24-83b6-77ad50b13b10 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:49.007558 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b493b11-4d2a-450b-809e-63473f8a7035 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:49.046133 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:49.083188 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a94b53a-df66-4b09-a637-ad9348dec12a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:49.083810 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a94b53a-df66-4b09-a637-ad9348dec12a None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:49.084069 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a94b53a-df66-4b09-a637-ad9348dec12a None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:49.084339 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a94b53a-df66-4b09-a637-ad9348dec12a None admin] PATH_INFO: `/v3/domains` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:49.084983 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a94b53a-df66-4b09-a637-ad9348dec12a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:18:49.085285 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a94b53a-df66-4b09-a637-ad9348dec12a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:49.086686 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a94b53a-df66-4b09-a637-ad9348dec12a None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:49.106719 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 351/692] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Sep 9 16:18:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:18:49.110412 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a94b53a-df66-4b09-a637-ad9348dec12a None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:49.137512 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c87cab-f87e-4d24-83b6-77ad50b13b10 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:49.197940 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1024e2-d746-4473-b2f6-1780457d0973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:49.198561 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1024e2-d746-4473-b2f6-1780457d0973 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:49.198775 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1024e2-d746-4473-b2f6-1780457d0973 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:49.199020 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1024e2-d746-4473-b2f6-1780457d0973 None admin] PATH_INFO: `/v3/domains` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:49.199646 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1024e2-d746-4473-b2f6-1780457d0973 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:18:49.200113 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1024e2-d746-4473-b2f6-1780457d0973 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:49.201867 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1024e2-d746-4473-b2f6-1780457d0973 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:49.228350 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 342/693] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Sep 9 16:18:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:18:49.233849 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1024e2-d746-4473-b2f6-1780457d0973 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:49.266256 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a94b53a-df66-4b09-a637-ad9348dec12a None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:49.272931 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:49.305833 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78da49f1-13ec-4426-9a25-940c90567669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:49.306511 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78da49f1-13ec-4426-9a25-940c90567669 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:49.306792 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78da49f1-13ec-4426-9a25-940c90567669 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:49.307061 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78da49f1-13ec-4426-9a25-940c90567669 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:49.314878 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78da49f1-13ec-4426-9a25-940c90567669 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:49.316315 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78da49f1-13ec-4426-9a25-940c90567669 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:49.329479 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-78da49f1-13ec-4426-9a25-940c90567669 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 16:18:49.329479 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:18:49.329479 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:18:49.329479 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:18:49.329479 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:18:49.329479 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:18:49.329479 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:18:49.329479 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:18:49.329479 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:18:49.329479 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:18:49.329479 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:18:49.329479 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:18:49.329479 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 16:18:49.329479 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 16:18:49.329479 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 16:18:49.330445 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 16:18:49.330445 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:18:49.330445 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:18:49.330445 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:18:49.330445 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:18:49.330445 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:18:49.330445 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:18:49.330445 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:18:49.330445 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Sep 09 16:18:49.330445 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:18:49.330445 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:18:49.330445 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:18:49.330445 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:18:49.330445 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:18:49.330445 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:18:49.330445 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:18:49.330445 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:18:49.331332 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 16:18:49.331332 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 16:18:49.331332 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 16:18:49.331332 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 16:18:49.331332 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 16:18:49.331332 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 16:18:49.331332 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 16:18:49.331332 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:18:49.331332 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 352/694] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Sep 9 16:18:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:18:49.337294 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78da49f1-13ec-4426-9a25-940c90567669 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:49.413012 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:49.428355 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1024e2-d746-4473-b2f6-1780457d0973 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:49.465984 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9de828-3586-4b41-b4a2-c3c63043eb1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:49.466561 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9de828-3586-4b41-b4a2-c3c63043eb1e None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:49.466841 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9de828-3586-4b41-b4a2-c3c63043eb1e None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:49.467109 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9de828-3586-4b41-b4a2-c3c63043eb1e None admin] PATH_INFO: `/v3/users/nova` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:49.475346 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9de828-3586-4b41-b4a2-c3c63043eb1e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:49.477006 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9de828-3586-4b41-b4a2-c3c63043eb1e None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:49.490495 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-4e9de828-3586-4b41-b4a2-c3c63043eb1e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 09 16:18:49.490495 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:18:49.490495 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:18:49.490495 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:18:49.490495 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:18:49.490495 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:18:49.490495 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:18:49.490495 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:18:49.490495 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:18:49.490495 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:18:49.490495 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:18:49.490495 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:18:49.490495 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 16:18:49.490495 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 16:18:49.490495 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 16:18:49.490495 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 16:18:49.491461 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:18:49.491461 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:18:49.491461 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 16:18:49.491461 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 16:18:49.491461 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 16:18:49.491461 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 16:18:49.491461 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:18:49.491461 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:18:49.491461 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:18:49.491461 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:18:49.491461 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:18:49.491461 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 16:18:49.491461 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:18:49.491461 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:18:49.491461 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:18:49.491461 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:18:49.491461 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:18:49.491461 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:18:49.492458 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:18:49.492458 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:18:49.492458 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 16:18:49.492458 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 16:18:49.492458 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 16:18:49.492458 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 16:18:49.492458 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 16:18:49.492458 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 16:18:49.492458 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 09 16:18:49.492458 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 16:18:49.492458 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 343/695] 10.222.0.27 () {56 vars in 1093 bytes} [Fri Sep 9 16:18:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:18:49.499317 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9de828-3586-4b41-b4a2-c3c63043eb1e None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:49.546331 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78da49f1-13ec-4426-9a25-940c90567669 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:49.583339 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5dc537-d7a8-4a14-b1f0-de2e0d82859a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:49.583948 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5dc537-d7a8-4a14-b1f0-de2e0d82859a None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:49.584225 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5dc537-d7a8-4a14-b1f0-de2e0d82859a None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:49.584497 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5dc537-d7a8-4a14-b1f0-de2e0d82859a None admin] PATH_INFO: `/v3/projects` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:49.585208 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5dc537-d7a8-4a14-b1f0-de2e0d82859a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:18:49.585514 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5dc537-d7a8-4a14-b1f0-de2e0d82859a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:49.587032 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5dc537-d7a8-4a14-b1f0-de2e0d82859a None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:49.602319 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 353/696] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Sep 9 16:18:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:18:49.608188 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5dc537-d7a8-4a14-b1f0-de2e0d82859a None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:49.671842 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:49.706329 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9de828-3586-4b41-b4a2-c3c63043eb1e None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:49.715478 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:49.720320 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5dc537-d7a8-4a14-b1f0-de2e0d82859a None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:49.752943 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e075c1-6972-4442-be05-105da887161b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:49.754013 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e075c1-6972-4442-be05-105da887161b None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:49.754298 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e075c1-6972-4442-be05-105da887161b None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:49.754867 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e075c1-6972-4442-be05-105da887161b None admin] PATH_INFO: `/v3/users` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:49.755610 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e075c1-6972-4442-be05-105da887161b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:18:49.756016 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e075c1-6972-4442-be05-105da887161b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:49.757684 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e075c1-6972-4442-be05-105da887161b None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:49.758848 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7d4eb2-3a9d-4f1d-9396-9531c4460cd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:49.759671 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7d4eb2-3a9d-4f1d-9396-9531c4460cd0 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:49.760043 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7d4eb2-3a9d-4f1d-9396-9531c4460cd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:49.760520 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7d4eb2-3a9d-4f1d-9396-9531c4460cd0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:49.761314 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7d4eb2-3a9d-4f1d-9396-9531c4460cd0 None admin] RBAC: Adding query filter params (role.id=1966594501e743aebf757851d9cd82a5, scope.project.id=68d6aaafab824657b08ca91f3d46d5f8, user.id=a2350bbc4a194c2dab2e3be830fd0eba) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:18:49.761695 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7d4eb2-3a9d-4f1d-9396-9531c4460cd0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:49.763195 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7d4eb2-3a9d-4f1d-9396-9531c4460cd0 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:49.770639 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 354/697] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Sep 9 16:18:49 2022] GET /identity/v3/role_assignments?user.id=a2350bbc4a194c2dab2e3be830fd0eba&scope.project.id=68d6aaafab824657b08ca91f3d46d5f8&role.id=1966594501e743aebf757851d9cd82a5 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:18:49.775847 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02ec812-35ae-481a-a77b-c2a08e91a4af None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:49.776209 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02ec812-35ae-481a-a77b-c2a08e91a4af None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:49.776560 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02ec812-35ae-481a-a77b-c2a08e91a4af None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:49.778211 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 355/698] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:18:49 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:18:49.783922 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 344/699] 10.222.0.27 () {56 vars in 1133 bytes} [Fri Sep 9 16:18:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:18:49.784237 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04aa45f-dd18-4664-abe5-7fbed970faf3 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:49.784627 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04aa45f-dd18-4664-abe5-7fbed970faf3 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:49.784963 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04aa45f-dd18-4664-abe5-7fbed970faf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:49.793831 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e075c1-6972-4442-be05-105da887161b None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:49.809339 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-b04aa45f-dd18-4664-abe5-7fbed970faf3 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:18:49.811046 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-b04aa45f-dd18-4664-abe5-7fbed970faf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:18:49.940200 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 356/700] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:18:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 16:18:50.001708 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3312ea-e830-4609-a80d-9bdf2915c415 None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:50.002907 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3312ea-e830-4609-a80d-9bdf2915c415 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:50.003364 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3312ea-e830-4609-a80d-9bdf2915c415 None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:50.004872 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 357/701] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:18:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 16:18:50.006860 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e075c1-6972-4442-be05-105da887161b None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:50.010134 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6921db20-a357-4fec-92d9-1c13cc626103 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:50.010613 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6921db20-a357-4fec-92d9-1c13cc626103 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:50.011027 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6921db20-a357-4fec-92d9-1c13cc626103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:50.031545 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-6921db20-a357-4fec-92d9-1c13cc626103 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:18:50.034162 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-6921db20-a357-4fec-92d9-1c13cc626103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:18:50.048207 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a65057-f38b-455a-bc84-ed8bccc54938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:50.048904 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a65057-f38b-455a-bc84-ed8bccc54938 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:50.049227 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a65057-f38b-455a-bc84-ed8bccc54938 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:50.049543 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a65057-f38b-455a-bc84-ed8bccc54938 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:50.053285 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:50.125251 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 358/702] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:18:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 16:18:50.137183 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a65057-f38b-455a-bc84-ed8bccc54938 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:50.138975 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a65057-f38b-455a-bc84-ed8bccc54938 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:50.224102 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c9a948-7683-468d-8a94-4738edfb942d None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:50.224760 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c9a948-7683-468d-8a94-4738edfb942d None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:50.225235 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c9a948-7683-468d-8a94-4738edfb942d None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:50.226859 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 359/703] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:18:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:18:50.232256 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fdf175-cc2a-48f4-a445-e913e6910d3d None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:50.232817 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fdf175-cc2a-48f4-a445-e913e6910d3d None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:50.233304 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fdf175-cc2a-48f4-a445-e913e6910d3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:50.251108 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 345/704] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Sep 9 16:18:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 09 16:18:50.251108 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a65057-f38b-455a-bc84-ed8bccc54938 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:50.261166 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-89fdf175-cc2a-48f4-a445-e913e6910d3d None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:18:50.262638 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-89fdf175-cc2a-48f4-a445-e913e6910d3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:18:50.286277 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:50.301587 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:50.335056 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 360/705] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:18:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 16:18:50.335914 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fdf175-cc2a-48f4-a445-e913e6910d3d None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:50.390478 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a65057-f38b-455a-bc84-ed8bccc54938 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:50.450992 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc55ddab-c0f8-4f1f-b824-1947fbbf9237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:50.452439 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc55ddab-c0f8-4f1f-b824-1947fbbf9237 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:50.452973 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc55ddab-c0f8-4f1f-b824-1947fbbf9237 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:50.453395 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc55ddab-c0f8-4f1f-b824-1947fbbf9237 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:50.466995 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc55ddab-c0f8-4f1f-b824-1947fbbf9237 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:50.469131 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc55ddab-c0f8-4f1f-b824-1947fbbf9237 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:50.471781 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fdf175-cc2a-48f4-a445-e913e6910d3d None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:50.488415 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-fc55ddab-c0f8-4f1f-b824-1947fbbf9237 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 16:18:50.488415 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:18:50.488415 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:18:50.488415 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:18:50.488415 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:18:50.488415 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:18:50.488415 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:18:50.488415 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:18:50.488415 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:18:50.488415 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:18:50.488415 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:18:50.488415 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:18:50.488415 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 16:18:50.488415 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 16:18:50.488415 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 16:18:50.488415 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 16:18:50.489587 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:18:50.489587 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:18:50.489587 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:18:50.489587 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:18:50.489587 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:18:50.489587 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:18:50.489587 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:18:50.489587 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 16:18:50.489587 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:18:50.489587 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:18:50.489587 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:18:50.489587 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:18:50.489587 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:18:50.489587 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:18:50.489587 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:18:50.489587 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:18:50.489587 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 16:18:50.490666 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 16:18:50.490666 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 16:18:50.490666 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 16:18:50.491513 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 346/706] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 16:18:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:18:50.492300 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc55ddab-c0f8-4f1f-b824-1947fbbf9237 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:50.520444 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e44d0e-c3d7-4010-9866-415aba943574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:50.521042 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e44d0e-c3d7-4010-9866-415aba943574 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:50.521325 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e44d0e-c3d7-4010-9866-415aba943574 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:50.521593 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e44d0e-c3d7-4010-9866-415aba943574 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:50.534704 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e44d0e-c3d7-4010-9866-415aba943574 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:50.536401 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e44d0e-c3d7-4010-9866-415aba943574 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:50.555736 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-56e44d0e-c3d7-4010-9866-415aba943574 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 16:18:50.555736 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:18:50.555736 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:18:50.555736 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:18:50.555736 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:18:50.555736 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:18:50.555736 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:18:50.555736 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:18:50.555736 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:18:50.555736 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:18:50.555736 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:18:50.555736 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:18:50.555736 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 16:18:50.555736 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 16:18:50.555736 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 16:18:50.555736 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 16:18:50.556743 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:18:50.556743 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:18:50.556743 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:18:50.556743 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:18:50.556743 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:18:50.556743 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:18:50.556743 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:18:50.556743 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Sep 09 16:18:50.556743 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:18:50.556743 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:18:50.556743 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:18:50.556743 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:18:50.556743 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:18:50.556743 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:18:50.556743 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:18:50.556743 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:18:50.556743 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 16:18:50.557649 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 16:18:50.557649 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 16:18:50.557649 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:18:50.557649 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 361/707] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 16:18:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:18:50.557884 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e44d0e-c3d7-4010-9866-415aba943574 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:50.563298 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:50.622422 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:50.641396 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc55ddab-c0f8-4f1f-b824-1947fbbf9237 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:50.679085 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e44d0e-c3d7-4010-9866-415aba943574 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:50.681217 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1d9ad3-97fc-4b97-9093-a5701f5593ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:50.681856 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1d9ad3-97fc-4b97-9093-a5701f5593ce None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:50.682126 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1d9ad3-97fc-4b97-9093-a5701f5593ce None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:50.682586 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1d9ad3-97fc-4b97-9093-a5701f5593ce None admin] PATH_INFO: `/v3/services/network` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:50.683164 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1d9ad3-97fc-4b97-9093-a5701f5593ce None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:50.684925 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1d9ad3-97fc-4b97-9093-a5701f5593ce None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:50.696083 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-5b1d9ad3-97fc-4b97-9093-a5701f5593ce None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 09 16:18:50.696083 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:18:50.696083 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 16:18:50.696083 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 16:18:50.696083 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 16:18:50.696083 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 16:18:50.696083 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 16:18:50.696083 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 16:18:50.696083 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 09 16:18:50.696083 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 16:18:50.696083 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 16:18:50.696083 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 16:18:50.696083 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:18:50.696083 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:18:50.696083 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:18:50.696083 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:18:50.696083 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:18:50.697075 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:18:50.697075 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:18:50.697075 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:18:50.697075 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:18:50.697075 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:18:50.697075 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:18:50.697075 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 16:18:50.697075 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 16:18:50.697075 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 16:18:50.697075 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 16:18:50.697075 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:18:50.697075 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:18:50.697075 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:18:50.697075 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:18:50.697075 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:18:50.697075 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:18:50.697923 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:18:50.697923 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 16:18:50.697923 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:18:50.697923 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:18:50.697923 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:18:50.697923 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:18:50.697923 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:18:50.697923 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:18:50.697923 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:18:50.697923 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:18:50.697923 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 16:18:50.697923 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 16:18:50.697923 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 09 16:18:50.697923 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 16:18:50.697923 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 347/708] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Sep 9 16:18:50 2022] GET /identity/v3/services/network => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:18:50.699451 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1d9ad3-97fc-4b97-9093-a5701f5593ce None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:50.722533 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a52e54-69f6-4eaa-a8a2-cdbc02be60ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:50.723400 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a52e54-69f6-4eaa-a8a2-cdbc02be60ff None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:50.723686 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a52e54-69f6-4eaa-a8a2-cdbc02be60ff None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:50.724385 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a52e54-69f6-4eaa-a8a2-cdbc02be60ff None admin] PATH_INFO: `/v3/domains` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:50.725306 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a52e54-69f6-4eaa-a8a2-cdbc02be60ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:18:50.725609 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a52e54-69f6-4eaa-a8a2-cdbc02be60ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:50.727253 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a52e54-69f6-4eaa-a8a2-cdbc02be60ff None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:50.745435 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 362/709] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Sep 9 16:18:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:18:50.745435 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a52e54-69f6-4eaa-a8a2-cdbc02be60ff None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:50.806183 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1d9ad3-97fc-4b97-9093-a5701f5593ce None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:50.824949 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:50.841210 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe03caf8-a142-4c05-9ca3-00c185921167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:50.841822 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe03caf8-a142-4c05-9ca3-00c185921167 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:50.842099 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe03caf8-a142-4c05-9ca3-00c185921167 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:50.842431 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe03caf8-a142-4c05-9ca3-00c185921167 None admin] PATH_INFO: `/v3/domains` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:50.843068 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe03caf8-a142-4c05-9ca3-00c185921167 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:18:50.843366 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe03caf8-a142-4c05-9ca3-00c185921167 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:50.844949 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe03caf8-a142-4c05-9ca3-00c185921167 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:50.857199 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 348/710] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Sep 9 16:18:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:18:50.858021 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe03caf8-a142-4c05-9ca3-00c185921167 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:50.876197 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a52e54-69f6-4eaa-a8a2-cdbc02be60ff None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:50.876372 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:50.912914 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7117df-3ef3-493d-894c-9f295a8dbf41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:50.913540 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7117df-3ef3-493d-894c-9f295a8dbf41 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:50.913816 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7117df-3ef3-493d-894c-9f295a8dbf41 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:50.914089 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7117df-3ef3-493d-894c-9f295a8dbf41 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:50.914691 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7117df-3ef3-493d-894c-9f295a8dbf41 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:50.916069 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7117df-3ef3-493d-894c-9f295a8dbf41 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:50.927102 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-cf7117df-3ef3-493d-894c-9f295a8dbf41 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 09 16:18:50.927102 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:18:50.927102 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 16:18:50.927102 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 16:18:50.927102 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 16:18:50.927102 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 16:18:50.927102 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 16:18:50.927102 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 16:18:50.927102 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 09 16:18:50.927102 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:18:50.927102 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 16:18:50.927102 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:18:50.927102 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:18:50.927102 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:18:50.927102 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:18:50.927102 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:18:50.927102 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:18:50.928151 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:18:50.928151 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:18:50.928151 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:18:50.928151 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:18:50.928151 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:18:50.928151 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:18:50.928151 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 16:18:50.928151 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 16:18:50.928151 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 16:18:50.928151 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 16:18:50.928151 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:18:50.928151 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:18:50.928151 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:18:50.928151 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:18:50.928151 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:18:50.928151 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:18:50.929029 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:18:50.929029 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Sep 09 16:18:50.929029 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:18:50.929029 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:18:50.929029 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:18:50.929029 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:18:50.929029 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:18:50.929029 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:18:50.929029 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:18:50.929029 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:18:50.929029 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 16:18:50.929029 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 16:18:50.929029 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 09 16:18:50.929029 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:18:50.929029 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 363/711] 10.222.0.27 () {56 vars in 1129 bytes} [Fri Sep 9 16:18:50 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:18:50.929826 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7117df-3ef3-493d-894c-9f295a8dbf41 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:50.968592 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe03caf8-a142-4c05-9ca3-00c185921167 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:51.003258 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ea4e45-dd4f-4f76-b68c-48bc290366cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:51.004134 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ea4e45-dd4f-4f76-b68c-48bc290366cf None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:51.004486 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ea4e45-dd4f-4f76-b68c-48bc290366cf None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:51.004760 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ea4e45-dd4f-4f76-b68c-48bc290366cf None admin] PATH_INFO: `/v3/services` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:51.005384 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ea4e45-dd4f-4f76-b68c-48bc290366cf None admin] RBAC: Adding query filter params (name=network) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:18:51.005685 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ea4e45-dd4f-4f76-b68c-48bc290366cf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:51.007093 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ea4e45-dd4f-4f76-b68c-48bc290366cf None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:51.016167 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 349/712] 10.222.0.27 () {56 vars in 1112 bytes} [Fri Sep 9 16:18:50 2022] GET /identity/v3/services?name=network => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:18:51.017323 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ea4e45-dd4f-4f76-b68c-48bc290366cf None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:51.046630 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7117df-3ef3-493d-894c-9f295a8dbf41 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:51.074640 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:51.085283 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3adcb3-05fc-4dae-a5e1-1ff49b94f174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:51.087545 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3adcb3-05fc-4dae-a5e1-1ff49b94f174 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:51.087545 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3adcb3-05fc-4dae-a5e1-1ff49b94f174 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:51.087545 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3adcb3-05fc-4dae-a5e1-1ff49b94f174 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:51.099330 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3adcb3-05fc-4dae-a5e1-1ff49b94f174 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:51.100825 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3adcb3-05fc-4dae-a5e1-1ff49b94f174 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:51.105186 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:51.112769 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-6d3adcb3-05fc-4dae-a5e1-1ff49b94f174 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 16:18:51.112769 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:18:51.112769 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:18:51.112769 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:18:51.112769 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:18:51.112769 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:18:51.112769 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:18:51.112769 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:18:51.112769 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:18:51.112769 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:18:51.112769 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:18:51.112769 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:18:51.112769 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 16:18:51.112769 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 16:18:51.112769 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 16:18:51.113695 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 16:18:51.113695 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:18:51.113695 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:18:51.113695 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:18:51.113695 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:18:51.113695 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:18:51.113695 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:18:51.113695 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:18:51.113695 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Sep 09 16:18:51.113695 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:18:51.113695 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:18:51.113695 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:18:51.113695 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:18:51.113695 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:18:51.113695 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:18:51.113695 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:18:51.113695 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:18:51.114627 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 16:18:51.114627 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 16:18:51.114627 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 16:18:51.114627 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 16:18:51.114627 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 16:18:51.114627 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 16:18:51.114627 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 16:18:51.114627 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:18:51.114627 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 364/713] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Sep 9 16:18:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:18:51.115119 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3adcb3-05fc-4dae-a5e1-1ff49b94f174 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:51.134786 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ea4e45-dd4f-4f76-b68c-48bc290366cf None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:51.175933 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50157c3b-dd04-43a4-8fcd-48c2f5b9f5ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:51.176532 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50157c3b-dd04-43a4-8fcd-48c2f5b9f5ae None admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:51.176837 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50157c3b-dd04-43a4-8fcd-48c2f5b9f5ae None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:51.177076 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50157c3b-dd04-43a4-8fcd-48c2f5b9f5ae None admin] PATH_INFO: `/v3/users` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:51.177707 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50157c3b-dd04-43a4-8fcd-48c2f5b9f5ae None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:51.179162 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50157c3b-dd04-43a4-8fcd-48c2f5b9f5ae None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:51.200060 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 350/714] 10.222.0.27 () {60 vars in 1132 bytes} [Fri Sep 9 16:18:51 2022] POST /identity/v3/users => generated 254 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:18:51.207528 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50157c3b-dd04-43a4-8fcd-48c2f5b9f5ae None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:51.223250 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3adcb3-05fc-4dae-a5e1-1ff49b94f174 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:51.267574 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0501f1ef-5aed-4a49-bec7-afdba4001ca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:51.267574 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0501f1ef-5aed-4a49-bec7-afdba4001ca9 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:51.268612 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0501f1ef-5aed-4a49-bec7-afdba4001ca9 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:51.268612 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0501f1ef-5aed-4a49-bec7-afdba4001ca9 None admin] PATH_INFO: `/v3/services` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:51.269306 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0501f1ef-5aed-4a49-bec7-afdba4001ca9 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:18:51.269610 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0501f1ef-5aed-4a49-bec7-afdba4001ca9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:51.271039 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0501f1ef-5aed-4a49-bec7-afdba4001ca9 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:51.287887 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 365/715] 10.222.0.27 () {56 vars in 1124 bytes} [Fri Sep 9 16:18:51 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:18:51.289111 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0501f1ef-5aed-4a49-bec7-afdba4001ca9 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:51.353195 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:51.368294 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50157c3b-dd04-43a4-8fcd-48c2f5b9f5ae None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:51.405905 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:51.410505 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d069850-5a0d-47ad-b4f8-6c9968fd3de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:51.410770 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d069850-5a0d-47ad-b4f8-6c9968fd3de3 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:51.411442 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d069850-5a0d-47ad-b4f8-6c9968fd3de3 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:51.411689 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d069850-5a0d-47ad-b4f8-6c9968fd3de3 None admin] PATH_INFO: `/v3/services` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:51.412554 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d069850-5a0d-47ad-b4f8-6c9968fd3de3 None admin] RBAC: Adding query filter params (type=network) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:18:51.412888 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d069850-5a0d-47ad-b4f8-6c9968fd3de3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:51.414574 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d069850-5a0d-47ad-b4f8-6c9968fd3de3 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:51.416142 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0501f1ef-5aed-4a49-bec7-afdba4001ca9 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:51.421801 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 351/716] 10.222.0.27 () {56 vars in 1112 bytes} [Fri Sep 9 16:18:51 2022] GET /identity/v3/services?type=network => generated 124 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:18:51.422730 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d069850-5a0d-47ad-b4f8-6c9968fd3de3 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:51.461089 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb341b1c-29b0-4e15-8442-940588c9383e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:51.462570 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb341b1c-29b0-4e15-8442-940588c9383e None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:51.463221 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb341b1c-29b0-4e15-8442-940588c9383e None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:51.464406 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb341b1c-29b0-4e15-8442-940588c9383e None admin] PATH_INFO: `/v3/projects` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:51.466159 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb341b1c-29b0-4e15-8442-940588c9383e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:18:51.466927 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb341b1c-29b0-4e15-8442-940588c9383e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:51.469407 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb341b1c-29b0-4e15-8442-940588c9383e None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:51.493515 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 366/717] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Sep 9 16:18:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:18:51.499188 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb341b1c-29b0-4e15-8442-940588c9383e None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:51.547980 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d069850-5a0d-47ad-b4f8-6c9968fd3de3 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:51.588996 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb842db0-4193-47cb-8b19-d0e5f2f6b8c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:51.589625 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb842db0-4193-47cb-8b19-d0e5f2f6b8c1 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:51.589912 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb842db0-4193-47cb-8b19-d0e5f2f6b8c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:51.590189 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb842db0-4193-47cb-8b19-d0e5f2f6b8c1 None admin] PATH_INFO: `/v3/services` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:51.590865 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb842db0-4193-47cb-8b19-d0e5f2f6b8c1 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:18:51.591174 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb842db0-4193-47cb-8b19-d0e5f2f6b8c1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:51.592584 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb842db0-4193-47cb-8b19-d0e5f2f6b8c1 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:51.598691 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 352/718] 10.222.0.27 () {56 vars in 1124 bytes} [Fri Sep 9 16:18:51 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:18:51.673496 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb341b1c-29b0-4e15-8442-940588c9383e None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:51.689479 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:51.715552 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1562d80a-360d-4561-a84d-406b1d631c5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:51.716166 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1562d80a-360d-4561-a84d-406b1d631c5d None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:51.716637 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1562d80a-360d-4561-a84d-406b1d631c5d None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:51.716907 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1562d80a-360d-4561-a84d-406b1d631c5d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:51.717642 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1562d80a-360d-4561-a84d-406b1d631c5d None admin] RBAC: Adding query filter params (role.id=0a36d1be416f4089be19be979943b731, scope.project.id=68d6aaafab824657b08ca91f3d46d5f8, user.id=a332b9b4980646a3b14633293f77b505) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:18:51.717946 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1562d80a-360d-4561-a84d-406b1d631c5d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:51.719560 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1562d80a-360d-4561-a84d-406b1d631c5d None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:51.726808 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 367/719] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Sep 9 16:18:51 2022] GET /identity/v3/role_assignments?user.id=a332b9b4980646a3b14633293f77b505&scope.project.id=68d6aaafab824657b08ca91f3d46d5f8&role.id=0a36d1be416f4089be19be979943b731 => generated 259 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 16:18:52.460320 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de68795-96d5-4c2e-a3a3-b10ba4c2543f None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:52.461329 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de68795-96d5-4c2e-a3a3-b10ba4c2543f None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:52.461809 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de68795-96d5-4c2e-a3a3-b10ba4c2543f None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:52.463633 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 353/720] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:18:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:18:52.469475 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee92f89-6861-474c-b16e-a3eb5f5ca237 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:52.469900 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee92f89-6861-474c-b16e-a3eb5f5ca237 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:52.470077 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee92f89-6861-474c-b16e-a3eb5f5ca237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:52.493212 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-bee92f89-6861-474c-b16e-a3eb5f5ca237 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:18:52.498446 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-bee92f89-6861-474c-b16e-a3eb5f5ca237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:18:52.588551 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 368/721] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:18:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 16:18:52.961638 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de68795-96d5-4c2e-a3a3-b10ba4c2543f None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:53.031960 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:53.085194 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de68795-96d5-4c2e-a3a3-b10ba4c2543f None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:53.124362 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a1e74c-e4d8-4be7-a4f0-f32bdac1f857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:53.125080 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a1e74c-e4d8-4be7-a4f0-f32bdac1f857 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:53.125357 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a1e74c-e4d8-4be7-a4f0-f32bdac1f857 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:53.125622 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a1e74c-e4d8-4be7-a4f0-f32bdac1f857 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:53.145834 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a1e74c-e4d8-4be7-a4f0-f32bdac1f857 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 16:18:53.150560 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-a2a1e74c-e4d8-4be7-a4f0-f32bdac1f857 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 16:18:53.150560 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:18:53.150560 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:18:53.150560 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:18:53.150560 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:18:53.150560 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:18:53.150560 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:18:53.150560 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:18:53.150560 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:18:53.150560 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:18:53.150560 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:18:53.150560 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:18:53.150560 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 16:18:53.150560 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 16:18:53.150560 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 16:18:53.150560 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 16:18:53.151477 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 16:18:53.151477 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 16:18:53.151477 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 16:18:53.151477 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 16:18:53.151477 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:18:53.151477 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:18:53.151477 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:18:53.151477 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:18:53.151477 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:18:53.151477 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:18:53.151477 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:18:53.151477 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 16:18:53.151477 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:18:53.151477 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:18:53.151477 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:18:53.151477 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:18:53.152662 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:18:53.152662 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:18:53.152662 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:18:53.152662 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:18:53.152662 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 16:18:53.152662 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 16:18:53.152662 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 16:18:53.152662 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 16:18:53.152662 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 16:18:53.152662 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 16:18:53.152662 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 16:18:53.152662 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 16:18:53.152662 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 354/722] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Sep 9 16:18:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:18:53.160004 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee92f89-6861-474c-b16e-a3eb5f5ca237 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:53.276081 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee92f89-6861-474c-b16e-a3eb5f5ca237 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:53.302669 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:53.337237 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8096ef7e-f922-44c9-b8c4-235515de6793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:53.337866 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8096ef7e-f922-44c9-b8c4-235515de6793 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:53.338144 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8096ef7e-f922-44c9-b8c4-235515de6793 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:53.338443 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8096ef7e-f922-44c9-b8c4-235515de6793 None admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:53.339105 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8096ef7e-f922-44c9-b8c4-235515de6793 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:18:53.339402 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8096ef7e-f922-44c9-b8c4-235515de6793 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:53.340788 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8096ef7e-f922-44c9-b8c4-235515de6793 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:53.354671 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 369/723] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Sep 9 16:18:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:18:53.356561 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a1e74c-e4d8-4be7-a4f0-f32bdac1f857 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:53.520351 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a1e74c-e4d8-4be7-a4f0-f32bdac1f857 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:53.545646 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:53.566866 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13705ea-a1a5-4365-8e3d-3caa66c1dc4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:53.567507 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13705ea-a1a5-4365-8e3d-3caa66c1dc4c None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:53.567785 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13705ea-a1a5-4365-8e3d-3caa66c1dc4c None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:53.568055 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13705ea-a1a5-4365-8e3d-3caa66c1dc4c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:53.584077 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13705ea-a1a5-4365-8e3d-3caa66c1dc4c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:53.585547 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13705ea-a1a5-4365-8e3d-3caa66c1dc4c None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:53.606190 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-b13705ea-a1a5-4365-8e3d-3caa66c1dc4c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 16:18:53.606190 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:18:53.606190 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:18:53.606190 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:18:53.606190 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:18:53.606190 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:18:53.606190 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:18:53.606190 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:18:53.606190 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:18:53.606190 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:18:53.606190 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:18:53.606190 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:18:53.606190 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 16:18:53.606190 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 16:18:53.606190 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 16:18:53.606190 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 16:18:53.607176 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:18:53.607176 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:18:53.607176 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:18:53.607176 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:18:53.607176 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:18:53.607176 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:18:53.607176 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:18:53.607176 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 16:18:53.607176 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:18:53.607176 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:18:53.607176 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:18:53.607176 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:18:53.607176 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:18:53.607176 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:18:53.607176 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:18:53.607176 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:18:53.607176 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 16:18:53.608150 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 16:18:53.608150 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 16:18:53.608150 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 16:18:53.608150 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 355/724] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 16:18:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:18:53.613775 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8096ef7e-f922-44c9-b8c4-235515de6793 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:53.732002 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8096ef7e-f922-44c9-b8c4-235515de6793 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:53.773818 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ae2ac7-49dc-42f9-9f94-ddfd53f7f1ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:53.774466 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ae2ac7-49dc-42f9-9f94-ddfd53f7f1ee None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:53.774748 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ae2ac7-49dc-42f9-9f94-ddfd53f7f1ee None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:53.775020 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ae2ac7-49dc-42f9-9f94-ddfd53f7f1ee None admin] PATH_INFO: `/v3/domains` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:53.775659 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ae2ac7-49dc-42f9-9f94-ddfd53f7f1ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:18:53.775964 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ae2ac7-49dc-42f9-9f94-ddfd53f7f1ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:53.777332 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ae2ac7-49dc-42f9-9f94-ddfd53f7f1ee None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:53.790048 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 370/725] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Sep 9 16:18:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:18:53.798954 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13705ea-a1a5-4365-8e3d-3caa66c1dc4c None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:53.972517 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13705ea-a1a5-4365-8e3d-3caa66c1dc4c None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:53.990513 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508ef83b-5ae3-40c9-95cc-53086c5d2596 None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:53.991143 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508ef83b-5ae3-40c9-95cc-53086c5d2596 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:53.991617 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508ef83b-5ae3-40c9-95cc-53086c5d2596 None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:53.993457 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 371/726] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:18:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:18:53.998778 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a24a05-b872-4610-bf84-78d61c8390aa None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:53.999291 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a24a05-b872-4610-bf84-78d61c8390aa None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:53.999777 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a24a05-b872-4610-bf84-78d61c8390aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:54.026169 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511dceed-29bb-4508-8ff0-4b6b7a0c227e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:54.027159 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511dceed-29bb-4508-8ff0-4b6b7a0c227e None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:54.027609 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511dceed-29bb-4508-8ff0-4b6b7a0c227e None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:54.028056 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511dceed-29bb-4508-8ff0-4b6b7a0c227e None admin] PATH_INFO: `/v3/users/swift` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:54.029513 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-28a24a05-b872-4610-bf84-78d61c8390aa None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:18:54.031049 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-28a24a05-b872-4610-bf84-78d61c8390aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:18:54.041446 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511dceed-29bb-4508-8ff0-4b6b7a0c227e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:54.047526 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511dceed-29bb-4508-8ff0-4b6b7a0c227e None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:54.068743 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-511dceed-29bb-4508-8ff0-4b6b7a0c227e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 09 16:18:54.068743 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:18:54.068743 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:18:54.068743 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:18:54.068743 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:18:54.068743 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:18:54.068743 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:18:54.068743 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:18:54.068743 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:18:54.068743 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:18:54.068743 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:18:54.068743 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:18:54.068743 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 16:18:54.068743 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 16:18:54.068743 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 16:18:54.068743 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 16:18:54.069719 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:18:54.069719 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:18:54.069719 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 16:18:54.069719 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 16:18:54.069719 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 16:18:54.069719 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 16:18:54.069719 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:18:54.069719 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:18:54.069719 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:18:54.069719 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:18:54.069719 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:18:54.069719 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 16:18:54.069719 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:18:54.069719 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:18:54.069719 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:18:54.069719 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:18:54.069719 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:18:54.069719 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:18:54.070722 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:18:54.070722 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:18:54.070722 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 16:18:54.070722 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 16:18:54.070722 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 16:18:54.070722 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 16:18:54.070722 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 16:18:54.070722 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 16:18:54.070722 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 09 16:18:54.070722 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 16:18:54.075839 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 356/727] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Sep 9 16:18:53 2022] GET /identity/v3/users/swift => generated 83 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:18:54.080279 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511dceed-29bb-4508-8ff0-4b6b7a0c227e None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:54.090708 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:54.130696 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:54.180900 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 372/728] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:18:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 16:18:54.204834 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfed0db9-9254-410a-bb25-59ff32df2724 None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:54.205126 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfed0db9-9254-410a-bb25-59ff32df2724 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:54.205910 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfed0db9-9254-410a-bb25-59ff32df2724 None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:54.207587 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 373/729] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:18:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 16:18:54.214500 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044f1b52-3f6a-4eb9-b1a7-2b7d3afecb38 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:54.214781 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044f1b52-3f6a-4eb9-b1a7-2b7d3afecb38 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:54.215054 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044f1b52-3f6a-4eb9-b1a7-2b7d3afecb38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:54.238831 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511dceed-29bb-4508-8ff0-4b6b7a0c227e None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:54.244161 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-044f1b52-3f6a-4eb9-b1a7-2b7d3afecb38 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:18:54.245329 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-044f1b52-3f6a-4eb9-b1a7-2b7d3afecb38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:18:54.307459 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5ee72b-bb46-4bbd-9091-7c844a15b315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:54.308482 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5ee72b-bb46-4bbd-9091-7c844a15b315 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:54.309387 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5ee72b-bb46-4bbd-9091-7c844a15b315 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:54.309922 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5ee72b-bb46-4bbd-9091-7c844a15b315 None admin] PATH_INFO: `/v3/users` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:54.311938 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5ee72b-bb46-4bbd-9091-7c844a15b315 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:18:54.312258 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5ee72b-bb46-4bbd-9091-7c844a15b315 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:54.313761 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5ee72b-bb46-4bbd-9091-7c844a15b315 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:54.358388 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 357/730] 10.222.0.27 () {56 vars in 1135 bytes} [Fri Sep 9 16:18:54 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 16:18:54.363862 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5ee72b-bb46-4bbd-9091-7c844a15b315 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:54.375891 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 374/731] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:18:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 16:18:54.456922 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ad1957-d1a8-4601-a534-331729865bc0 None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:54.457237 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ad1957-d1a8-4601-a534-331729865bc0 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:54.457471 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ad1957-d1a8-4601-a534-331729865bc0 None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:54.459837 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 375/732] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:18:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 16:18:54.466075 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fd71aa-ee78-4098-af2d-d171bfe2ec4d None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:54.466399 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fd71aa-ee78-4098-af2d-d171bfe2ec4d None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:54.466673 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fd71aa-ee78-4098-af2d-d171bfe2ec4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:54.503795 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-29fd71aa-ee78-4098-af2d-d171bfe2ec4d None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:18:54.505006 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-29fd71aa-ee78-4098-af2d-d171bfe2ec4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:18:54.516596 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:54.526269 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5ee72b-bb46-4bbd-9091-7c844a15b315 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:54.571000 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25532ada-9079-425e-9aa6-b8fe14b1f2e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:54.571905 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25532ada-9079-425e-9aa6-b8fe14b1f2e1 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:54.573069 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25532ada-9079-425e-9aa6-b8fe14b1f2e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:54.573345 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25532ada-9079-425e-9aa6-b8fe14b1f2e1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:54.608642 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 376/733] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:18:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 16:18:54.609259 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fd71aa-ee78-4098-af2d-d171bfe2ec4d None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:54.633785 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:54.650163 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25532ada-9079-425e-9aa6-b8fe14b1f2e1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:54.651644 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25532ada-9079-425e-9aa6-b8fe14b1f2e1 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:54.726277 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fd71aa-ee78-4098-af2d-d171bfe2ec4d None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:54.745602 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:54.761598 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 358/734] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Sep 9 16:18:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 16:18:54.761598 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d430c064-ede6-422d-8b95-9619ff722548 None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:54.761598 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d430c064-ede6-422d-8b95-9619ff722548 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:54.761598 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d430c064-ede6-422d-8b95-9619ff722548 None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:54.761982 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7256254e-599b-4cca-9a7f-832cc7549ca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:54.761982 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7256254e-599b-4cca-9a7f-832cc7549ca9 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:54.761982 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7256254e-599b-4cca-9a7f-832cc7549ca9 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:54.762198 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7256254e-599b-4cca-9a7f-832cc7549ca9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:54.765294 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 359/735] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:18:54 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:18:54.766082 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d430c064-ede6-422d-8b95-9619ff722548 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:54.779019 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7256254e-599b-4cca-9a7f-832cc7549ca9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 16:18:54.786669 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-7256254e-599b-4cca-9a7f-832cc7549ca9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 16:18:54.786669 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:18:54.786669 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:18:54.786669 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:18:54.786669 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:18:54.786669 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:18:54.786669 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:18:54.786669 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:18:54.786669 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:18:54.786669 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:18:54.786669 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:18:54.786669 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:18:54.786669 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 16:18:54.786669 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 16:18:54.786669 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 16:18:54.786669 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 16:18:54.787786 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 16:18:54.787786 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 16:18:54.787786 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 16:18:54.787786 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 16:18:54.787786 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:18:54.787786 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:18:54.787786 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:18:54.787786 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:18:54.787786 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:18:54.787786 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:18:54.787786 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:18:54.787786 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Sep 09 16:18:54.787786 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:18:54.787786 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:18:54.787786 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:18:54.787786 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:18:54.788816 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:18:54.788816 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:18:54.788816 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:18:54.788816 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:18:54.788816 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 16:18:54.788816 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 16:18:54.788816 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 16:18:54.788816 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 16:18:54.788816 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 16:18:54.788816 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 16:18:54.788816 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 16:18:54.788816 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:18:54.791565 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 377/736] 10.222.0.27 () {56 vars in 1102 bytes} [Fri Sep 9 16:18:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:18:54.792724 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7256254e-599b-4cca-9a7f-832cc7549ca9 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:54.878173 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d430c064-ede6-422d-8b95-9619ff722548 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:54.879795 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:54.902038 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7256254e-599b-4cca-9a7f-832cc7549ca9 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:54.912392 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1544c30-e575-41bc-85e6-5a36a2861102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:54.912983 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1544c30-e575-41bc-85e6-5a36a2861102 None admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:54.913255 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1544c30-e575-41bc-85e6-5a36a2861102 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:54.913521 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1544c30-e575-41bc-85e6-5a36a2861102 None admin] PATH_INFO: `/v3/services` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:54.914150 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1544c30-e575-41bc-85e6-5a36a2861102 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:54.915541 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1544c30-e575-41bc-85e6-5a36a2861102 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:54.931698 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 360/737] 10.222.0.27 () {60 vars in 1141 bytes} [Fri Sep 9 16:18:54 2022] POST /identity/v3/services => generated 240 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:18:54.932882 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da437cf2-e45e-4144-b4b4-731c34c3d9d4 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:54.933162 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da437cf2-e45e-4144-b4b4-731c34c3d9d4 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:54.933437 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da437cf2-e45e-4144-b4b4-731c34c3d9d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:54.952342 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-da437cf2-e45e-4144-b4b4-731c34c3d9d4 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:18:54.953584 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-da437cf2-e45e-4144-b4b4-731c34c3d9d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:18:54.964305 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e838da-3864-4897-bca2-9e599568b48d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:54.964956 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e838da-3864-4897-bca2-9e599568b48d None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:54.965229 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e838da-3864-4897-bca2-9e599568b48d None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:54.965495 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e838da-3864-4897-bca2-9e599568b48d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:54.982462 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e838da-3864-4897-bca2-9e599568b48d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:54.983984 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e838da-3864-4897-bca2-9e599568b48d None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:55.000226 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-23e838da-3864-4897-bca2-9e599568b48d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 16:18:55.000226 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:18:55.000226 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:18:55.000226 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:18:55.000226 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:18:55.000226 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:18:55.000226 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:18:55.000226 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:18:55.000226 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:18:55.000226 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:18:55.000226 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:18:55.000226 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:18:55.000226 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 16:18:55.000226 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 16:18:55.000226 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 16:18:55.000226 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 16:18:55.001731 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:18:55.001731 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:18:55.001731 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:18:55.001731 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:18:55.001731 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:18:55.001731 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:18:55.001731 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:18:55.001731 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Sep 09 16:18:55.001731 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:18:55.001731 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:18:55.001731 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:18:55.001731 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:18:55.001731 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:18:55.001731 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:18:55.001731 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:18:55.001731 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:18:55.001731 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 16:18:55.003835 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 16:18:55.003835 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 16:18:55.003835 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:18:55.003835 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 378/738] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 16:18:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:18:55.003835 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e838da-3864-4897-bca2-9e599568b48d None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:55.019020 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:55.043988 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 361/739] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:18:54 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 16:18:55.044653 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da437cf2-e45e-4144-b4b4-731c34c3d9d4 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:55.148203 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e838da-3864-4897-bca2-9e599568b48d None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:55.170101 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da437cf2-e45e-4144-b4b4-731c34c3d9d4 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:55.177903 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:55.191133 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a72438-6810-4a56-ab60-7c0ebaf90de5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:55.192075 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a72438-6810-4a56-ab60-7c0ebaf90de5 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:55.192359 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a72438-6810-4a56-ab60-7c0ebaf90de5 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:55.192629 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a72438-6810-4a56-ab60-7c0ebaf90de5 None admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:55.193291 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a72438-6810-4a56-ab60-7c0ebaf90de5 None admin] RBAC: Adding query filter params (name=service) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:18:55.193590 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a72438-6810-4a56-ab60-7c0ebaf90de5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:55.198679 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a72438-6810-4a56-ab60-7c0ebaf90de5 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:55.207535 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 379/740] 10.222.0.27 () {56 vars in 1103 bytes} [Fri Sep 9 16:18:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:18:55.208680 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a72438-6810-4a56-ab60-7c0ebaf90de5 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:55.212982 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba928b1-2faf-415a-b5e9-9f61943db981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:55.213137 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba928b1-2faf-415a-b5e9-9f61943db981 None admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:55.213298 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba928b1-2faf-415a-b5e9-9f61943db981 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:55.213577 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba928b1-2faf-415a-b5e9-9f61943db981 None admin] PATH_INFO: `/v3/services` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:55.214273 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba928b1-2faf-415a-b5e9-9f61943db981 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:55.215760 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba928b1-2faf-415a-b5e9-9f61943db981 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:55.233483 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 362/741] 10.222.0.27 () {60 vars in 1141 bytes} [Fri Sep 9 16:18:55 2022] POST /identity/v3/services => generated 251 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:18:55.234511 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba928b1-2faf-415a-b5e9-9f61943db981 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:55.302728 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:55.322290 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a72438-6810-4a56-ab60-7c0ebaf90de5 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:55.367768 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4894c174-2dee-4258-88c4-ff6873d05f4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:55.368393 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4894c174-2dee-4258-88c4-ff6873d05f4e None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:55.368671 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4894c174-2dee-4258-88c4-ff6873d05f4e None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:55.368940 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4894c174-2dee-4258-88c4-ff6873d05f4e None admin] PATH_INFO: `/v3/domains` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:55.369978 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4894c174-2dee-4258-88c4-ff6873d05f4e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:18:55.369978 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4894c174-2dee-4258-88c4-ff6873d05f4e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:55.371382 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4894c174-2dee-4258-88c4-ff6873d05f4e None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:55.385716 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 380/742] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Sep 9 16:18:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:18:55.391321 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4894c174-2dee-4258-88c4-ff6873d05f4e None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:55.394574 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba928b1-2faf-415a-b5e9-9f61943db981 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:55.445261 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b45ed21-0c2f-4bbd-bab3-2e211c2b59aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:55.445916 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b45ed21-0c2f-4bbd-bab3-2e211c2b59aa None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:55.446197 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b45ed21-0c2f-4bbd-bab3-2e211c2b59aa None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:55.446501 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b45ed21-0c2f-4bbd-bab3-2e211c2b59aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:55.447749 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:55.461450 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b45ed21-0c2f-4bbd-bab3-2e211c2b59aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:55.463043 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b45ed21-0c2f-4bbd-bab3-2e211c2b59aa None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:55.478713 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-6b45ed21-0c2f-4bbd-bab3-2e211c2b59aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 16:18:55.478713 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:18:55.478713 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:18:55.478713 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:18:55.478713 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:18:55.478713 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:18:55.478713 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:18:55.478713 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:18:55.478713 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:18:55.478713 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:18:55.478713 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:18:55.478713 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:18:55.478713 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 16:18:55.478713 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 16:18:55.478713 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 16:18:55.478713 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 16:18:55.479718 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:18:55.479718 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:18:55.479718 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:18:55.479718 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:18:55.479718 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:18:55.479718 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:18:55.479718 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:18:55.479718 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 16:18:55.479718 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:18:55.479718 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:18:55.479718 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:18:55.479718 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:18:55.479718 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:18:55.479718 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:18:55.479718 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:18:55.479718 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:18:55.479718 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 16:18:55.480629 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 16:18:55.480629 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 16:18:55.480629 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 16:18:55.480629 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 363/743] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 16:18:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:18:55.480629 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b45ed21-0c2f-4bbd-bab3-2e211c2b59aa None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:55.524563 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4894c174-2dee-4258-88c4-ff6873d05f4e None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:55.561641 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50975acd-d86b-409c-8e00-772fb54b043e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:55.562271 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50975acd-d86b-409c-8e00-772fb54b043e None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:55.562569 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50975acd-d86b-409c-8e00-772fb54b043e None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:55.562832 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50975acd-d86b-409c-8e00-772fb54b043e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:55.569839 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50975acd-d86b-409c-8e00-772fb54b043e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:55.571316 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50975acd-d86b-409c-8e00-772fb54b043e None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:55.585038 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-50975acd-d86b-409c-8e00-772fb54b043e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 16:18:55.585038 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:18:55.585038 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:18:55.585038 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:18:55.585038 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:18:55.585038 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:18:55.585038 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:18:55.585038 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:18:55.585038 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:18:55.585038 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:18:55.585038 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:18:55.585038 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:18:55.585038 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 16:18:55.585038 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 16:18:55.585038 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 16:18:55.585984 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 16:18:55.585984 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:18:55.585984 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:18:55.585984 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:18:55.585984 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:18:55.585984 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:18:55.585984 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:18:55.585984 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:18:55.585984 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Sep 09 16:18:55.585984 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:18:55.585984 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:18:55.585984 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:18:55.585984 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:18:55.585984 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:18:55.585984 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:18:55.585984 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:18:55.585984 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:18:55.586910 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 16:18:55.586910 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 16:18:55.586910 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 16:18:55.586910 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 16:18:55.586910 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 16:18:55.586910 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 16:18:55.586910 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 16:18:55.586910 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:18:55.586910 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 381/744] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Sep 9 16:18:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:18:55.586910 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50975acd-d86b-409c-8e00-772fb54b043e None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:55.606759 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:55.620393 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b45ed21-0c2f-4bbd-bab3-2e211c2b59aa None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:55.668687 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10aa3ee-2e77-4035-a2ae-9acaae2c2c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:55.669315 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10aa3ee-2e77-4035-a2ae-9acaae2c2c06 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:55.669596 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10aa3ee-2e77-4035-a2ae-9acaae2c2c06 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:55.670403 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10aa3ee-2e77-4035-a2ae-9acaae2c2c06 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:55.685061 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10aa3ee-2e77-4035-a2ae-9acaae2c2c06 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 16:18:55.692854 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-d10aa3ee-2e77-4035-a2ae-9acaae2c2c06 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 16:18:55.692854 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:18:55.692854 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:18:55.692854 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:18:55.692854 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:18:55.692854 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:18:55.692854 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:18:55.692854 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:18:55.692854 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:18:55.692854 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:18:55.692854 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:18:55.692854 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:18:55.692854 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 16:18:55.692854 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 16:18:55.692854 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 16:18:55.692854 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 16:18:55.694139 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 16:18:55.694139 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 16:18:55.694139 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 16:18:55.694139 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 16:18:55.694139 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:18:55.694139 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:18:55.694139 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:18:55.694139 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:18:55.694139 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:18:55.694139 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:18:55.694139 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:18:55.694139 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 16:18:55.694139 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:18:55.694139 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:18:55.694139 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:18:55.694139 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:18:55.695208 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:18:55.695208 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:18:55.695208 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:18:55.695208 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:18:55.695208 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 16:18:55.695208 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 16:18:55.695208 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 16:18:55.695208 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 16:18:55.695208 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 16:18:55.695208 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 16:18:55.695208 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 16:18:55.695208 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 16:18:55.695208 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 364/745] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Sep 9 16:18:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:18:55.696096 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10aa3ee-2e77-4035-a2ae-9acaae2c2c06 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:55.700776 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50975acd-d86b-409c-8e00-772fb54b043e None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:55.701931 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:55.738153 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a80047b-28e1-4163-9df0-1117fbc7a1dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:55.738956 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a80047b-28e1-4163-9df0-1117fbc7a1dd None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:55.739325 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a80047b-28e1-4163-9df0-1117fbc7a1dd None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:55.739687 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a80047b-28e1-4163-9df0-1117fbc7a1dd None admin] PATH_INFO: `/v3/domains` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:55.740418 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a80047b-28e1-4163-9df0-1117fbc7a1dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:18:55.740829 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a80047b-28e1-4163-9df0-1117fbc7a1dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:55.742399 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a80047b-28e1-4163-9df0-1117fbc7a1dd None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:55.760267 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 382/746] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Sep 9 16:18:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:18:55.761280 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a80047b-28e1-4163-9df0-1117fbc7a1dd None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:55.825557 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10aa3ee-2e77-4035-a2ae-9acaae2c2c06 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:55.862113 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de7a2e0-7dc6-4e4c-ab35-78c6e847bfc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:55.862891 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de7a2e0-7dc6-4e4c-ab35-78c6e847bfc2 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:55.863257 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de7a2e0-7dc6-4e4c-ab35-78c6e847bfc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:55.863620 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de7a2e0-7dc6-4e4c-ab35-78c6e847bfc2 None admin] PATH_INFO: `/v3/projects` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:55.864411 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de7a2e0-7dc6-4e4c-ab35-78c6e847bfc2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:18:55.864860 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de7a2e0-7dc6-4e4c-ab35-78c6e847bfc2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:55.866455 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de7a2e0-7dc6-4e4c-ab35-78c6e847bfc2 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:55.884628 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 365/747] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Sep 9 16:18:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:18:55.885629 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de7a2e0-7dc6-4e4c-ab35-78c6e847bfc2 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:55.888117 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a80047b-28e1-4163-9df0-1117fbc7a1dd None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:55.901640 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:55.936461 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e24fc33-89da-43c8-ab90-d7c12753ec43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:55.937090 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e24fc33-89da-43c8-ab90-d7c12753ec43 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:55.937944 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e24fc33-89da-43c8-ab90-d7c12753ec43 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:55.938227 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e24fc33-89da-43c8-ab90-d7c12753ec43 None admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:55.939355 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e24fc33-89da-43c8-ab90-d7c12753ec43 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:18:55.940203 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e24fc33-89da-43c8-ab90-d7c12753ec43 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:55.941951 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e24fc33-89da-43c8-ab90-d7c12753ec43 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:55.956284 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 383/748] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Sep 9 16:18:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:18:55.957584 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e24fc33-89da-43c8-ab90-d7c12753ec43 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:55.988709 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:56.004011 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de7a2e0-7dc6-4e4c-ab35-78c6e847bfc2 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:56.041653 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbf1798-d615-4cc7-8150-769e04e27ed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:56.042289 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbf1798-d615-4cc7-8150-769e04e27ed1 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:56.042703 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbf1798-d615-4cc7-8150-769e04e27ed1 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:56.043059 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbf1798-d615-4cc7-8150-769e04e27ed1 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:56.051074 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbf1798-d615-4cc7-8150-769e04e27ed1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:56.052721 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbf1798-d615-4cc7-8150-769e04e27ed1 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:56.065477 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e24fc33-89da-43c8-ab90-d7c12753ec43 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:56.066582 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-cdbf1798-d615-4cc7-8150-769e04e27ed1 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 09 16:18:56.066582 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:18:56.066582 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:18:56.066582 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:18:56.066582 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:18:56.066582 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:18:56.066582 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:18:56.066582 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:18:56.066582 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:18:56.066582 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:18:56.066582 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:18:56.066582 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:18:56.066582 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 16:18:56.066582 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 16:18:56.066582 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 16:18:56.066582 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 16:18:56.067575 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:18:56.067575 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:18:56.067575 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 16:18:56.067575 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 16:18:56.067575 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 16:18:56.067575 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 16:18:56.067575 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:18:56.067575 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:18:56.067575 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:18:56.067575 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:18:56.067575 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:18:56.067575 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 16:18:56.067575 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:18:56.067575 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:18:56.067575 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:18:56.067575 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:18:56.067575 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:18:56.067575 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:18:56.068532 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:18:56.068532 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:18:56.068532 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 16:18:56.068532 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 16:18:56.068532 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 16:18:56.068532 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 16:18:56.068532 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 16:18:56.068532 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 16:18:56.068532 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 09 16:18:56.068532 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 16:18:56.072963 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 366/749] 10.222.0.27 () {56 vars in 1117 bytes} [Fri Sep 9 16:18:55 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:18:56.073849 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbf1798-d615-4cc7-8150-769e04e27ed1 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:56.104950 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dc67a0-6137-4e5d-89de-b467810a3cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:56.105882 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dc67a0-6137-4e5d-89de-b467810a3cc1 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:56.106368 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dc67a0-6137-4e5d-89de-b467810a3cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:56.106863 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dc67a0-6137-4e5d-89de-b467810a3cc1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:56.107795 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dc67a0-6137-4e5d-89de-b467810a3cc1 None admin] RBAC: Adding query filter params (role.id=0a36d1be416f4089be19be979943b731, scope.project.id=68d6aaafab824657b08ca91f3d46d5f8, user.id=a2350bbc4a194c2dab2e3be830fd0eba) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:18:56.108285 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dc67a0-6137-4e5d-89de-b467810a3cc1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:56.109908 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dc67a0-6137-4e5d-89de-b467810a3cc1 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:56.116074 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 384/750] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Sep 9 16:18:55 2022] GET /identity/v3/role_assignments?user.id=a2350bbc4a194c2dab2e3be830fd0eba&scope.project.id=68d6aaafab824657b08ca91f3d46d5f8&role.id=0a36d1be416f4089be19be979943b731 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:18:56.117068 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dc67a0-6137-4e5d-89de-b467810a3cc1 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:56.205761 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:56.254897 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbf1798-d615-4cc7-8150-769e04e27ed1 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:56.295088 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:56.319337 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dc67a0-6137-4e5d-89de-b467810a3cc1 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:56.350348 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d982d3e-ebb0-49a0-ba2f-ccc0f8a23166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:56.350989 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d982d3e-ebb0-49a0-ba2f-ccc0f8a23166 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:56.351269 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d982d3e-ebb0-49a0-ba2f-ccc0f8a23166 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:56.351544 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d982d3e-ebb0-49a0-ba2f-ccc0f8a23166 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:56.367884 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d982d3e-ebb0-49a0-ba2f-ccc0f8a23166 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:56.371985 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d982d3e-ebb0-49a0-ba2f-ccc0f8a23166 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:56.375503 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27d23d4-c874-4433-921e-91e8c1bc9031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:56.376116 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27d23d4-c874-4433-921e-91e8c1bc9031 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:56.376396 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27d23d4-c874-4433-921e-91e8c1bc9031 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:56.376667 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27d23d4-c874-4433-921e-91e8c1bc9031 None admin] PATH_INFO: `/v3/users` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:56.377944 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27d23d4-c874-4433-921e-91e8c1bc9031 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:18:56.378252 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27d23d4-c874-4433-921e-91e8c1bc9031 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:56.379730 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27d23d4-c874-4433-921e-91e8c1bc9031 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:56.389569 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-9d982d3e-ebb0-49a0-ba2f-ccc0f8a23166 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 16:18:56.389569 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:18:56.389569 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:18:56.389569 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:18:56.389569 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:18:56.389569 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:18:56.389569 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:18:56.389569 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:18:56.389569 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:18:56.389569 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:18:56.389569 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:18:56.389569 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:18:56.389569 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 16:18:56.389569 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 16:18:56.389569 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 16:18:56.389569 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 16:18:56.390532 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:18:56.390532 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:18:56.390532 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:18:56.390532 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:18:56.390532 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:18:56.390532 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:18:56.390532 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:18:56.390532 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 16:18:56.390532 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:18:56.390532 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:18:56.390532 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:18:56.390532 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:18:56.390532 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:18:56.390532 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:18:56.390532 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:18:56.390532 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:18:56.390532 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 16:18:56.391420 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 16:18:56.391420 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 16:18:56.391420 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 16:18:56.393500 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 367/751] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 16:18:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:18:56.400815 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d982d3e-ebb0-49a0-ba2f-ccc0f8a23166 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:56.404687 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 385/752] 10.222.0.27 () {56 vars in 1149 bytes} [Fri Sep 9 16:18:56 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:18:56.411148 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27d23d4-c874-4433-921e-91e8c1bc9031 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:56.545234 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27d23d4-c874-4433-921e-91e8c1bc9031 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:56.590638 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d03d5f6-0db7-4b5e-a806-7673c3ddbf3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:56.591250 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d03d5f6-0db7-4b5e-a806-7673c3ddbf3b None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:56.591525 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d03d5f6-0db7-4b5e-a806-7673c3ddbf3b None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:56.591791 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d03d5f6-0db7-4b5e-a806-7673c3ddbf3b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:56.623636 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d982d3e-ebb0-49a0-ba2f-ccc0f8a23166 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:56.643957 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:56.659249 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:56.667485 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5f3714-0bac-48ba-ba1d-f67b45e35604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:56.668113 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5f3714-0bac-48ba-ba1d-f67b45e35604 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:56.668386 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5f3714-0bac-48ba-ba1d-f67b45e35604 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:56.668650 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5f3714-0bac-48ba-ba1d-f67b45e35604 None admin] PATH_INFO: `/v3/domains` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:56.669302 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5f3714-0bac-48ba-ba1d-f67b45e35604 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:18:56.669601 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5f3714-0bac-48ba-ba1d-f67b45e35604 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:56.671045 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5f3714-0bac-48ba-ba1d-f67b45e35604 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:56.712707 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 368/753] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Sep 9 16:18:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:18:56.717279 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5f3714-0bac-48ba-ba1d-f67b45e35604 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:56.762706 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d03d5f6-0db7-4b5e-a806-7673c3ddbf3b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:56.764177 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d03d5f6-0db7-4b5e-a806-7673c3ddbf3b None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:56.886538 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5f3714-0bac-48ba-ba1d-f67b45e35604 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:56.946725 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 386/754] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Sep 9 16:18:56 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 535 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 09 16:18:56.952672 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d03d5f6-0db7-4b5e-a806-7673c3ddbf3b None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:56.956940 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5b2b4c-4849-466e-9a8e-c740d5c0fe06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:56.957576 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5b2b4c-4849-466e-9a8e-c740d5c0fe06 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:56.957845 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5b2b4c-4849-466e-9a8e-c740d5c0fe06 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:56.958109 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5b2b4c-4849-466e-9a8e-c740d5c0fe06 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:56.972828 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5b2b4c-4849-466e-9a8e-c740d5c0fe06 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:56.974287 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5b2b4c-4849-466e-9a8e-c740d5c0fe06 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:56.988167 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-aa5b2b4c-4849-466e-9a8e-c740d5c0fe06 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 09 16:18:56.988167 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:18:56.988167 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:18:56.988167 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:18:56.988167 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:18:56.988167 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:18:56.988167 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:18:56.988167 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:18:56.988167 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:18:56.988167 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:18:56.988167 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:18:56.988167 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:18:56.988167 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 16:18:56.988167 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 16:18:56.988167 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 16:18:56.988167 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 16:18:56.989164 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:18:56.989164 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:18:56.989164 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 16:18:56.989164 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 16:18:56.989164 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 16:18:56.989164 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 16:18:56.989164 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:18:56.989164 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:18:56.989164 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:18:56.989164 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:18:56.989164 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:18:56.989164 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 16:18:56.989164 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:18:56.989164 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:18:56.989164 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:18:56.989164 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:18:56.989164 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:18:56.989164 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:18:56.990464 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:18:56.990464 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:18:56.990464 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 16:18:56.990464 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 16:18:56.990464 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 16:18:56.990464 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 16:18:56.990464 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 16:18:56.990464 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 16:18:56.990464 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 09 16:18:56.990464 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 16:18:56.990464 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 369/755] 10.222.0.27 () {56 vars in 1093 bytes} [Fri Sep 9 16:18:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:18:56.995269 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5b2b4c-4849-466e-9a8e-c740d5c0fe06 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:57.049807 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:57.104675 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:57.124525 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5b2b4c-4849-466e-9a8e-c740d5c0fe06 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:57.196729 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d03d5f6-0db7-4b5e-a806-7673c3ddbf3b None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:57.197663 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05c934c-3399-4f3b-b81e-d5e66d3e422f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:57.198502 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05c934c-3399-4f3b-b81e-d5e66d3e422f None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:57.198952 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05c934c-3399-4f3b-b81e-d5e66d3e422f None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:57.199392 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05c934c-3399-4f3b-b81e-d5e66d3e422f None admin] PATH_INFO: `/v3/users` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:57.201587 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05c934c-3399-4f3b-b81e-d5e66d3e422f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:18:57.202079 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05c934c-3399-4f3b-b81e-d5e66d3e422f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:57.203723 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05c934c-3399-4f3b-b81e-d5e66d3e422f None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:57.253491 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 370/756] 10.222.0.27 () {56 vars in 1133 bytes} [Fri Sep 9 16:18:56 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:18:57.258676 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05c934c-3399-4f3b-b81e-d5e66d3e422f None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:57.260589 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebe71bd-36fd-4d7e-8d2e-22af37da3d38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:57.261477 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebe71bd-36fd-4d7e-8d2e-22af37da3d38 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:57.262193 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebe71bd-36fd-4d7e-8d2e-22af37da3d38 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:57.263666 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebe71bd-36fd-4d7e-8d2e-22af37da3d38 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:57.278139 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebe71bd-36fd-4d7e-8d2e-22af37da3d38 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:57.281885 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebe71bd-36fd-4d7e-8d2e-22af37da3d38 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:57.305049 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-eebe71bd-36fd-4d7e-8d2e-22af37da3d38 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 16:18:57.305049 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:18:57.305049 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:18:57.305049 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:18:57.305049 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:18:57.305049 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:18:57.305049 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:18:57.305049 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:18:57.305049 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:18:57.305049 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:18:57.305049 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:18:57.305049 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:18:57.305049 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 16:18:57.305049 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 16:18:57.305049 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 16:18:57.305049 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 16:18:57.306030 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:18:57.306030 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:18:57.306030 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:18:57.306030 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:18:57.306030 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:18:57.306030 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:18:57.306030 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:18:57.306030 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Sep 09 16:18:57.306030 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:18:57.306030 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:18:57.306030 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:18:57.306030 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:18:57.306030 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:18:57.306030 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:18:57.306030 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:18:57.306030 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:18:57.306030 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 16:18:57.306944 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 16:18:57.306944 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 16:18:57.306944 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:18:57.309305 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 387/757] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 16:18:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 357 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:18:57.316366 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebe71bd-36fd-4d7e-8d2e-22af37da3d38 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:57.437165 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:57.441765 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebe71bd-36fd-4d7e-8d2e-22af37da3d38 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:57.458050 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05c934c-3399-4f3b-b81e-d5e66d3e422f None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:57.459752 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:57.485297 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59ab3cd-d4a3-4441-a75f-49b567d0976f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:57.486995 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59ab3cd-d4a3-4441-a75f-49b567d0976f None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:57.487479 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59ab3cd-d4a3-4441-a75f-49b567d0976f None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:57.488223 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59ab3cd-d4a3-4441-a75f-49b567d0976f None admin] PATH_INFO: `/v3/domains` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:57.489483 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59ab3cd-d4a3-4441-a75f-49b567d0976f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:18:57.490241 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59ab3cd-d4a3-4441-a75f-49b567d0976f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:57.491842 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59ab3cd-d4a3-4441-a75f-49b567d0976f None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:57.493714 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4f6aa1-7540-4621-bd98-cf7f3010061f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:57.494366 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4f6aa1-7540-4621-bd98-cf7f3010061f None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:57.494662 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4f6aa1-7540-4621-bd98-cf7f3010061f None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:57.495249 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4f6aa1-7540-4621-bd98-cf7f3010061f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:57.505822 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4f6aa1-7540-4621-bd98-cf7f3010061f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:57.507316 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4f6aa1-7540-4621-bd98-cf7f3010061f None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:57.508265 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 388/758] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Sep 9 16:18:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:18:57.513085 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f9f7e8-dda9-458a-9d14-3a0a79a3ca9c None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:57.513085 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f9f7e8-dda9-458a-9d14-3a0a79a3ca9c None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:57.513085 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f9f7e8-dda9-458a-9d14-3a0a79a3ca9c None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:57.513983 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 389/759] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:18:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:18:57.518987 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f9f7e8-dda9-458a-9d14-3a0a79a3ca9c None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:57.530810 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-8a4f6aa1-7540-4621-bd98-cf7f3010061f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 16:18:57.530810 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:18:57.530810 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:18:57.530810 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:18:57.530810 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:18:57.530810 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:18:57.530810 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:18:57.530810 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:18:57.530810 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:18:57.530810 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:18:57.530810 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:18:57.530810 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:18:57.530810 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 16:18:57.530810 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 16:18:57.530810 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 16:18:57.530810 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 16:18:57.531764 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:18:57.531764 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:18:57.531764 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:18:57.531764 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:18:57.531764 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:18:57.531764 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:18:57.531764 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:18:57.531764 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 16:18:57.531764 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:18:57.531764 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:18:57.531764 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:18:57.531764 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:18:57.531764 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:18:57.531764 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:18:57.531764 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:18:57.531764 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:18:57.531764 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 16:18:57.532645 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 16:18:57.532645 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 16:18:57.532645 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 16:18:57.535059 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 371/760] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 16:18:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 16:18:57.537176 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9595a029-023f-44f7-ae71-6f0b89ba4863 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:57.537658 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9595a029-023f-44f7-ae71-6f0b89ba4863 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:57.538270 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9595a029-023f-44f7-ae71-6f0b89ba4863 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:57.561406 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-9595a029-023f-44f7-ae71-6f0b89ba4863 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:18:57.563397 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-9595a029-023f-44f7-ae71-6f0b89ba4863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:18:57.640775 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f9f7e8-dda9-458a-9d14-3a0a79a3ca9c None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:57.655808 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 372/761] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:18:57 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 16:18:57.656542 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9595a029-023f-44f7-ae71-6f0b89ba4863 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:57.684274 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8e63af-856f-4a78-bac2-916223ed098d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:57.685493 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8e63af-856f-4a78-bac2-916223ed098d None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:57.685966 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8e63af-856f-4a78-bac2-916223ed098d None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:57.686474 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8e63af-856f-4a78-bac2-916223ed098d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:57.694729 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8e63af-856f-4a78-bac2-916223ed098d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:57.696512 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8e63af-856f-4a78-bac2-916223ed098d None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:57.710623 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-cf8e63af-856f-4a78-bac2-916223ed098d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 16:18:57.710623 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:18:57.710623 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:18:57.710623 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:18:57.710623 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:18:57.710623 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:18:57.710623 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:18:57.710623 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:18:57.710623 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:18:57.710623 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:18:57.710623 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:18:57.710623 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:18:57.710623 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 16:18:57.710623 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 16:18:57.710623 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 16:18:57.711516 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 16:18:57.711516 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:18:57.711516 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:18:57.711516 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:18:57.711516 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:18:57.711516 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:18:57.711516 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:18:57.711516 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:18:57.711516 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Sep 09 16:18:57.711516 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:18:57.711516 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:18:57.711516 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:18:57.711516 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:18:57.711516 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:18:57.711516 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:18:57.711516 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:18:57.711516 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:18:57.712404 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 16:18:57.712404 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 16:18:57.712404 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 16:18:57.712404 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 16:18:57.712404 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 16:18:57.712404 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 16:18:57.712404 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 16:18:57.712404 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:18:57.718429 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 390/762] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Sep 9 16:18:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:18:57.721726 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8e63af-856f-4a78-bac2-916223ed098d None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:57.747386 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:57.749361 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:57.769197 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9595a029-023f-44f7-ae71-6f0b89ba4863 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:57.807078 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94aa40d5-fcfb-4c48-990a-5853793c7bba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:57.807698 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aa40d5-fcfb-4c48-990a-5853793c7bba None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:57.807976 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aa40d5-fcfb-4c48-990a-5853793c7bba None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:57.808247 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aa40d5-fcfb-4c48-990a-5853793c7bba None admin] PATH_INFO: `/v3/domains` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:57.808971 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94aa40d5-fcfb-4c48-990a-5853793c7bba None admin] RBAC: Adding query filter params (name=Default) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:18:57.809259 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94aa40d5-fcfb-4c48-990a-5853793c7bba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:57.810964 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94aa40d5-fcfb-4c48-990a-5853793c7bba None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:57.823912 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 373/763] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Sep 9 16:18:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:18:57.825318 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f7ec50-27e7-4e7e-b2d3-9466b8b521ee None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:57.825610 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f7ec50-27e7-4e7e-b2d3-9466b8b521ee None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:57.825886 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f7ec50-27e7-4e7e-b2d3-9466b8b521ee None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:57.827466 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 374/764] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:18:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:18:57.834768 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b50dbfc-3505-49ba-887d-1ce0c5b3ff1a None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:57.835050 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b50dbfc-3505-49ba-887d-1ce0c5b3ff1a None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:57.835327 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b50dbfc-3505-49ba-887d-1ce0c5b3ff1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:57.855515 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-1b50dbfc-3505-49ba-887d-1ce0c5b3ff1a None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:18:57.856758 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-1b50dbfc-3505-49ba-887d-1ce0c5b3ff1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:18:57.934463 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 375/765] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:18:57 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 16:18:57.935812 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b50dbfc-3505-49ba-887d-1ce0c5b3ff1a None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:57.995549 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8e63af-856f-4a78-bac2-916223ed098d None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:58.038171 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49d7648-fd13-4780-86b1-93fc0afb5669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:58.039084 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49d7648-fd13-4780-86b1-93fc0afb5669 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:58.039504 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49d7648-fd13-4780-86b1-93fc0afb5669 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:58.039939 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49d7648-fd13-4780-86b1-93fc0afb5669 None admin] PATH_INFO: `/v3/projects` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:58.040776 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49d7648-fd13-4780-86b1-93fc0afb5669 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:18:58.041219 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49d7648-fd13-4780-86b1-93fc0afb5669 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:58.042912 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:58.044360 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49d7648-fd13-4780-86b1-93fc0afb5669 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:58.062668 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 391/766] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Sep 9 16:18:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:18:58.067418 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49d7648-fd13-4780-86b1-93fc0afb5669 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:58.079783 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b50dbfc-3505-49ba-887d-1ce0c5b3ff1a None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:58.117163 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e74f401-f56f-4550-9238-a7cc2abfa1ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:58.117975 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e74f401-f56f-4550-9238-a7cc2abfa1ad None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:58.118360 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e74f401-f56f-4550-9238-a7cc2abfa1ad None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:58.118725 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e74f401-f56f-4550-9238-a7cc2abfa1ad None admin] PATH_INFO: `/v3/projects/service` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:58.126108 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e74f401-f56f-4550-9238-a7cc2abfa1ad None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:58.127841 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e74f401-f56f-4550-9238-a7cc2abfa1ad None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:58.139819 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-4e74f401-f56f-4550-9238-a7cc2abfa1ad None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 16:18:58.139819 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:18:58.139819 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:18:58.139819 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:18:58.139819 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:18:58.139819 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:18:58.139819 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:18:58.139819 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:18:58.139819 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:18:58.139819 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:18:58.139819 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:18:58.139819 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:18:58.139819 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 16:18:58.139819 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 16:18:58.139819 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 16:18:58.140832 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 16:18:58.140832 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:18:58.140832 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:18:58.140832 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:18:58.140832 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:18:58.140832 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:18:58.140832 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:18:58.140832 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:18:58.140832 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 16:18:58.140832 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:18:58.140832 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:18:58.140832 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:18:58.140832 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:18:58.140832 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:18:58.140832 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:18:58.140832 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:18:58.140832 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:18:58.141727 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 16:18:58.141727 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 16:18:58.141727 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 16:18:58.141727 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 16:18:58.141727 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 16:18:58.141727 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 16:18:58.141727 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 16:18:58.141727 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 16:18:58.141727 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 376/767] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Sep 9 16:18:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:18:58.142972 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e74f401-f56f-4550-9238-a7cc2abfa1ad None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:58.164567 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:58.189670 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49d7648-fd13-4780-86b1-93fc0afb5669 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:58.230725 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205edcf3-fc9e-4c79-83b9-049750b3c5a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:58.231798 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205edcf3-fc9e-4c79-83b9-049750b3c5a8 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:58.232146 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205edcf3-fc9e-4c79-83b9-049750b3c5a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:58.232478 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205edcf3-fc9e-4c79-83b9-049750b3c5a8 None admin] PATH_INFO: `/v3/services/network` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:58.233138 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205edcf3-fc9e-4c79-83b9-049750b3c5a8 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:58.235197 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205edcf3-fc9e-4c79-83b9-049750b3c5a8 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:58.245061 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-205edcf3-fc9e-4c79-83b9-049750b3c5a8 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 09 16:18:58.245061 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:18:58.245061 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 16:18:58.245061 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 16:18:58.245061 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 16:18:58.245061 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 16:18:58.245061 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 16:18:58.245061 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 16:18:58.245061 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 09 16:18:58.245061 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:18:58.245061 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 16:18:58.245061 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:18:58.245061 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:18:58.245061 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:18:58.245061 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:18:58.245061 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:18:58.245061 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:18:58.246113 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:18:58.246113 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:18:58.246113 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:18:58.246113 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:18:58.246113 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:18:58.246113 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:18:58.246113 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 16:18:58.246113 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 16:18:58.246113 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 16:18:58.246113 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 16:18:58.246113 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:18:58.246113 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:18:58.246113 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:18:58.246113 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:18:58.246113 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:18:58.246113 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:18:58.247005 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:18:58.247005 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Sep 09 16:18:58.247005 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:18:58.247005 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:18:58.247005 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:18:58.247005 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:18:58.247005 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:18:58.247005 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:18:58.247005 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:18:58.247005 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:18:58.247005 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 16:18:58.247005 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 16:18:58.247005 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 09 16:18:58.247005 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:18:58.247005 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 392/768] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Sep 9 16:18:58 2022] GET /identity/v3/services/network => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:18:58.247839 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205edcf3-fc9e-4c79-83b9-049750b3c5a8 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:58.271320 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e74f401-f56f-4550-9238-a7cc2abfa1ad None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:58.312174 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb219cba-d3ce-4494-97b9-568dfda3a191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:58.312782 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb219cba-d3ce-4494-97b9-568dfda3a191 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:58.313077 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb219cba-d3ce-4494-97b9-568dfda3a191 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:58.313340 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb219cba-d3ce-4494-97b9-568dfda3a191 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:58.314050 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb219cba-d3ce-4494-97b9-568dfda3a191 None admin] RBAC: Adding query filter params (role.id=1966594501e743aebf757851d9cd82a5, scope.project.id=68d6aaafab824657b08ca91f3d46d5f8, user.id=b9d05f3782d24127aa613c8d7ac8041b) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:18:58.314384 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb219cba-d3ce-4494-97b9-568dfda3a191 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:58.315941 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb219cba-d3ce-4494-97b9-568dfda3a191 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:58.317717 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:58.322594 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 377/769] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Sep 9 16:18:58 2022] GET /identity/v3/role_assignments?user.id=b9d05f3782d24127aa613c8d7ac8041b&scope.project.id=68d6aaafab824657b08ca91f3d46d5f8&role.id=1966594501e743aebf757851d9cd82a5 => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:18:58.323608 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb219cba-d3ce-4494-97b9-568dfda3a191 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:58.371455 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205edcf3-fc9e-4c79-83b9-049750b3c5a8 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:58.412132 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20daf6e6-f784-4a96-aa2e-f2c6ea2b7dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:58.412948 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20daf6e6-f784-4a96-aa2e-f2c6ea2b7dd6 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:58.413301 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20daf6e6-f784-4a96-aa2e-f2c6ea2b7dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:58.413646 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20daf6e6-f784-4a96-aa2e-f2c6ea2b7dd6 None admin] PATH_INFO: `/v3/projects` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:58.414631 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20daf6e6-f784-4a96-aa2e-f2c6ea2b7dd6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:18:58.415013 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20daf6e6-f784-4a96-aa2e-f2c6ea2b7dd6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:58.416764 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20daf6e6-f784-4a96-aa2e-f2c6ea2b7dd6 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:58.438513 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 393/770] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Sep 9 16:18:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:18:58.441047 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20daf6e6-f784-4a96-aa2e-f2c6ea2b7dd6 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:58.447571 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:58.449408 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb219cba-d3ce-4494-97b9-568dfda3a191 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:58.491120 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453c3c1c-1951-4f51-ab0e-0754d44073a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:58.492193 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453c3c1c-1951-4f51-ab0e-0754d44073a1 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:58.492678 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453c3c1c-1951-4f51-ab0e-0754d44073a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:58.493148 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453c3c1c-1951-4f51-ab0e-0754d44073a1 None admin] PATH_INFO: `/v3/services` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:58.494077 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453c3c1c-1951-4f51-ab0e-0754d44073a1 None admin] RBAC: Adding query filter params (name=network) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:18:58.494663 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453c3c1c-1951-4f51-ab0e-0754d44073a1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:58.496366 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453c3c1c-1951-4f51-ab0e-0754d44073a1 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:58.507806 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 378/771] 10.222.0.27 () {56 vars in 1112 bytes} [Fri Sep 9 16:18:58 2022] GET /identity/v3/services?name=network => generated 124 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:18:58.509240 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453c3c1c-1951-4f51-ab0e-0754d44073a1 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:58.569741 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20daf6e6-f784-4a96-aa2e-f2c6ea2b7dd6 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:58.582896 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:58.604239 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59da90dd-5c0f-459e-b037-ebd30edc8c48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:58.604858 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59da90dd-5c0f-459e-b037-ebd30edc8c48 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:58.605132 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59da90dd-5c0f-459e-b037-ebd30edc8c48 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:58.605396 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59da90dd-5c0f-459e-b037-ebd30edc8c48 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:58.605959 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59da90dd-5c0f-459e-b037-ebd30edc8c48 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:58.607347 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59da90dd-5c0f-459e-b037-ebd30edc8c48 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:58.616601 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-59da90dd-5c0f-459e-b037-ebd30edc8c48 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 09 16:18:58.616601 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:18:58.616601 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 16:18:58.616601 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 16:18:58.616601 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 16:18:58.616601 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 16:18:58.616601 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 16:18:58.616601 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 16:18:58.616601 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 09 16:18:58.616601 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:18:58.616601 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 16:18:58.616601 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:18:58.616601 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:18:58.616601 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:18:58.616601 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:18:58.616601 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:18:58.616601 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:18:58.617634 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:18:58.617634 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:18:58.617634 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:18:58.617634 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:18:58.617634 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:18:58.617634 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:18:58.617634 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 16:18:58.617634 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 16:18:58.617634 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 16:18:58.617634 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 16:18:58.617634 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:18:58.617634 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:18:58.617634 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:18:58.617634 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:18:58.617634 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:18:58.617634 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:18:58.619096 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:18:58.619096 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Sep 09 16:18:58.619096 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:18:58.619096 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:18:58.619096 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:18:58.619096 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:18:58.619096 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:18:58.619096 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:18:58.619096 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:18:58.619096 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:18:58.619096 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 16:18:58.619096 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 16:18:58.619096 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 09 16:18:58.619096 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:18:58.619096 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 394/772] 10.222.0.27 () {56 vars in 1129 bytes} [Fri Sep 9 16:18:58 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:18:58.619899 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59da90dd-5c0f-459e-b037-ebd30edc8c48 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:58.630442 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453c3c1c-1951-4f51-ab0e-0754d44073a1 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:58.669287 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315a36b6-6b03-4e07-ae41-01044a185cdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:58.669941 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315a36b6-6b03-4e07-ae41-01044a185cdc None admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:58.670196 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315a36b6-6b03-4e07-ae41-01044a185cdc None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:58.670794 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315a36b6-6b03-4e07-ae41-01044a185cdc None admin] PATH_INFO: `/v3/projects/68d6aaafab824657b08ca91f3d46d5f8/users/a332b9b4980646a3b14633293f77b505/roles/0a36d1be416f4089be19be979943b731` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:58.672718 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315a36b6-6b03-4e07-ae41-01044a185cdc None admin] RBAC: Authorizing `identity:create_grant(project_id=68d6aaafab824657b08ca91f3d46d5f8, user_id=a332b9b4980646a3b14633293f77b505, role_id=0a36d1be416f4089be19be979943b731)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:58.674686 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315a36b6-6b03-4e07-ae41-01044a185cdc None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:58.687580 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 379/773] 10.222.0.27 () {58 vars in 1439 bytes} [Fri Sep 9 16:18:58 2022] PUT /identity/v3/projects/68d6aaafab824657b08ca91f3d46d5f8/users/a332b9b4980646a3b14633293f77b505/roles/0a36d1be416f4089be19be979943b731 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:18:58.688841 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ddca0f-4bda-4934-bdc9-be05f4f53460 None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:58.689121 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ddca0f-4bda-4934-bdc9-be05f4f53460 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:58.689385 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ddca0f-4bda-4934-bdc9-be05f4f53460 None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:58.691470 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 380/774] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:18:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:18:58.695332 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ddca0f-4bda-4934-bdc9-be05f4f53460 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:58.709752 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:58.755464 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59da90dd-5c0f-459e-b037-ebd30edc8c48 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:58.804209 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9679796-2f46-4514-a9e4-508cca864101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:58.805218 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9679796-2f46-4514-a9e4-508cca864101 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:58.805575 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9679796-2f46-4514-a9e4-508cca864101 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:58.805853 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9679796-2f46-4514-a9e4-508cca864101 None admin] PATH_INFO: `/v3/services` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:58.806521 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9679796-2f46-4514-a9e4-508cca864101 None admin] RBAC: Adding query filter params (type=network) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:18:58.806824 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9679796-2f46-4514-a9e4-508cca864101 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:58.808230 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9679796-2f46-4514-a9e4-508cca864101 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:58.815921 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 395/775] 10.222.0.27 () {56 vars in 1112 bytes} [Fri Sep 9 16:18:58 2022] GET /identity/v3/services?type=network => generated 350 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:18:58.817326 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0760181f-6f07-43a5-9c0b-d80935a0ac6d None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:58.817614 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0760181f-6f07-43a5-9c0b-d80935a0ac6d None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:58.817889 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0760181f-6f07-43a5-9c0b-d80935a0ac6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:58.840975 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-0760181f-6f07-43a5-9c0b-d80935a0ac6d None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:18:58.842530 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-0760181f-6f07-43a5-9c0b-d80935a0ac6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:18:58.845128 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ddca0f-4bda-4934-bdc9-be05f4f53460 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:58.881085 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:58.901227 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8da6ad-a2eb-46ee-8856-65de0c5d42d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:58.901850 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8da6ad-a2eb-46ee-8856-65de0c5d42d1 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:58.902128 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8da6ad-a2eb-46ee-8856-65de0c5d42d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:58.902468 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8da6ad-a2eb-46ee-8856-65de0c5d42d1 None admin] PATH_INFO: `/v3/services` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:58.903062 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8da6ad-a2eb-46ee-8856-65de0c5d42d1 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:18:58.903363 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8da6ad-a2eb-46ee-8856-65de0c5d42d1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:58.904742 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8da6ad-a2eb-46ee-8856-65de0c5d42d1 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:58.910630 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 381/776] 10.222.0.27 () {56 vars in 1124 bytes} [Fri Sep 9 16:18:58 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:18:58.911443 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8da6ad-a2eb-46ee-8856-65de0c5d42d1 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:58.928451 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 396/777] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:18:58 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 16:18:58.929317 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0760181f-6f07-43a5-9c0b-d80935a0ac6d None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:59.007070 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:59.034083 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8da6ad-a2eb-46ee-8856-65de0c5d42d1 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:59.055375 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0760181f-6f07-43a5-9c0b-d80935a0ac6d None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:59.070880 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b106ba53-6db6-440d-9cc6-5acbdf4a2575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:59.071950 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b106ba53-6db6-440d-9cc6-5acbdf4a2575 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:59.072778 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b106ba53-6db6-440d-9cc6-5acbdf4a2575 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:59.073580 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b106ba53-6db6-440d-9cc6-5acbdf4a2575 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:59.074535 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b106ba53-6db6-440d-9cc6-5acbdf4a2575 None admin] RBAC: Adding query filter params (interface=public, service_id=bf39696c3dce4571a4e6dc529e858b73, region_id=RegionOne) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:18:59.075172 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b106ba53-6db6-440d-9cc6-5acbdf4a2575 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:59.077077 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b106ba53-6db6-440d-9cc6-5acbdf4a2575 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:59.087882 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 382/778] 10.222.0.27 () {56 vars in 1251 bytes} [Fri Sep 9 16:18:58 2022] GET /identity/v3/endpoints?service_id=bf39696c3dce4571a4e6dc529e858b73&interface=public®ion_id=RegionOne => generated 194 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:18:59.094504 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b106ba53-6db6-440d-9cc6-5acbdf4a2575 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:59.104047 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec88353-a294-42e0-8adf-b0902f2d3aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:59.104711 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec88353-a294-42e0-8adf-b0902f2d3aee None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:59.104984 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec88353-a294-42e0-8adf-b0902f2d3aee None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:59.105253 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec88353-a294-42e0-8adf-b0902f2d3aee None admin] PATH_INFO: `/v3/services` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:59.105930 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec88353-a294-42e0-8adf-b0902f2d3aee None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:18:59.106232 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec88353-a294-42e0-8adf-b0902f2d3aee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:59.107686 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec88353-a294-42e0-8adf-b0902f2d3aee None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:59.118352 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 397/779] 10.222.0.27 () {56 vars in 1124 bytes} [Fri Sep 9 16:18:58 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:18:59.123912 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec88353-a294-42e0-8adf-b0902f2d3aee None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:59.196194 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:59.267171 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b106ba53-6db6-440d-9cc6-5acbdf4a2575 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:59.310025 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ece9193-a1f7-405b-a82c-7176a53e2ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:59.311059 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ece9193-a1f7-405b-a82c-7176a53e2ee5 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:59.311531 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ece9193-a1f7-405b-a82c-7176a53e2ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:59.312243 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ece9193-a1f7-405b-a82c-7176a53e2ee5 None admin] PATH_INFO: `/v3/services` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:59.313319 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ece9193-a1f7-405b-a82c-7176a53e2ee5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:59.314868 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec88353-a294-42e0-8adf-b0902f2d3aee None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:59.315079 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ece9193-a1f7-405b-a82c-7176a53e2ee5 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:59.321680 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 383/780] 10.222.0.27 () {56 vars in 1087 bytes} [Fri Sep 9 16:18:59 2022] GET /identity/v3/services => generated 772 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 16:18:59.323164 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ece9193-a1f7-405b-a82c-7176a53e2ee5 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:59.347867 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:59.366328 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1947532b-77e2-439a-93c3-ff2dd7c740ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:59.367848 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1947532b-77e2-439a-93c3-ff2dd7c740ef None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:59.368308 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1947532b-77e2-439a-93c3-ff2dd7c740ef None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:59.368737 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1947532b-77e2-439a-93c3-ff2dd7c740ef None admin] PATH_INFO: `/v3/endpoints` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:59.369622 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1947532b-77e2-439a-93c3-ff2dd7c740ef None admin] RBAC: Adding query filter params (interface=public, service_id=049de000b7734114b3f820070eb3be06, region_id=RegionOne) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:18:59.370078 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1947532b-77e2-439a-93c3-ff2dd7c740ef None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:59.371861 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1947532b-77e2-439a-93c3-ff2dd7c740ef None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:59.381368 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 398/781] 10.222.0.27 () {56 vars in 1251 bytes} [Fri Sep 9 16:18:59 2022] GET /identity/v3/endpoints?service_id=049de000b7734114b3f820070eb3be06&interface=public®ion_id=RegionOne => generated 194 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 16:18:59.387166 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1947532b-77e2-439a-93c3-ff2dd7c740ef None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:59.555658 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ece9193-a1f7-405b-a82c-7176a53e2ee5 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:59.574967 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:59.590264 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1947532b-77e2-439a-93c3-ff2dd7c740ef None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:59.599735 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab2c117-85ad-46c3-bc24-236393122353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:59.600720 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab2c117-85ad-46c3-bc24-236393122353 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:59.601221 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab2c117-85ad-46c3-bc24-236393122353 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:59.601696 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab2c117-85ad-46c3-bc24-236393122353 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:59.614686 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab2c117-85ad-46c3-bc24-236393122353 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 16:18:59.621574 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-bab2c117-85ad-46c3-bc24-236393122353 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 16:18:59.621574 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:18:59.621574 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:18:59.621574 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:18:59.621574 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:18:59.621574 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:18:59.621574 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:18:59.621574 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:18:59.621574 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:18:59.621574 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:18:59.621574 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:18:59.621574 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:18:59.621574 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 16:18:59.621574 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 16:18:59.621574 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 16:18:59.621574 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 16:18:59.622558 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 16:18:59.622558 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 16:18:59.622558 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 16:18:59.622558 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 16:18:59.622558 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:18:59.622558 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:18:59.622558 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:18:59.622558 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:18:59.622558 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:18:59.622558 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:18:59.622558 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:18:59.622558 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 16:18:59.622558 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:18:59.622558 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:18:59.622558 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:18:59.622558 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:18:59.623386 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:18:59.623386 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:18:59.623386 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:18:59.623386 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:18:59.623386 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 16:18:59.623386 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 16:18:59.623386 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 16:18:59.623386 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 16:18:59.623386 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 16:18:59.623386 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 16:18:59.623386 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 16:18:59.623386 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 16:18:59.626015 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 384/782] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Sep 9 16:18:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:18:59.629702 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff45814-851f-4cf8-98f8-1970704e1ebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:59.630651 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff45814-851f-4cf8-98f8-1970704e1ebc None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:59.631702 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab2c117-85ad-46c3-bc24-236393122353 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:59.634719 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff45814-851f-4cf8-98f8-1970704e1ebc None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:59.635002 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff45814-851f-4cf8-98f8-1970704e1ebc None admin] PATH_INFO: `/v3/services` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:59.635627 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff45814-851f-4cf8-98f8-1970704e1ebc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:59.637008 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff45814-851f-4cf8-98f8-1970704e1ebc None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:59.646627 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 399/783] 10.222.0.27 () {56 vars in 1087 bytes} [Fri Sep 9 16:18:59 2022] GET /identity/v3/services => generated 772 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:18:59.789294 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab2c117-85ad-46c3-bc24-236393122353 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:18:59.840933 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2351c5-1d07-4b56-baee-b07161a59e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:18:59.841523 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2351c5-1d07-4b56-baee-b07161a59e0d None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:18:59.841806 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2351c5-1d07-4b56-baee-b07161a59e0d None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:18:59.842087 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2351c5-1d07-4b56-baee-b07161a59e0d None admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:18:59.842789 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2351c5-1d07-4b56-baee-b07161a59e0d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:18:59.843089 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2351c5-1d07-4b56-baee-b07161a59e0d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:18:59.844491 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2351c5-1d07-4b56-baee-b07161a59e0d None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:18:59.858919 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 385/784] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Sep 9 16:18:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:18:59.868009 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff45814-851f-4cf8-98f8-1970704e1ebc None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:18:59.947207 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:18:59.994943 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff45814-851f-4cf8-98f8-1970704e1ebc None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:00.031424 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a133295f-2016-40ff-9399-87226472a52d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:00.032768 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a133295f-2016-40ff-9399-87226472a52d None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:00.033274 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a133295f-2016-40ff-9399-87226472a52d None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:00.034199 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a133295f-2016-40ff-9399-87226472a52d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:00.045469 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a133295f-2016-40ff-9399-87226472a52d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:00.047161 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a133295f-2016-40ff-9399-87226472a52d None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:00.062111 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-a133295f-2016-40ff-9399-87226472a52d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 16:19:00.062111 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:19:00.062111 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:19:00.062111 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:19:00.062111 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:19:00.062111 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:19:00.062111 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:19:00.062111 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:19:00.062111 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:19:00.062111 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:19:00.062111 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:19:00.062111 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:19:00.062111 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 16:19:00.062111 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 16:19:00.062111 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 16:19:00.062111 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 16:19:00.063099 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:19:00.063099 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:19:00.063099 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:19:00.063099 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:19:00.063099 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:19:00.063099 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:19:00.063099 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:19:00.063099 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Sep 09 16:19:00.063099 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:19:00.063099 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:19:00.063099 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:19:00.063099 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:19:00.063099 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:19:00.063099 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:19:00.063099 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:19:00.063099 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:19:00.063099 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 16:19:00.063984 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 16:19:00.063984 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 16:19:00.063984 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:19:00.070752 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 400/785] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 16:18:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:19:00.073452 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2351c5-1d07-4b56-baee-b07161a59e0d None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:00.111042 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:00.209432 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2351c5-1d07-4b56-baee-b07161a59e0d None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:00.270469 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ac114b-2ffc-4ce5-b307-a67385e0d607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:00.271397 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ac114b-2ffc-4ce5-b307-a67385e0d607 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:00.271847 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ac114b-2ffc-4ce5-b307-a67385e0d607 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:00.272260 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ac114b-2ffc-4ce5-b307-a67385e0d607 None admin] PATH_INFO: `/v3/domains` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:00.273039 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ac114b-2ffc-4ce5-b307-a67385e0d607 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:19:00.273479 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ac114b-2ffc-4ce5-b307-a67385e0d607 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:00.275139 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ac114b-2ffc-4ce5-b307-a67385e0d607 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:00.292459 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 386/786] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Sep 9 16:19:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:19:00.293825 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a133295f-2016-40ff-9399-87226472a52d None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:00.436330 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a133295f-2016-40ff-9399-87226472a52d None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:00.444678 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:00.484997 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4848de50-2e7e-4d70-922a-22d4c5bd4a39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:00.485630 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4848de50-2e7e-4d70-922a-22d4c5bd4a39 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:00.485905 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4848de50-2e7e-4d70-922a-22d4c5bd4a39 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:00.486180 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4848de50-2e7e-4d70-922a-22d4c5bd4a39 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:00.493928 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4848de50-2e7e-4d70-922a-22d4c5bd4a39 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:00.495423 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4848de50-2e7e-4d70-922a-22d4c5bd4a39 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:00.514408 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-4848de50-2e7e-4d70-922a-22d4c5bd4a39 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 09 16:19:00.514408 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:19:00.514408 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:19:00.514408 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:19:00.514408 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:19:00.514408 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:19:00.514408 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:19:00.514408 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:19:00.514408 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:19:00.514408 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:19:00.514408 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:19:00.514408 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:19:00.514408 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 16:19:00.514408 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 16:19:00.514408 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 16:19:00.514408 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 16:19:00.515406 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:19:00.515406 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:19:00.515406 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 16:19:00.515406 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 16:19:00.515406 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 16:19:00.515406 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 16:19:00.515406 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:19:00.515406 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:19:00.515406 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:19:00.515406 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:19:00.515406 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:19:00.515406 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Sep 09 16:19:00.515406 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:19:00.515406 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:19:00.515406 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:19:00.515406 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:19:00.515406 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:19:00.515406 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:19:00.516359 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:19:00.516359 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:19:00.516359 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 16:19:00.516359 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 16:19:00.516359 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 16:19:00.516359 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 16:19:00.516359 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 16:19:00.516359 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 16:19:00.516359 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 09 16:19:00.516359 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:19:00.516919 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 401/787] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Sep 9 16:19:00 2022] GET /identity/v3/users/swift => generated 83 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:19:00.522994 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ac114b-2ffc-4ce5-b307-a67385e0d607 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:00.654877 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:00.660788 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ac114b-2ffc-4ce5-b307-a67385e0d607 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:00.692028 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eea74a1-868e-4d8e-bf1a-495b7a080158 None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:00.692329 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eea74a1-868e-4d8e-bf1a-495b7a080158 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:00.692496 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eea74a1-868e-4d8e-bf1a-495b7a080158 None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:00.693773 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 402/788] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:19:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 16:19:00.698640 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1a007c-a27c-46af-ae4a-879e00110c5b None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:00.698917 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1a007c-a27c-46af-ae4a-879e00110c5b None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:00.699184 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1a007c-a27c-46af-ae4a-879e00110c5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:00.701284 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dab8da1-60df-4409-8408-e0cd3f61de2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:00.701970 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dab8da1-60df-4409-8408-e0cd3f61de2d None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:00.702252 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dab8da1-60df-4409-8408-e0cd3f61de2d None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:00.702554 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dab8da1-60df-4409-8408-e0cd3f61de2d None admin] PATH_INFO: `/v3/users` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:00.703269 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dab8da1-60df-4409-8408-e0cd3f61de2d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:19:00.703567 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dab8da1-60df-4409-8408-e0cd3f61de2d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:00.704979 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dab8da1-60df-4409-8408-e0cd3f61de2d None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:00.723204 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 387/789] 10.222.0.27 () {56 vars in 1135 bytes} [Fri Sep 9 16:19:00 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:19:00.728677 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dab8da1-60df-4409-8408-e0cd3f61de2d None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:00.731503 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-8a1a007c-a27c-46af-ae4a-879e00110c5b None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:19:00.733042 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-8a1a007c-a27c-46af-ae4a-879e00110c5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:19:00.842244 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 403/790] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:19:00 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 16:19:00.876464 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dab8da1-60df-4409-8408-e0cd3f61de2d None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:00.924713 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40344a04-81b6-4b27-b248-fa0b89ba472a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:00.925708 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40344a04-81b6-4b27-b248-fa0b89ba472a None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:00.926115 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40344a04-81b6-4b27-b248-fa0b89ba472a None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:00.926619 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40344a04-81b6-4b27-b248-fa0b89ba472a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:00.943028 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40344a04-81b6-4b27-b248-fa0b89ba472a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:00.944422 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40344a04-81b6-4b27-b248-fa0b89ba472a None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:00.959332 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-40344a04-81b6-4b27-b248-fa0b89ba472a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 16:19:00.959332 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:19:00.959332 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:19:00.959332 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:19:00.959332 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:19:00.959332 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:19:00.959332 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:19:00.959332 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:19:00.959332 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:19:00.959332 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:19:00.959332 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:19:00.959332 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:19:00.959332 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 16:19:00.959332 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 16:19:00.959332 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 16:19:00.959332 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 16:19:00.961508 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:19:00.961508 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:19:00.961508 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:19:00.961508 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:19:00.961508 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:19:00.961508 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:19:00.961508 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:19:00.961508 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 16:19:00.961508 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:19:00.961508 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:19:00.961508 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:19:00.961508 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:19:00.961508 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:19:00.961508 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:19:00.961508 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:19:00.961508 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:19:00.961508 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 16:19:00.963649 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 16:19:00.963649 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 16:19:00.963649 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 16:19:00.963649 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 388/791] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 16:19:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:19:00.966256 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1a007c-a27c-46af-ae4a-879e00110c5b None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:01.082654 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:01.085451 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1a007c-a27c-46af-ae4a-879e00110c5b None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:01.120943 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311b8b2b-1879-453b-b024-757f12d91cad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:01.121599 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311b8b2b-1879-453b-b024-757f12d91cad None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:01.121877 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311b8b2b-1879-453b-b024-757f12d91cad None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:01.122145 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311b8b2b-1879-453b-b024-757f12d91cad None admin] PATH_INFO: `/v3/domains` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:01.122798 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311b8b2b-1879-453b-b024-757f12d91cad None admin] RBAC: Adding query filter params (name=Default) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:19:01.123093 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311b8b2b-1879-453b-b024-757f12d91cad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:01.124456 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311b8b2b-1879-453b-b024-757f12d91cad None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:01.136143 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 404/792] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Sep 9 16:19:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:19:01.143998 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40344a04-81b6-4b27-b248-fa0b89ba472a None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:01.154488 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:01.170021 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311b8b2b-1879-453b-b024-757f12d91cad None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:01.282337 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40344a04-81b6-4b27-b248-fa0b89ba472a None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:01.319116 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262954b6-8773-49cb-8636-91f4daa9d066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:01.319891 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262954b6-8773-49cb-8636-91f4daa9d066 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:01.320284 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262954b6-8773-49cb-8636-91f4daa9d066 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:01.320649 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262954b6-8773-49cb-8636-91f4daa9d066 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:01.330520 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262954b6-8773-49cb-8636-91f4daa9d066 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:01.331968 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262954b6-8773-49cb-8636-91f4daa9d066 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:01.351244 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-262954b6-8773-49cb-8636-91f4daa9d066 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 16:19:01.351244 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:19:01.351244 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:19:01.351244 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:19:01.351244 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:19:01.351244 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:19:01.351244 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:19:01.351244 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:19:01.351244 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:19:01.351244 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:19:01.351244 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:19:01.351244 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:19:01.351244 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 16:19:01.351244 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 16:19:01.351244 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 16:19:01.352208 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 16:19:01.352208 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:19:01.352208 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:19:01.352208 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:19:01.352208 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:19:01.352208 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:19:01.352208 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:19:01.352208 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:19:01.352208 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 16:19:01.352208 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:19:01.352208 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:19:01.352208 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:19:01.352208 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:19:01.352208 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:19:01.352208 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:19:01.352208 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:19:01.352208 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:19:01.353103 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 16:19:01.353103 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 16:19:01.353103 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 16:19:01.353103 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 16:19:01.353103 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 16:19:01.353103 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 16:19:01.353103 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 16:19:01.353103 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 16:19:01.358634 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 389/793] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Sep 9 16:19:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:19:01.364031 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262954b6-8773-49cb-8636-91f4daa9d066 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:01.387885 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311b8b2b-1879-453b-b024-757f12d91cad None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:01.429684 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61c63b0-12bf-4e79-a096-286924edb8ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:01.430357 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61c63b0-12bf-4e79-a096-286924edb8ec None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:01.430649 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61c63b0-12bf-4e79-a096-286924edb8ec None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:01.430908 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61c63b0-12bf-4e79-a096-286924edb8ec None admin] PATH_INFO: `/v3/roles/service` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:01.447246 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:01.447437 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61c63b0-12bf-4e79-a096-286924edb8ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 16:19:01.458258 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-e61c63b0-12bf-4e79-a096-286924edb8ec None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 16:19:01.458258 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:19:01.458258 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:19:01.458258 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:19:01.458258 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:19:01.458258 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:19:01.458258 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:19:01.458258 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:19:01.458258 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:19:01.458258 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:19:01.458258 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:19:01.458258 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:19:01.458258 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 16:19:01.458258 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 16:19:01.458258 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 16:19:01.458258 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 16:19:01.459421 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 16:19:01.459421 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 16:19:01.459421 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 16:19:01.459421 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 16:19:01.459421 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:19:01.459421 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:19:01.459421 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:19:01.459421 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:19:01.459421 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:19:01.459421 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:19:01.459421 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:19:01.459421 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Sep 09 16:19:01.459421 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:19:01.459421 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:19:01.459421 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:19:01.459421 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:19:01.460286 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:19:01.460286 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:19:01.460286 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:19:01.460286 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:19:01.460286 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 16:19:01.460286 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 16:19:01.460286 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 16:19:01.460286 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 16:19:01.460286 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 16:19:01.460286 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 16:19:01.460286 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 16:19:01.460286 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:19:01.460286 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 405/794] 10.222.0.27 () {56 vars in 1102 bytes} [Fri Sep 9 16:19:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:19:01.461348 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f088076-9b70-40f3-846d-36dd599b03f3 None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:01.461664 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f088076-9b70-40f3-846d-36dd599b03f3 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:01.461935 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f088076-9b70-40f3-846d-36dd599b03f3 None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:01.464140 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 406/795] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:19:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:19:01.467494 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f088076-9b70-40f3-846d-36dd599b03f3 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:01.489420 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:01.492136 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262954b6-8773-49cb-8636-91f4daa9d066 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:01.527856 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aadb208-8d29-45cc-9066-fbd4dfe0ad25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:01.528806 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aadb208-8d29-45cc-9066-fbd4dfe0ad25 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:01.529450 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aadb208-8d29-45cc-9066-fbd4dfe0ad25 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:01.529929 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aadb208-8d29-45cc-9066-fbd4dfe0ad25 None admin] PATH_INFO: `/v3/projects` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:01.530843 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aadb208-8d29-45cc-9066-fbd4dfe0ad25 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:19:01.531368 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aadb208-8d29-45cc-9066-fbd4dfe0ad25 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:01.533059 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aadb208-8d29-45cc-9066-fbd4dfe0ad25 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:01.546163 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 390/796] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Sep 9 16:19:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:19:01.552304 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051fd63f-95fb-4644-b6fc-d6574c7a28ed None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:01.552938 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051fd63f-95fb-4644-b6fc-d6574c7a28ed None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:01.553439 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051fd63f-95fb-4644-b6fc-d6574c7a28ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:01.571906 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-051fd63f-95fb-4644-b6fc-d6574c7a28ed None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:19:01.573466 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-051fd63f-95fb-4644-b6fc-d6574c7a28ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:19:01.580927 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f088076-9b70-40f3-846d-36dd599b03f3 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:01.616764 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d91b0a-b615-4e0b-b34f-6842bf21ff4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:01.617392 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d91b0a-b615-4e0b-b34f-6842bf21ff4d None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:01.617668 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d91b0a-b615-4e0b-b34f-6842bf21ff4d None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:01.617936 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d91b0a-b615-4e0b-b34f-6842bf21ff4d None admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:01.618605 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d91b0a-b615-4e0b-b34f-6842bf21ff4d None admin] RBAC: Adding query filter params (name=service) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:19:01.618902 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d91b0a-b615-4e0b-b34f-6842bf21ff4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:01.620413 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d91b0a-b615-4e0b-b34f-6842bf21ff4d None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:01.629711 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 407/797] 10.222.0.27 () {56 vars in 1103 bytes} [Fri Sep 9 16:19:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:19:01.630587 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d91b0a-b615-4e0b-b34f-6842bf21ff4d None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:01.646719 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 391/798] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:19:01 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 16:19:01.647911 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051fd63f-95fb-4644-b6fc-d6574c7a28ed None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:01.708421 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:01.759110 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051fd63f-95fb-4644-b6fc-d6574c7a28ed None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:01.777779 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:01.817898 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d91b0a-b615-4e0b-b34f-6842bf21ff4d None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:01.827575 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3367c04c-04d0-425a-a710-28fc0c48b5ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:01.828283 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3367c04c-04d0-425a-a710-28fc0c48b5ee None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:01.828489 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3367c04c-04d0-425a-a710-28fc0c48b5ee None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:01.828752 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3367c04c-04d0-425a-a710-28fc0c48b5ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:01.851716 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3367c04c-04d0-425a-a710-28fc0c48b5ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:01.853306 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3367c04c-04d0-425a-a710-28fc0c48b5ee None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:01.854877 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1662a5d6-877e-49e7-ad2a-8ae69edf5cec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:01.855942 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1662a5d6-877e-49e7-ad2a-8ae69edf5cec None admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:01.856478 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1662a5d6-877e-49e7-ad2a-8ae69edf5cec None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:01.856953 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1662a5d6-877e-49e7-ad2a-8ae69edf5cec None admin] PATH_INFO: `/v3/projects/68d6aaafab824657b08ca91f3d46d5f8/users/a2350bbc4a194c2dab2e3be830fd0eba/roles/0a36d1be416f4089be19be979943b731` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:01.859469 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1662a5d6-877e-49e7-ad2a-8ae69edf5cec None admin] RBAC: Authorizing `identity:create_grant(project_id=68d6aaafab824657b08ca91f3d46d5f8, user_id=a2350bbc4a194c2dab2e3be830fd0eba, role_id=0a36d1be416f4089be19be979943b731)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:01.861224 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1662a5d6-877e-49e7-ad2a-8ae69edf5cec None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:01.880430 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-3367c04c-04d0-425a-a710-28fc0c48b5ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 16:19:01.880430 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:19:01.880430 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:19:01.880430 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:19:01.880430 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:19:01.880430 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:19:01.880430 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:19:01.880430 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:19:01.880430 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:19:01.880430 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:19:01.880430 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:19:01.880430 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:19:01.880430 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 16:19:01.880430 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 16:19:01.880430 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 16:19:01.880430 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 16:19:01.881742 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:19:01.881742 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:19:01.881742 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:19:01.881742 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:19:01.881742 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:19:01.881742 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:19:01.881742 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:19:01.881742 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 16:19:01.881742 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:19:01.881742 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:19:01.881742 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:19:01.881742 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:19:01.881742 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:19:01.881742 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:19:01.881742 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:19:01.881742 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:19:01.881742 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 16:19:01.882750 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 16:19:01.882750 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 16:19:01.882750 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 16:19:01.885423 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 408/799] 10.222.0.27 () {58 vars in 1439 bytes} [Fri Sep 9 16:19:01 2022] PUT /identity/v3/projects/68d6aaafab824657b08ca91f3d46d5f8/users/a2350bbc4a194c2dab2e3be830fd0eba/roles/0a36d1be416f4089be19be979943b731 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:19:01.887240 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 392/800] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 16:19:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:19:01.896374 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1662a5d6-877e-49e7-ad2a-8ae69edf5cec None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:02.005977 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3367c04c-04d0-425a-a710-28fc0c48b5ee None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:02.054868 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1662a5d6-877e-49e7-ad2a-8ae69edf5cec None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:02.096851 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8ebdb9-e489-49de-b1eb-eebe795aa2ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:02.097478 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8ebdb9-e489-49de-b1eb-eebe795aa2ee None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:02.097717 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8ebdb9-e489-49de-b1eb-eebe795aa2ee None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:02.097913 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8ebdb9-e489-49de-b1eb-eebe795aa2ee None admin] PATH_INFO: `/v3/domains` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:02.098595 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8ebdb9-e489-49de-b1eb-eebe795aa2ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:19:02.098895 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8ebdb9-e489-49de-b1eb-eebe795aa2ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:02.101008 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8ebdb9-e489-49de-b1eb-eebe795aa2ee None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:02.118654 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:02.129256 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 409/801] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Sep 9 16:19:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:19:02.135037 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8ebdb9-e489-49de-b1eb-eebe795aa2ee None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:02.199959 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3367c04c-04d0-425a-a710-28fc0c48b5ee None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:02.214255 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:02.257908 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617d6a9a-20b3-4097-afd2-bb545c07377a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:02.258569 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617d6a9a-20b3-4097-afd2-bb545c07377a None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:02.258847 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617d6a9a-20b3-4097-afd2-bb545c07377a None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:02.259113 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617d6a9a-20b3-4097-afd2-bb545c07377a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:02.287963 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617d6a9a-20b3-4097-afd2-bb545c07377a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 16:19:02.294740 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-617d6a9a-20b3-4097-afd2-bb545c07377a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 16:19:02.294740 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:19:02.294740 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:19:02.294740 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:19:02.294740 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:19:02.294740 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:19:02.294740 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:19:02.294740 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:19:02.294740 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:19:02.294740 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:19:02.294740 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:19:02.294740 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:19:02.294740 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 16:19:02.294740 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 16:19:02.294740 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 16:19:02.294740 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 16:19:02.295687 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 16:19:02.295687 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 16:19:02.295687 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 16:19:02.295687 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 16:19:02.295687 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:19:02.295687 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:19:02.295687 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:19:02.295687 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:19:02.295687 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:19:02.295687 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:19:02.295687 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:19:02.295687 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 16:19:02.295687 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:19:02.295687 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:19:02.295687 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:19:02.295687 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:19:02.296561 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:19:02.296561 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:19:02.296561 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:19:02.296561 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:19:02.296561 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 16:19:02.296561 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 16:19:02.296561 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 16:19:02.296561 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 16:19:02.296561 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 16:19:02.296561 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 16:19:02.296561 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 16:19:02.296561 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 16:19:02.300442 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 393/802] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Sep 9 16:19:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 16:19:02.304394 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617d6a9a-20b3-4097-afd2-bb545c07377a None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:02.316872 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8ebdb9-e489-49de-b1eb-eebe795aa2ee None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:02.361259 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad8e0e9-9569-4217-bebb-2fbed9e59d59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:02.362763 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad8e0e9-9569-4217-bebb-2fbed9e59d59 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:02.363239 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad8e0e9-9569-4217-bebb-2fbed9e59d59 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:02.363722 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad8e0e9-9569-4217-bebb-2fbed9e59d59 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:02.373441 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad8e0e9-9569-4217-bebb-2fbed9e59d59 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:02.375272 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad8e0e9-9569-4217-bebb-2fbed9e59d59 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:02.387506 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-2ad8e0e9-9569-4217-bebb-2fbed9e59d59 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 09 16:19:02.387506 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:19:02.387506 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:19:02.387506 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:19:02.387506 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:19:02.387506 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:19:02.387506 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:19:02.387506 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:19:02.387506 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:19:02.387506 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:19:02.387506 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:19:02.387506 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:19:02.387506 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 16:19:02.387506 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 16:19:02.387506 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 16:19:02.387506 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 16:19:02.388476 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:19:02.388476 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:19:02.388476 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 16:19:02.388476 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 16:19:02.388476 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 16:19:02.388476 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 16:19:02.388476 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:19:02.388476 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:19:02.388476 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:19:02.388476 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:19:02.388476 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:19:02.388476 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Sep 09 16:19:02.388476 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:19:02.388476 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:19:02.388476 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:19:02.388476 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:19:02.388476 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:19:02.388476 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:19:02.389448 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:19:02.389448 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:19:02.389448 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 16:19:02.389448 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 16:19:02.389448 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 16:19:02.389448 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 16:19:02.389448 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 16:19:02.389448 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 16:19:02.389448 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 09 16:19:02.389448 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:19:02.392059 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 410/803] 10.222.0.27 () {56 vars in 1117 bytes} [Fri Sep 9 16:19:02 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:19:02.393530 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676596ed-0da4-4b95-8a6c-c75e36d6b401 None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:02.394021 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676596ed-0da4-4b95-8a6c-c75e36d6b401 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:02.394507 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676596ed-0da4-4b95-8a6c-c75e36d6b401 None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:02.400206 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 411/804] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:19:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:19:02.401316 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676596ed-0da4-4b95-8a6c-c75e36d6b401 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:02.433130 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617d6a9a-20b3-4097-afd2-bb545c07377a None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:02.475561 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:02.485385 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e300ed-09f0-4aae-ae40-c09fc7ba7faa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:02.486652 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e300ed-09f0-4aae-ae40-c09fc7ba7faa None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:02.486932 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e300ed-09f0-4aae-ae40-c09fc7ba7faa None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:02.487203 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e300ed-09f0-4aae-ae40-c09fc7ba7faa None admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:02.487862 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e300ed-09f0-4aae-ae40-c09fc7ba7faa None admin] RBAC: Adding query filter params (name=admin) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:19:02.488164 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e300ed-09f0-4aae-ae40-c09fc7ba7faa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:02.489860 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e300ed-09f0-4aae-ae40-c09fc7ba7faa None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:02.499482 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 394/805] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Sep 9 16:19:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:19:02.501050 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783d78f5-f969-49ba-95a4-e17ec92b81db None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:02.501528 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783d78f5-f969-49ba-95a4-e17ec92b81db None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:02.502571 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783d78f5-f969-49ba-95a4-e17ec92b81db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:02.522175 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-783d78f5-f969-49ba-95a4-e17ec92b81db None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:19:02.523732 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-783d78f5-f969-49ba-95a4-e17ec92b81db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:19:02.535001 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676596ed-0da4-4b95-8a6c-c75e36d6b401 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:02.548789 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:02.575511 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da563bbe-0925-419e-8f72-723266176d42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:02.576121 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da563bbe-0925-419e-8f72-723266176d42 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:02.576399 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da563bbe-0925-419e-8f72-723266176d42 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:02.576724 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da563bbe-0925-419e-8f72-723266176d42 None admin] PATH_INFO: `/v3/users` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:02.577444 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da563bbe-0925-419e-8f72-723266176d42 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:19:02.577743 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da563bbe-0925-419e-8f72-723266176d42 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:02.579706 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da563bbe-0925-419e-8f72-723266176d42 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:02.597452 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 395/806] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:19:02 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 16:19:02.598014 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783d78f5-f969-49ba-95a4-e17ec92b81db None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:02.610630 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 412/807] 10.222.0.27 () {56 vars in 1149 bytes} [Fri Sep 9 16:19:02 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:19:02.610630 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0b05f2-9e38-46e1-93b7-1ee799e221ab None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:02.610630 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0b05f2-9e38-46e1-93b7-1ee799e221ab None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:02.610630 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0b05f2-9e38-46e1-93b7-1ee799e221ab None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:02.610630 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 413/808] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:19:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:19:02.619182 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0b05f2-9e38-46e1-93b7-1ee799e221ab None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:02.740182 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0b05f2-9e38-46e1-93b7-1ee799e221ab None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:02.743632 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783d78f5-f969-49ba-95a4-e17ec92b81db None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:02.763220 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:02.783318 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413db750-693b-4f43-8752-21636655e81e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:02.784091 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413db750-693b-4f43-8752-21636655e81e None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:02.784479 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413db750-693b-4f43-8752-21636655e81e None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:02.784826 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413db750-693b-4f43-8752-21636655e81e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:02.788540 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48bb1b2-0ce2-4b36-ad89-1fb68f8404ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:02.789339 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48bb1b2-0ce2-4b36-ad89-1fb68f8404ae None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:02.789763 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48bb1b2-0ce2-4b36-ad89-1fb68f8404ae None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:02.790197 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48bb1b2-0ce2-4b36-ad89-1fb68f8404ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:02.796151 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413db750-693b-4f43-8752-21636655e81e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:02.797791 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413db750-693b-4f43-8752-21636655e81e None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:02.803473 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48bb1b2-0ce2-4b36-ad89-1fb68f8404ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:02.805148 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48bb1b2-0ce2-4b36-ad89-1fb68f8404ae None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:02.813984 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-413db750-693b-4f43-8752-21636655e81e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 16:19:02.813984 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:19:02.813984 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:19:02.813984 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:19:02.813984 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:19:02.813984 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:19:02.813984 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:19:02.813984 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:19:02.813984 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:19:02.813984 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:19:02.813984 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:19:02.813984 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:19:02.813984 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 16:19:02.813984 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 16:19:02.813984 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 16:19:02.813984 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 16:19:02.815671 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:19:02.815671 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:19:02.815671 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:19:02.815671 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:19:02.815671 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:19:02.815671 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:19:02.815671 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:19:02.815671 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 16:19:02.815671 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:19:02.815671 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:19:02.815671 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:19:02.815671 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:19:02.815671 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:19:02.815671 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:19:02.815671 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:19:02.815671 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:19:02.815671 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 16:19:02.816774 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 16:19:02.816774 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 16:19:02.816774 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 16:19:02.818223 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 396/809] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 16:19:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:19:02.819588 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b04efa-11b4-4d87-8e31-bda772483c1e None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:02.819961 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b04efa-11b4-4d87-8e31-bda772483c1e None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:02.820326 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b04efa-11b4-4d87-8e31-bda772483c1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:02.827109 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-d48bb1b2-0ce2-4b36-ad89-1fb68f8404ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 16:19:02.827109 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:19:02.827109 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:19:02.827109 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:19:02.827109 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:19:02.827109 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:19:02.827109 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:19:02.827109 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:19:02.827109 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:19:02.827109 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:19:02.827109 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:19:02.827109 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:19:02.827109 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 16:19:02.827109 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 16:19:02.827109 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 16:19:02.827109 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 16:19:02.828297 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:19:02.828297 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:19:02.828297 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:19:02.828297 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:19:02.828297 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:19:02.828297 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:19:02.828297 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:19:02.828297 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Sep 09 16:19:02.828297 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:19:02.828297 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:19:02.828297 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:19:02.828297 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:19:02.828297 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:19:02.828297 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:19:02.828297 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:19:02.828297 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:19:02.828297 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 16:19:02.829388 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 16:19:02.829388 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 16:19:02.829388 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:19:02.836833 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 414/810] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 16:19:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:19:02.837993 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48bb1b2-0ce2-4b36-ad89-1fb68f8404ae None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:02.844310 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-f1b04efa-11b4-4d87-8e31-bda772483c1e None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:19:02.845613 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-f1b04efa-11b4-4d87-8e31-bda772483c1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:19:02.854442 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:02.916307 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 397/811] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:19:02 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 16:19:02.925635 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b04efa-11b4-4d87-8e31-bda772483c1e None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:02.953688 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48bb1b2-0ce2-4b36-ad89-1fb68f8404ae None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:02.991518 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef8322e-dd65-403b-a821-3bfbe078572b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:02.992515 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef8322e-dd65-403b-a821-3bfbe078572b None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:02.992794 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef8322e-dd65-403b-a821-3bfbe078572b None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:02.993062 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef8322e-dd65-403b-a821-3bfbe078572b None admin] PATH_INFO: `/v3/domains` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:02.994006 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef8322e-dd65-403b-a821-3bfbe078572b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:19:02.994340 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef8322e-dd65-403b-a821-3bfbe078572b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:02.995700 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef8322e-dd65-403b-a821-3bfbe078572b None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:03.009537 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 415/812] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Sep 9 16:19:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:19:03.010553 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef8322e-dd65-403b-a821-3bfbe078572b None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:03.042256 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:03.063985 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b04efa-11b4-4d87-8e31-bda772483c1e None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:03.101555 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231381a2-f4b5-4e53-b9a9-f95619eee0b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:03.102188 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231381a2-f4b5-4e53-b9a9-f95619eee0b2 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:03.102497 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231381a2-f4b5-4e53-b9a9-f95619eee0b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:03.102816 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231381a2-f4b5-4e53-b9a9-f95619eee0b2 None admin] PATH_INFO: `/v3/domains` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:03.103449 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231381a2-f4b5-4e53-b9a9-f95619eee0b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:19:03.103739 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231381a2-f4b5-4e53-b9a9-f95619eee0b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:03.105109 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231381a2-f4b5-4e53-b9a9-f95619eee0b2 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:03.121383 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 398/813] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Sep 9 16:19:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:19:03.121383 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231381a2-f4b5-4e53-b9a9-f95619eee0b2 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:03.124792 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:03.135261 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef8322e-dd65-403b-a821-3bfbe078572b None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:03.173700 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f47f80-7f76-4980-8d61-844b3b5fd20c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:03.174989 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f47f80-7f76-4980-8d61-844b3b5fd20c None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:03.175360 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f47f80-7f76-4980-8d61-844b3b5fd20c None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:03.175956 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f47f80-7f76-4980-8d61-844b3b5fd20c None admin] PATH_INFO: `/v3/services/network` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:03.176412 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f47f80-7f76-4980-8d61-844b3b5fd20c None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:03.177866 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f47f80-7f76-4980-8d61-844b3b5fd20c None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:03.187772 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-17f47f80-7f76-4980-8d61-844b3b5fd20c None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 09 16:19:03.187772 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:19:03.187772 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 16:19:03.187772 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 16:19:03.187772 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 16:19:03.187772 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 16:19:03.187772 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 16:19:03.187772 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 16:19:03.187772 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 09 16:19:03.187772 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:19:03.187772 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 16:19:03.187772 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:19:03.187772 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:19:03.187772 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:19:03.187772 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:19:03.187772 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:19:03.187772 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:19:03.188908 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:19:03.188908 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:19:03.188908 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:19:03.188908 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:19:03.188908 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:19:03.188908 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:19:03.188908 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 16:19:03.188908 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 16:19:03.188908 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 16:19:03.188908 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 16:19:03.188908 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:19:03.188908 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:19:03.188908 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:19:03.188908 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:19:03.188908 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:19:03.188908 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:19:03.190374 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:19:03.190374 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Sep 09 16:19:03.190374 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:19:03.190374 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:19:03.190374 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:19:03.190374 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:19:03.190374 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:19:03.190374 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:19:03.190374 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:19:03.190374 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:19:03.190374 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 16:19:03.190374 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 16:19:03.190374 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 09 16:19:03.190374 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:19:03.190374 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 416/814] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Sep 9 16:19:03 2022] GET /identity/v3/services/network => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:19:03.191263 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f47f80-7f76-4980-8d61-844b3b5fd20c None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:03.246571 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231381a2-f4b5-4e53-b9a9-f95619eee0b2 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:03.286630 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c2a29b-15cd-442f-b030-a241f7ca8d76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:03.287377 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c2a29b-15cd-442f-b030-a241f7ca8d76 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:03.287997 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c2a29b-15cd-442f-b030-a241f7ca8d76 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:03.287997 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c2a29b-15cd-442f-b030-a241f7ca8d76 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:03.295821 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c2a29b-15cd-442f-b030-a241f7ca8d76 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:03.297271 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c2a29b-15cd-442f-b030-a241f7ca8d76 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:03.298163 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:03.308514 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f47f80-7f76-4980-8d61-844b3b5fd20c None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:03.309293 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-17c2a29b-15cd-442f-b030-a241f7ca8d76 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 09 16:19:03.309293 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:19:03.309293 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:19:03.309293 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:19:03.309293 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:19:03.309293 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:19:03.309293 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:19:03.309293 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:19:03.309293 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:19:03.309293 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:19:03.309293 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:19:03.309293 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:19:03.309293 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 16:19:03.309293 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 16:19:03.309293 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 16:19:03.309293 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 16:19:03.310481 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:19:03.310481 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:19:03.310481 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 16:19:03.310481 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 16:19:03.310481 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 16:19:03.310481 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 16:19:03.310481 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:19:03.310481 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:19:03.310481 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:19:03.310481 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:19:03.310481 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:19:03.310481 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 16:19:03.310481 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:19:03.310481 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:19:03.310481 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:19:03.310481 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:19:03.310481 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:19:03.310481 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:19:03.311410 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:19:03.311410 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:19:03.311410 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 16:19:03.311410 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 16:19:03.311410 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 16:19:03.311410 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 16:19:03.311410 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 16:19:03.311410 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 16:19:03.311410 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 09 16:19:03.311410 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 16:19:03.311410 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 399/815] 10.222.0.27 () {56 vars in 1093 bytes} [Fri Sep 9 16:19:03 2022] GET /identity/v3/users/nova => generated 82 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:19:03.311410 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c2a29b-15cd-442f-b030-a241f7ca8d76 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:03.347404 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7125a56e-6141-4b1f-9a7b-4895c24c56fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:03.347997 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7125a56e-6141-4b1f-9a7b-4895c24c56fb None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:03.348271 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7125a56e-6141-4b1f-9a7b-4895c24c56fb None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:03.348553 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7125a56e-6141-4b1f-9a7b-4895c24c56fb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:03.356383 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7125a56e-6141-4b1f-9a7b-4895c24c56fb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:03.357284 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7125a56e-6141-4b1f-9a7b-4895c24c56fb None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:03.369163 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-7125a56e-6141-4b1f-9a7b-4895c24c56fb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 16:19:03.369163 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:19:03.369163 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:19:03.369163 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:19:03.369163 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:19:03.369163 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:19:03.369163 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:19:03.369163 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:19:03.369163 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:19:03.369163 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:19:03.369163 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:19:03.369163 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:19:03.369163 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 16:19:03.369163 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 16:19:03.369163 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 16:19:03.370087 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 16:19:03.370087 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:19:03.370087 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:19:03.370087 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:19:03.370087 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:19:03.370087 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:19:03.370087 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:19:03.370087 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:19:03.370087 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Sep 09 16:19:03.370087 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:19:03.370087 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:19:03.370087 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:19:03.370087 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:19:03.370087 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:19:03.370087 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:19:03.370087 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:19:03.370087 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:19:03.371020 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 16:19:03.371020 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 16:19:03.371020 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 16:19:03.371020 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 16:19:03.371020 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 16:19:03.371020 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 16:19:03.371020 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 16:19:03.371020 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:19:03.371020 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 417/816] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Sep 9 16:19:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:19:03.371510 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7125a56e-6141-4b1f-9a7b-4895c24c56fb None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:03.387268 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:03.431417 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c2a29b-15cd-442f-b030-a241f7ca8d76 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:03.464722 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd42cdd-246e-4fd9-bb9a-e3812e934c7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:03.465342 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd42cdd-246e-4fd9-bb9a-e3812e934c7b None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:03.465610 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd42cdd-246e-4fd9-bb9a-e3812e934c7b None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:03.465876 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd42cdd-246e-4fd9-bb9a-e3812e934c7b None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:03.466477 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd42cdd-246e-4fd9-bb9a-e3812e934c7b None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:03.467838 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd42cdd-246e-4fd9-bb9a-e3812e934c7b None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:03.477270 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-7cd42cdd-246e-4fd9-bb9a-e3812e934c7b None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 09 16:19:03.477270 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:19:03.477270 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 16:19:03.477270 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 16:19:03.477270 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 16:19:03.477270 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 16:19:03.477270 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 16:19:03.477270 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 16:19:03.477270 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 09 16:19:03.477270 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 16:19:03.477270 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 16:19:03.477270 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 16:19:03.477270 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:19:03.477270 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:19:03.477270 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:19:03.477270 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:19:03.477270 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:19:03.478238 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:19:03.478238 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:19:03.478238 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:19:03.478238 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:19:03.478238 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:19:03.478238 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:19:03.478238 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 16:19:03.478238 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 16:19:03.478238 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 16:19:03.478238 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 16:19:03.478238 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:19:03.478238 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:19:03.478238 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:19:03.478238 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:19:03.478238 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:19:03.478238 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:19:03.479131 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:19:03.479131 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 16:19:03.479131 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:19:03.479131 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:19:03.479131 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:19:03.479131 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:19:03.479131 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:19:03.479131 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:19:03.479131 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:19:03.479131 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:19:03.479131 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 16:19:03.479131 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 16:19:03.479131 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 09 16:19:03.479131 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 16:19:03.479131 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 400/817] 10.222.0.27 () {56 vars in 1129 bytes} [Fri Sep 9 16:19:03 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:19:03.480602 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd42cdd-246e-4fd9-bb9a-e3812e934c7b None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:03.495152 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7125a56e-6141-4b1f-9a7b-4895c24c56fb None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:03.531184 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95770915-e7ac-4653-8cc0-3b9a01228d8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:03.531779 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95770915-e7ac-4653-8cc0-3b9a01228d8d None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:03.532056 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95770915-e7ac-4653-8cc0-3b9a01228d8d None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:03.532322 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95770915-e7ac-4653-8cc0-3b9a01228d8d None admin] PATH_INFO: `/v3/services` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:03.532940 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95770915-e7ac-4653-8cc0-3b9a01228d8d None admin] RBAC: Adding query filter params (name=network) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:19:03.533757 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95770915-e7ac-4653-8cc0-3b9a01228d8d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:03.535206 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95770915-e7ac-4653-8cc0-3b9a01228d8d None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:03.539572 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 418/818] 10.222.0.27 () {56 vars in 1112 bytes} [Fri Sep 9 16:19:03 2022] GET /identity/v3/services?name=network => generated 124 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:19:03.540327 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95770915-e7ac-4653-8cc0-3b9a01228d8d None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:03.560310 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:03.591750 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd42cdd-246e-4fd9-bb9a-e3812e934c7b None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:03.623490 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:03.633101 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a8999a-9930-43e0-976f-d96924da2b0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:03.633705 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a8999a-9930-43e0-976f-d96924da2b0b None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:03.633987 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a8999a-9930-43e0-976f-d96924da2b0b None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:03.634257 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a8999a-9930-43e0-976f-d96924da2b0b None admin] PATH_INFO: `/v3/users` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:03.635005 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a8999a-9930-43e0-976f-d96924da2b0b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:19:03.635308 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a8999a-9930-43e0-976f-d96924da2b0b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:03.636750 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a8999a-9930-43e0-976f-d96924da2b0b None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:03.651668 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95770915-e7ac-4653-8cc0-3b9a01228d8d None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:03.659105 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 401/819] 10.222.0.27 () {56 vars in 1133 bytes} [Fri Sep 9 16:19:03 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:19:03.660285 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a8999a-9930-43e0-976f-d96924da2b0b None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:03.690412 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8d739a-417e-4953-97f6-6e346adebd4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:03.690943 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8d739a-417e-4953-97f6-6e346adebd4f None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:03.691217 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8d739a-417e-4953-97f6-6e346adebd4f None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:03.691482 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8d739a-417e-4953-97f6-6e346adebd4f None admin] PATH_INFO: `/v3/projects` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:03.692152 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8d739a-417e-4953-97f6-6e346adebd4f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:19:03.692452 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8d739a-417e-4953-97f6-6e346adebd4f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:03.693873 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8d739a-417e-4953-97f6-6e346adebd4f None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:03.711170 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 419/820] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Sep 9 16:19:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:19:03.711170 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8d739a-417e-4953-97f6-6e346adebd4f None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:03.771887 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a8999a-9930-43e0-976f-d96924da2b0b None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:03.795911 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:03.810296 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fb9420-350c-4a8e-a0b8-14411c04110f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:03.810935 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fb9420-350c-4a8e-a0b8-14411c04110f None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:03.811217 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fb9420-350c-4a8e-a0b8-14411c04110f None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:03.811483 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fb9420-350c-4a8e-a0b8-14411c04110f None admin] PATH_INFO: `/v3/services` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:03.812106 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fb9420-350c-4a8e-a0b8-14411c04110f None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:19:03.812430 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fb9420-350c-4a8e-a0b8-14411c04110f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:03.813825 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fb9420-350c-4a8e-a0b8-14411c04110f None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:03.822784 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 402/821] 10.222.0.27 () {56 vars in 1124 bytes} [Fri Sep 9 16:19:03 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:19:03.822784 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fb9420-350c-4a8e-a0b8-14411c04110f None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:03.825524 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8d739a-417e-4953-97f6-6e346adebd4f None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:03.861950 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17249b48-d0c2-47cb-a889-95e5e4280cb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:03.862592 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17249b48-d0c2-47cb-a889-95e5e4280cb6 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:03.862868 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17249b48-d0c2-47cb-a889-95e5e4280cb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:03.863135 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17249b48-d0c2-47cb-a889-95e5e4280cb6 None admin] PATH_INFO: `/v3/services` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:03.863753 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17249b48-d0c2-47cb-a889-95e5e4280cb6 None admin] RBAC: Adding query filter params (type=network) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:19:03.864054 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17249b48-d0c2-47cb-a889-95e5e4280cb6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:03.865421 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17249b48-d0c2-47cb-a889-95e5e4280cb6 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:03.870513 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 420/822] 10.222.0.27 () {56 vars in 1112 bytes} [Fri Sep 9 16:19:03 2022] GET /identity/v3/services?type=network => generated 350 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:19:03.871262 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17249b48-d0c2-47cb-a889-95e5e4280cb6 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:03.882799 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:03.945412 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fb9420-350c-4a8e-a0b8-14411c04110f None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:03.980657 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17249b48-d0c2-47cb-a889-95e5e4280cb6 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:04.017422 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20fcd57-096b-4615-8aaa-7991e3e10037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:04.018703 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20fcd57-096b-4615-8aaa-7991e3e10037 None admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:04.018972 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20fcd57-096b-4615-8aaa-7991e3e10037 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:04.019232 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20fcd57-096b-4615-8aaa-7991e3e10037 None admin] PATH_INFO: `/v3/projects/68d6aaafab824657b08ca91f3d46d5f8/users/b9d05f3782d24127aa613c8d7ac8041b/roles/1966594501e743aebf757851d9cd82a5` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:04.031557 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:04.036999 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20fcd57-096b-4615-8aaa-7991e3e10037 None admin] RBAC: Authorizing `identity:create_grant(project_id=68d6aaafab824657b08ca91f3d46d5f8, user_id=b9d05f3782d24127aa613c8d7ac8041b, role_id=1966594501e743aebf757851d9cd82a5)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:04.038509 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20fcd57-096b-4615-8aaa-7991e3e10037 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:04.058397 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 421/823] 10.222.0.27 () {58 vars in 1439 bytes} [Fri Sep 9 16:19:03 2022] PUT /identity/v3/projects/68d6aaafab824657b08ca91f3d46d5f8/users/b9d05f3782d24127aa613c8d7ac8041b/roles/1966594501e743aebf757851d9cd82a5 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:19:04.060163 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20fcd57-096b-4615-8aaa-7991e3e10037 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:04.103932 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b046c133-c4a7-4ce3-9869-5d774163373f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:04.104560 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b046c133-c4a7-4ce3-9869-5d774163373f None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:04.105091 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b046c133-c4a7-4ce3-9869-5d774163373f None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:04.105370 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b046c133-c4a7-4ce3-9869-5d774163373f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:04.191727 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b046c133-c4a7-4ce3-9869-5d774163373f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:04.193509 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b046c133-c4a7-4ce3-9869-5d774163373f None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:04.203237 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20fcd57-096b-4615-8aaa-7991e3e10037 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:04.248220 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:04.248830 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4327a9-be51-422d-96f7-f888eea4bade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:04.249446 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4327a9-be51-422d-96f7-f888eea4bade None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:04.249721 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4327a9-be51-422d-96f7-f888eea4bade None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:04.250153 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4327a9-be51-422d-96f7-f888eea4bade None admin] PATH_INFO: `/v3/services` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:04.250922 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4327a9-be51-422d-96f7-f888eea4bade None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:19:04.251176 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4327a9-be51-422d-96f7-f888eea4bade None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:04.253562 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4327a9-be51-422d-96f7-f888eea4bade None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:04.259264 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 422/824] 10.222.0.27 () {56 vars in 1124 bytes} [Fri Sep 9 16:19:04 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:19:04.260064 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4327a9-be51-422d-96f7-f888eea4bade None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:04.313771 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 403/825] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Sep 9 16:19:03 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 492 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 09 16:19:04.313771 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebccaf1-68d0-4317-8808-f8c4f22c0633 None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:04.313771 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebccaf1-68d0-4317-8808-f8c4f22c0633 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:04.313771 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebccaf1-68d0-4317-8808-f8c4f22c0633 None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:04.313771 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 404/826] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:19:04 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:19:04.314384 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebccaf1-68d0-4317-8808-f8c4f22c0633 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:04.326230 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:04.375266 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4327a9-be51-422d-96f7-f888eea4bade None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:04.412224 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144f8316-a2af-4207-b9a8-7e9ad9050572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:04.412937 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144f8316-a2af-4207-b9a8-7e9ad9050572 None admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:04.413211 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144f8316-a2af-4207-b9a8-7e9ad9050572 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:04.413586 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144f8316-a2af-4207-b9a8-7e9ad9050572 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:04.414234 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144f8316-a2af-4207-b9a8-7e9ad9050572 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:04.415619 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144f8316-a2af-4207-b9a8-7e9ad9050572 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:04.417423 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebccaf1-68d0-4317-8808-f8c4f22c0633 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:04.440681 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 423/827] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 16:19:04 2022] POST /identity/v3/endpoints => generated 337 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:19:04.440681 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144f8316-a2af-4207-b9a8-7e9ad9050572 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:04.473050 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb5b862-719f-46b9-b2e9-f8abd6a9125c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:04.473578 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb5b862-719f-46b9-b2e9-f8abd6a9125c None admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:04.473854 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb5b862-719f-46b9-b2e9-f8abd6a9125c None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:04.474118 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb5b862-719f-46b9-b2e9-f8abd6a9125c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:04.474874 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb5b862-719f-46b9-b2e9-f8abd6a9125c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:04.476389 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb5b862-719f-46b9-b2e9-f8abd6a9125c None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:04.498665 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:04.505198 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 405/828] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 16:19:04 2022] POST /identity/v3/endpoints => generated 346 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:19:04.513743 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080ae734-f9ba-451c-b12c-cb93c292824f None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:04.514076 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080ae734-f9ba-451c-b12c-cb93c292824f None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:04.514288 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080ae734-f9ba-451c-b12c-cb93c292824f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:04.558939 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-080ae734-f9ba-451c-b12c-cb93c292824f None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:19:04.561135 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-080ae734-f9ba-451c-b12c-cb93c292824f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:19:04.669948 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144f8316-a2af-4207-b9a8-7e9ad9050572 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:04.690719 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:04.718500 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f21fe6-db59-4c36-a23a-3de1e86f9982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:04.718500 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f21fe6-db59-4c36-a23a-3de1e86f9982 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:04.718500 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f21fe6-db59-4c36-a23a-3de1e86f9982 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:04.718500 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f21fe6-db59-4c36-a23a-3de1e86f9982 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:04.719175 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 406/829] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:19:04 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 16:19:04.726977 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f21fe6-db59-4c36-a23a-3de1e86f9982 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:04.728412 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f21fe6-db59-4c36-a23a-3de1e86f9982 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:04.746854 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-c8f21fe6-db59-4c36-a23a-3de1e86f9982 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 16:19:04.746854 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:19:04.746854 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:19:04.746854 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:19:04.746854 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:19:04.746854 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:19:04.746854 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:19:04.746854 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:19:04.746854 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:19:04.746854 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:19:04.746854 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:19:04.746854 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:19:04.746854 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 16:19:04.746854 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 16:19:04.746854 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 16:19:04.746854 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 16:19:04.747835 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:19:04.747835 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:19:04.747835 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:19:04.747835 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:19:04.747835 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:19:04.747835 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:19:04.747835 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:19:04.747835 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Sep 09 16:19:04.747835 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:19:04.747835 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:19:04.747835 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:19:04.747835 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:19:04.747835 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:19:04.747835 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:19:04.747835 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:19:04.747835 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:19:04.747835 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 16:19:04.748710 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 16:19:04.748710 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 16:19:04.748710 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:19:04.748710 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 424/830] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 16:19:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:19:04.754492 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080ae734-f9ba-451c-b12c-cb93c292824f None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:04.868606 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080ae734-f9ba-451c-b12c-cb93c292824f None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:04.895013 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:04.904602 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b8c2e5-6014-4624-bbbc-6fccc42b16b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:04.905264 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b8c2e5-6014-4624-bbbc-6fccc42b16b0 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:04.905738 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b8c2e5-6014-4624-bbbc-6fccc42b16b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:04.906009 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b8c2e5-6014-4624-bbbc-6fccc42b16b0 None admin] PATH_INFO: `/v3/domains` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:04.906672 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b8c2e5-6014-4624-bbbc-6fccc42b16b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:19:04.906972 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b8c2e5-6014-4624-bbbc-6fccc42b16b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:04.908881 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b8c2e5-6014-4624-bbbc-6fccc42b16b0 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:04.920845 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 407/831] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Sep 9 16:19:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:19:04.926766 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f21fe6-db59-4c36-a23a-3de1e86f9982 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:05.008436 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b8c2e5-6014-4624-bbbc-6fccc42b16b0 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:05.039119 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f21fe6-db59-4c36-a23a-3de1e86f9982 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:05.077716 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be60dcc-8129-4749-b486-1fdb6813aef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:05.078363 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be60dcc-8129-4749-b486-1fdb6813aef1 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:05.078639 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be60dcc-8129-4749-b486-1fdb6813aef1 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:05.078910 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be60dcc-8129-4749-b486-1fdb6813aef1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:05.086498 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be60dcc-8129-4749-b486-1fdb6813aef1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:05.087935 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be60dcc-8129-4749-b486-1fdb6813aef1 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:05.100772 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-7be60dcc-8129-4749-b486-1fdb6813aef1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 16:19:05.100772 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:19:05.100772 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:19:05.100772 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:19:05.100772 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:19:05.100772 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:19:05.100772 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:19:05.100772 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:19:05.100772 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:19:05.100772 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:19:05.100772 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:19:05.100772 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:19:05.100772 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 16:19:05.100772 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 16:19:05.100772 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 16:19:05.101674 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 16:19:05.101674 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:19:05.101674 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:19:05.101674 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:19:05.101674 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:19:05.101674 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:19:05.101674 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:19:05.101674 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:19:05.101674 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Sep 09 16:19:05.101674 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:19:05.101674 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:19:05.101674 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:19:05.101674 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:19:05.101674 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:19:05.101674 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:19:05.101674 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:19:05.101674 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:19:05.103030 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 16:19:05.103030 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 16:19:05.103030 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 16:19:05.103030 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 16:19:05.103030 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 16:19:05.103030 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 16:19:05.103030 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 16:19:05.103030 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:19:05.106573 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 425/832] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Sep 9 16:19:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:19:05.107854 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be60dcc-8129-4749-b486-1fdb6813aef1 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:05.135765 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:05.138761 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b8c2e5-6014-4624-bbbc-6fccc42b16b0 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:05.178241 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e94620e-b28f-4d2d-85d7-2d7273cd70a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:05.178904 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e94620e-b28f-4d2d-85d7-2d7273cd70a5 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:05.179179 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e94620e-b28f-4d2d-85d7-2d7273cd70a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:05.179446 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e94620e-b28f-4d2d-85d7-2d7273cd70a5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:05.190440 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e94620e-b28f-4d2d-85d7-2d7273cd70a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 16:19:05.195812 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-1e94620e-b28f-4d2d-85d7-2d7273cd70a5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 16:19:05.195812 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:19:05.195812 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:19:05.195812 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:19:05.195812 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:19:05.195812 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:19:05.195812 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:19:05.195812 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:19:05.195812 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:19:05.195812 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:19:05.195812 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:19:05.195812 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:19:05.195812 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 16:19:05.195812 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 16:19:05.195812 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 16:19:05.195812 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 16:19:05.196741 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 16:19:05.196741 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 16:19:05.196741 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 16:19:05.196741 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 16:19:05.196741 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:19:05.196741 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:19:05.196741 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:19:05.196741 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:19:05.196741 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:19:05.196741 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:19:05.196741 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:19:05.196741 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 16:19:05.196741 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:19:05.196741 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:19:05.196741 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:19:05.196741 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:19:05.197581 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:19:05.197581 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:19:05.197581 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:19:05.197581 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:19:05.197581 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 16:19:05.197581 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 16:19:05.197581 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 16:19:05.197581 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 16:19:05.197581 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 16:19:05.197581 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 16:19:05.197581 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 16:19:05.197581 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 16:19:05.197581 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 408/833] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Sep 9 16:19:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 16:19:05.210385 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e94620e-b28f-4d2d-85d7-2d7273cd70a5 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:05.231116 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be60dcc-8129-4749-b486-1fdb6813aef1 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:05.268782 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e2a9b3-7e9f-4031-b8aa-bbf8eef69bd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:05.269687 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e2a9b3-7e9f-4031-b8aa-bbf8eef69bd1 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:05.270209 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e2a9b3-7e9f-4031-b8aa-bbf8eef69bd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:05.270787 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e2a9b3-7e9f-4031-b8aa-bbf8eef69bd1 None admin] PATH_INFO: `/v3/projects` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:05.271693 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e2a9b3-7e9f-4031-b8aa-bbf8eef69bd1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:19:05.272221 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e2a9b3-7e9f-4031-b8aa-bbf8eef69bd1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:05.273422 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:05.274784 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e2a9b3-7e9f-4031-b8aa-bbf8eef69bd1 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:05.289996 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 426/834] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Sep 9 16:19:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 16:19:05.296271 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e2a9b3-7e9f-4031-b8aa-bbf8eef69bd1 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:05.348535 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e94620e-b28f-4d2d-85d7-2d7273cd70a5 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:05.390625 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:05.395076 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197a3618-801f-47b1-a372-ace4b4c97ecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:05.396540 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197a3618-801f-47b1-a372-ace4b4c97ecd None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:05.397438 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197a3618-801f-47b1-a372-ace4b4c97ecd None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:05.397918 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197a3618-801f-47b1-a372-ace4b4c97ecd None admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:05.398803 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197a3618-801f-47b1-a372-ace4b4c97ecd None admin] RBAC: Adding query filter params (name=admin) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:19:05.399305 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197a3618-801f-47b1-a372-ace4b4c97ecd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:05.401577 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197a3618-801f-47b1-a372-ace4b4c97ecd None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:05.414327 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 409/835] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Sep 9 16:19:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:19:05.414791 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e2a9b3-7e9f-4031-b8aa-bbf8eef69bd1 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:05.425322 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197a3618-801f-47b1-a372-ace4b4c97ecd None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:05.454578 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fcd02d-3d7f-4e23-97f5-b729da31b722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:05.454975 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fcd02d-3d7f-4e23-97f5-b729da31b722 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:05.455784 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fcd02d-3d7f-4e23-97f5-b729da31b722 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:05.456054 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fcd02d-3d7f-4e23-97f5-b729da31b722 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:05.456774 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fcd02d-3d7f-4e23-97f5-b729da31b722 None admin] RBAC: Adding query filter params (role.id=0a36d1be416f4089be19be979943b731, scope.project.id=68d6aaafab824657b08ca91f3d46d5f8, user.id=a332b9b4980646a3b14633293f77b505) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:19:05.457054 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fcd02d-3d7f-4e23-97f5-b729da31b722 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:05.458549 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fcd02d-3d7f-4e23-97f5-b729da31b722 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:05.470326 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 427/836] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Sep 9 16:19:05 2022] GET /identity/v3/role_assignments?user.id=a332b9b4980646a3b14633293f77b505&scope.project.id=68d6aaafab824657b08ca91f3d46d5f8&role.id=0a36d1be416f4089be19be979943b731 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:19:05.548536 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197a3618-801f-47b1-a372-ace4b4c97ecd None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:05.559369 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:05.590746 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff98fcc5-b79b-4031-8604-02cf82b1dff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:05.591506 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff98fcc5-b79b-4031-8604-02cf82b1dff4 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:05.591786 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff98fcc5-b79b-4031-8604-02cf82b1dff4 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:05.592057 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff98fcc5-b79b-4031-8604-02cf82b1dff4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:05.604112 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff98fcc5-b79b-4031-8604-02cf82b1dff4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:05.605703 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff98fcc5-b79b-4031-8604-02cf82b1dff4 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:05.621212 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-ff98fcc5-b79b-4031-8604-02cf82b1dff4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 16:19:05.621212 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:19:05.621212 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:19:05.621212 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:19:05.621212 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:19:05.621212 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:19:05.621212 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:19:05.621212 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:19:05.621212 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:19:05.621212 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:19:05.621212 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:19:05.621212 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:19:05.621212 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 16:19:05.621212 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 16:19:05.621212 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 16:19:05.621212 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 16:19:05.622230 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:19:05.622230 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:19:05.622230 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:19:05.622230 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:19:05.622230 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:19:05.622230 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:19:05.622230 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:19:05.622230 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 16:19:05.622230 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:19:05.622230 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:19:05.622230 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:19:05.622230 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:19:05.622230 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:19:05.622230 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:19:05.622230 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:19:05.622230 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:19:05.622230 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 16:19:05.623775 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 16:19:05.623775 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 16:19:05.623775 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 16:19:05.623775 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 410/837] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 16:19:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:19:05.629170 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fcd02d-3d7f-4e23-97f5-b729da31b722 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:05.737786 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fcd02d-3d7f-4e23-97f5-b729da31b722 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:05.773500 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613da044-2ee7-478b-a7f2-399ded75ac2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:05.774106 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613da044-2ee7-478b-a7f2-399ded75ac2e None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:05.774416 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613da044-2ee7-478b-a7f2-399ded75ac2e None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:05.774688 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613da044-2ee7-478b-a7f2-399ded75ac2e None admin] PATH_INFO: `/v3/domains` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:05.775326 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613da044-2ee7-478b-a7f2-399ded75ac2e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:19:05.775628 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613da044-2ee7-478b-a7f2-399ded75ac2e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:05.777000 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613da044-2ee7-478b-a7f2-399ded75ac2e None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:05.794461 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 428/838] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Sep 9 16:19:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:19:05.796128 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff98fcc5-b79b-4031-8604-02cf82b1dff4 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:05.907635 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff98fcc5-b79b-4031-8604-02cf82b1dff4 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:05.943387 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e0b641-8c44-44ae-b3f5-24fb4de92322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:05.944396 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e0b641-8c44-44ae-b3f5-24fb4de92322 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:05.944869 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e0b641-8c44-44ae-b3f5-24fb4de92322 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:05.945335 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e0b641-8c44-44ae-b3f5-24fb4de92322 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:05.953289 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e0b641-8c44-44ae-b3f5-24fb4de92322 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:05.955062 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e0b641-8c44-44ae-b3f5-24fb4de92322 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:05.966372 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-c8e0b641-8c44-44ae-b3f5-24fb4de92322 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 09 16:19:05.966372 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:19:05.966372 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:19:05.966372 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:19:05.966372 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:19:05.966372 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:19:05.966372 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:19:05.966372 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:19:05.966372 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:19:05.966372 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:19:05.966372 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:19:05.966372 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:19:05.966372 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 16:19:05.966372 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 16:19:05.966372 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 16:19:05.966372 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 16:19:05.967279 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:19:05.967279 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:19:05.967279 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 16:19:05.967279 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 16:19:05.967279 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 16:19:05.967279 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 16:19:05.967279 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:19:05.967279 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:19:05.967279 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:19:05.967279 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:19:05.967279 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:19:05.967279 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 16:19:05.967279 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:19:05.967279 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:19:05.967279 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:19:05.967279 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:19:05.967279 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:19:05.967279 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:19:05.968206 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:19:05.968206 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:19:05.968206 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 16:19:05.968206 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 16:19:05.968206 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 16:19:05.968206 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 16:19:05.968206 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 16:19:05.968206 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 16:19:05.968206 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 09 16:19:05.968206 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 16:19:05.970690 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 411/839] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Sep 9 16:19:05 2022] GET /identity/v3/users/swift => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:19:05.978931 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613da044-2ee7-478b-a7f2-399ded75ac2e None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:05.985349 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:06.082605 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613da044-2ee7-478b-a7f2-399ded75ac2e None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:06.120180 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3439a995-527c-4009-9115-2e4a5086892d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:06.120787 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3439a995-527c-4009-9115-2e4a5086892d None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:06.121063 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3439a995-527c-4009-9115-2e4a5086892d None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:06.121330 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3439a995-527c-4009-9115-2e4a5086892d None admin] PATH_INFO: `/v3/users` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:06.122051 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3439a995-527c-4009-9115-2e4a5086892d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:19:06.122378 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3439a995-527c-4009-9115-2e4a5086892d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:06.123815 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3439a995-527c-4009-9115-2e4a5086892d None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:06.146426 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 429/840] 10.222.0.27 () {56 vars in 1135 bytes} [Fri Sep 9 16:19:05 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:19:06.148118 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e0b641-8c44-44ae-b3f5-24fb4de92322 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:06.171064 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:06.259271 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e0b641-8c44-44ae-b3f5-24fb4de92322 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:06.296201 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f581e3b6-8efe-4950-b81f-4714930702c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:06.296806 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f581e3b6-8efe-4950-b81f-4714930702c8 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:06.297078 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f581e3b6-8efe-4950-b81f-4714930702c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:06.297350 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f581e3b6-8efe-4950-b81f-4714930702c8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:06.308348 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022bb34b-19ab-4479-80bf-d6372270815c None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:06.308848 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022bb34b-19ab-4479-80bf-d6372270815c None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:06.308928 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022bb34b-19ab-4479-80bf-d6372270815c None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:06.310724 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 430/841] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:19:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:19:06.315825 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a55d8d8-57fa-4098-b7c3-27b47c538d90 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:06.316108 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a55d8d8-57fa-4098-b7c3-27b47c538d90 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:06.316380 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a55d8d8-57fa-4098-b7c3-27b47c538d90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:06.336317 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-0a55d8d8-57fa-4098-b7c3-27b47c538d90 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:19:06.337518 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-0a55d8d8-57fa-4098-b7c3-27b47c538d90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:19:06.376549 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f581e3b6-8efe-4950-b81f-4714930702c8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:06.378027 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f581e3b6-8efe-4950-b81f-4714930702c8 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:06.399739 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:06.410959 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:06.426630 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 431/842] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:19:06 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 16:19:06.484590 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 412/843] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Sep 9 16:19:06 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 09 16:19:06.491356 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a55d8d8-57fa-4098-b7c3-27b47c538d90 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:06.599227 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a55d8d8-57fa-4098-b7c3-27b47c538d90 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:06.638459 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5febd66-f05e-4fb5-a51b-2fdcf2517826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:06.639359 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5febd66-f05e-4fb5-a51b-2fdcf2517826 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:06.639846 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5febd66-f05e-4fb5-a51b-2fdcf2517826 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:06.640359 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5febd66-f05e-4fb5-a51b-2fdcf2517826 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:06.651234 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5febd66-f05e-4fb5-a51b-2fdcf2517826 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:06.652872 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5febd66-f05e-4fb5-a51b-2fdcf2517826 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:06.668190 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-e5febd66-f05e-4fb5-a51b-2fdcf2517826 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 16:19:06.668190 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:19:06.668190 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:19:06.668190 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:19:06.668190 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:19:06.668190 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:19:06.668190 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:19:06.668190 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:19:06.668190 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:19:06.668190 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:19:06.668190 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:19:06.668190 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:19:06.668190 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 16:19:06.668190 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 16:19:06.668190 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 16:19:06.668190 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 16:19:06.669162 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:19:06.669162 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:19:06.669162 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:19:06.669162 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:19:06.669162 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:19:06.669162 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:19:06.669162 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:19:06.669162 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Sep 09 16:19:06.669162 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:19:06.669162 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:19:06.669162 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:19:06.669162 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:19:06.669162 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:19:06.669162 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:19:06.669162 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:19:06.669162 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:19:06.669162 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 16:19:06.670071 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 16:19:06.670071 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 16:19:06.670071 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:19:06.671781 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 432/844] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 16:19:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:19:06.677549 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f581e3b6-8efe-4950-b81f-4714930702c8 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:06.757411 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5febd66-f05e-4fb5-a51b-2fdcf2517826 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:06.793947 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f581e3b6-8efe-4950-b81f-4714930702c8 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:06.812334 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:06.818099 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:06.834071 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914ea95f-487f-4c87-91fe-0acedb788063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:06.834919 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914ea95f-487f-4c87-91fe-0acedb788063 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:06.835348 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914ea95f-487f-4c87-91fe-0acedb788063 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:06.835792 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914ea95f-487f-4c87-91fe-0acedb788063 None admin] PATH_INFO: `/v3/domains` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:06.836607 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914ea95f-487f-4c87-91fe-0acedb788063 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:19:06.837057 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914ea95f-487f-4c87-91fe-0acedb788063 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:06.838678 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914ea95f-487f-4c87-91fe-0acedb788063 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:06.851889 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 413/845] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Sep 9 16:19:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:19:06.857571 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914ea95f-487f-4c87-91fe-0acedb788063 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:06.874144 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5febd66-f05e-4fb5-a51b-2fdcf2517826 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:06.912136 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e34a332-c963-4f85-94fe-1f96ae1f8887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:06.912770 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e34a332-c963-4f85-94fe-1f96ae1f8887 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:06.913050 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e34a332-c963-4f85-94fe-1f96ae1f8887 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:06.913323 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e34a332-c963-4f85-94fe-1f96ae1f8887 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:06.923729 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e34a332-c963-4f85-94fe-1f96ae1f8887 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 16:19:06.929154 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-1e34a332-c963-4f85-94fe-1f96ae1f8887 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 16:19:06.929154 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:19:06.929154 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:19:06.929154 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:19:06.929154 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:19:06.929154 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:19:06.929154 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:19:06.929154 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:19:06.929154 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:19:06.929154 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:19:06.929154 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:19:06.929154 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:19:06.929154 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 16:19:06.929154 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 16:19:06.929154 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 16:19:06.929154 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 16:19:06.930098 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 16:19:06.930098 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 16:19:06.930098 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 16:19:06.930098 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 16:19:06.930098 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:19:06.930098 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:19:06.930098 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:19:06.930098 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:19:06.930098 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:19:06.930098 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:19:06.930098 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:19:06.930098 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Sep 09 16:19:06.930098 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:19:06.930098 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:19:06.930098 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:19:06.930098 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:19:06.930970 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:19:06.930970 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:19:06.930970 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:19:06.930970 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:19:06.930970 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 16:19:06.930970 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 16:19:06.930970 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 16:19:06.930970 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 16:19:06.930970 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 16:19:06.930970 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 16:19:06.930970 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 16:19:06.930970 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:19:06.930970 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 433/846] 10.222.0.27 () {56 vars in 1102 bytes} [Fri Sep 9 16:19:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 16:19:06.931680 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a12f46-929b-47f1-a72d-8ed8778cfc43 None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:06.931680 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a12f46-929b-47f1-a72d-8ed8778cfc43 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:06.932140 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a12f46-929b-47f1-a72d-8ed8778cfc43 None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:06.933328 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 434/847] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:19:06 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:19:06.939899 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2fb3cc-cda7-4fd8-86df-5a28618d1c4e None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:06.940180 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2fb3cc-cda7-4fd8-86df-5a28618d1c4e None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:06.940449 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2fb3cc-cda7-4fd8-86df-5a28618d1c4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:06.961570 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-ad2fb3cc-cda7-4fd8-86df-5a28618d1c4e None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:19:06.962945 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-ad2fb3cc-cda7-4fd8-86df-5a28618d1c4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:19:06.966983 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914ea95f-487f-4c87-91fe-0acedb788063 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:07.014894 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760ef829-acce-4ff4-9728-fcd18555f8b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:07.015522 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760ef829-acce-4ff4-9728-fcd18555f8b1 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:07.015803 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760ef829-acce-4ff4-9728-fcd18555f8b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:07.016078 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760ef829-acce-4ff4-9728-fcd18555f8b1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:07.027012 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760ef829-acce-4ff4-9728-fcd18555f8b1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:07.028794 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760ef829-acce-4ff4-9728-fcd18555f8b1 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:07.042525 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 435/848] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:19:06 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 16:19:07.042525 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2fb3cc-cda7-4fd8-86df-5a28618d1c4e None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:07.055157 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-760ef829-acce-4ff4-9728-fcd18555f8b1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 16:19:07.055157 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:19:07.055157 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:19:07.055157 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:19:07.055157 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:19:07.055157 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:19:07.055157 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:19:07.055157 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:19:07.055157 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:19:07.055157 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:19:07.055157 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:19:07.055157 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:19:07.055157 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 16:19:07.055157 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 16:19:07.055157 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 16:19:07.056055 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 16:19:07.056055 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:19:07.056055 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:19:07.056055 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:19:07.056055 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:19:07.056055 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:19:07.056055 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:19:07.056055 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:19:07.056055 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 16:19:07.056055 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:19:07.056055 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:19:07.056055 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:19:07.056055 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:19:07.056055 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:19:07.056055 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:19:07.056055 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:19:07.056055 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:19:07.056970 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 16:19:07.056970 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 16:19:07.056970 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 16:19:07.056970 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 16:19:07.056970 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 16:19:07.056970 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 16:19:07.056970 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 16:19:07.056970 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 16:19:07.058509 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 414/849] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Sep 9 16:19:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:19:07.063105 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760ef829-acce-4ff4-9728-fcd18555f8b1 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:07.073993 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:07.123606 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:07.155941 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2fb3cc-cda7-4fd8-86df-5a28618d1c4e None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:07.196109 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760ef829-acce-4ff4-9728-fcd18555f8b1 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:07.198191 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3f5da1-e6bf-404f-bfe0-f1297df32e21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:07.199018 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3f5da1-e6bf-404f-bfe0-f1297df32e21 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:07.199396 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3f5da1-e6bf-404f-bfe0-f1297df32e21 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:07.200391 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3f5da1-e6bf-404f-bfe0-f1297df32e21 None admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:07.200617 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3f5da1-e6bf-404f-bfe0-f1297df32e21 None admin] RBAC: Adding query filter params (name=service) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:19:07.201019 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3f5da1-e6bf-404f-bfe0-f1297df32e21 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:07.202521 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3f5da1-e6bf-404f-bfe0-f1297df32e21 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:07.216848 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 436/850] 10.222.0.27 () {56 vars in 1103 bytes} [Fri Sep 9 16:19:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:19:07.218789 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3f5da1-e6bf-404f-bfe0-f1297df32e21 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:07.239272 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7a34bc-2309-4367-8778-24783460a480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:07.240084 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7a34bc-2309-4367-8778-24783460a480 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:07.240611 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7a34bc-2309-4367-8778-24783460a480 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:07.240832 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7a34bc-2309-4367-8778-24783460a480 None admin] PATH_INFO: `/v3/projects` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:07.241722 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7a34bc-2309-4367-8778-24783460a480 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:19:07.242071 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7a34bc-2309-4367-8778-24783460a480 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:07.243613 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7a34bc-2309-4367-8778-24783460a480 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:07.265238 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 415/851] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Sep 9 16:19:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:19:07.266745 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7a34bc-2309-4367-8778-24783460a480 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:07.349790 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:07.354413 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3f5da1-e6bf-404f-bfe0-f1297df32e21 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:07.376146 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:07.379536 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7a34bc-2309-4367-8778-24783460a480 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:07.393948 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76ed6c3-d363-4606-ae5d-14d6b1ebe132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:07.394606 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76ed6c3-d363-4606-ae5d-14d6b1ebe132 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:07.394885 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76ed6c3-d363-4606-ae5d-14d6b1ebe132 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:07.395180 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76ed6c3-d363-4606-ae5d-14d6b1ebe132 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:07.406817 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76ed6c3-d363-4606-ae5d-14d6b1ebe132 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:07.408828 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76ed6c3-d363-4606-ae5d-14d6b1ebe132 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:07.417034 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c653c1b-e519-4f3d-8f5d-2bc8010a3cb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:07.417664 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c653c1b-e519-4f3d-8f5d-2bc8010a3cb0 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:07.417963 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c653c1b-e519-4f3d-8f5d-2bc8010a3cb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:07.418210 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c653c1b-e519-4f3d-8f5d-2bc8010a3cb0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:07.418954 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c653c1b-e519-4f3d-8f5d-2bc8010a3cb0 None admin] RBAC: Adding query filter params (role.id=0a36d1be416f4089be19be979943b731, scope.project.id=68d6aaafab824657b08ca91f3d46d5f8, user.id=a2350bbc4a194c2dab2e3be830fd0eba) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:19:07.419260 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c653c1b-e519-4f3d-8f5d-2bc8010a3cb0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:07.420670 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c653c1b-e519-4f3d-8f5d-2bc8010a3cb0 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:07.423763 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-a76ed6c3-d363-4606-ae5d-14d6b1ebe132 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 16:19:07.423763 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:19:07.423763 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:19:07.423763 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:19:07.423763 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:19:07.423763 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:19:07.423763 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:19:07.423763 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:19:07.423763 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:19:07.423763 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:19:07.423763 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:19:07.423763 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:19:07.423763 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 16:19:07.423763 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 16:19:07.423763 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 16:19:07.423763 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 16:19:07.425378 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:19:07.425378 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:19:07.425378 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:19:07.425378 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:19:07.425378 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:19:07.425378 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:19:07.425378 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:19:07.425378 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Sep 09 16:19:07.425378 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:19:07.425378 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:19:07.425378 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:19:07.425378 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:19:07.425378 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:19:07.425378 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:19:07.425378 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:19:07.425378 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:19:07.425378 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 16:19:07.426284 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 16:19:07.426284 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 16:19:07.426284 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:19:07.426284 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 437/852] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 16:19:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:19:07.426284 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76ed6c3-d363-4606-ae5d-14d6b1ebe132 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:07.433093 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 416/853] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Sep 9 16:19:07 2022] GET /identity/v3/role_assignments?user.id=a2350bbc4a194c2dab2e3be830fd0eba&scope.project.id=68d6aaafab824657b08ca91f3d46d5f8&role.id=0a36d1be416f4089be19be979943b731 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:19:07.436106 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c653c1b-e519-4f3d-8f5d-2bc8010a3cb0 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:07.556646 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76ed6c3-d363-4606-ae5d-14d6b1ebe132 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:07.596793 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a2dc32-fea5-4d70-9549-6495eb82a6f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:07.597461 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a2dc32-fea5-4d70-9549-6495eb82a6f3 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:07.597871 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a2dc32-fea5-4d70-9549-6495eb82a6f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:07.598150 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a2dc32-fea5-4d70-9549-6495eb82a6f3 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:07.598773 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a2dc32-fea5-4d70-9549-6495eb82a6f3 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:07.600169 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a2dc32-fea5-4d70-9549-6495eb82a6f3 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:07.605152 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c653c1b-e519-4f3d-8f5d-2bc8010a3cb0 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:07.610265 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-48a2dc32-fea5-4d70-9549-6495eb82a6f3 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 09 16:19:07.610265 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:19:07.610265 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 16:19:07.610265 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 16:19:07.610265 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 16:19:07.610265 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 16:19:07.610265 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 16:19:07.610265 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 16:19:07.610265 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 09 16:19:07.610265 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:19:07.610265 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 16:19:07.610265 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:19:07.610265 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:19:07.610265 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:19:07.610265 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:19:07.610265 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:19:07.610265 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:19:07.611871 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:19:07.611871 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:19:07.611871 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:19:07.611871 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:19:07.611871 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:19:07.611871 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:19:07.611871 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 16:19:07.611871 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 16:19:07.611871 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 16:19:07.611871 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 16:19:07.611871 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:19:07.611871 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:19:07.611871 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:19:07.611871 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:19:07.611871 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:19:07.611871 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:19:07.612717 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:19:07.612717 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Sep 09 16:19:07.612717 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:19:07.612717 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:19:07.612717 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:19:07.612717 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:19:07.612717 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:19:07.612717 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:19:07.612717 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:19:07.612717 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:19:07.612717 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 16:19:07.612717 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 16:19:07.612717 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 09 16:19:07.612717 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:19:07.613452 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 438/854] 10.222.0.27 () {56 vars in 1114 bytes} [Fri Sep 9 16:19:07 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:19:07.618578 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a2dc32-fea5-4d70-9549-6495eb82a6f3 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:07.637606 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:07.655495 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1bbbe9-fba1-4c1d-a116-1d757a71158e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:07.656651 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1bbbe9-fba1-4c1d-a116-1d757a71158e None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:07.656651 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1bbbe9-fba1-4c1d-a116-1d757a71158e None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:07.656651 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1bbbe9-fba1-4c1d-a116-1d757a71158e None admin] PATH_INFO: `/v3/domains` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:07.657242 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1bbbe9-fba1-4c1d-a116-1d757a71158e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:19:07.657697 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1bbbe9-fba1-4c1d-a116-1d757a71158e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:07.659253 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1bbbe9-fba1-4c1d-a116-1d757a71158e None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:07.674370 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 417/855] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Sep 9 16:19:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:19:07.679410 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1bbbe9-fba1-4c1d-a116-1d757a71158e None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:07.715188 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:07.749534 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a2dc32-fea5-4d70-9549-6495eb82a6f3 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:07.788262 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e53e2d7-1f30-4c00-afc2-ff793d98dc16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:07.788874 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e53e2d7-1f30-4c00-afc2-ff793d98dc16 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:07.789155 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e53e2d7-1f30-4c00-afc2-ff793d98dc16 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:07.789427 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e53e2d7-1f30-4c00-afc2-ff793d98dc16 None admin] PATH_INFO: `/v3/services` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:07.790047 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e53e2d7-1f30-4c00-afc2-ff793d98dc16 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:19:07.790383 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e53e2d7-1f30-4c00-afc2-ff793d98dc16 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:07.792248 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e53e2d7-1f30-4c00-afc2-ff793d98dc16 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:07.795572 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1bbbe9-fba1-4c1d-a116-1d757a71158e None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:07.802656 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 439/856] 10.222.0.27 () {56 vars in 1114 bytes} [Fri Sep 9 16:19:07 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:19:07.804005 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e53e2d7-1f30-4c00-afc2-ff793d98dc16 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:07.837550 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1d3a48-395a-4b63-a951-1484b0892d01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:07.838094 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1d3a48-395a-4b63-a951-1484b0892d01 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:07.838404 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1d3a48-395a-4b63-a951-1484b0892d01 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:07.838676 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1d3a48-395a-4b63-a951-1484b0892d01 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:07.847411 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1d3a48-395a-4b63-a951-1484b0892d01 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:07.848858 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1d3a48-395a-4b63-a951-1484b0892d01 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:07.860103 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-ac1d3a48-395a-4b63-a951-1484b0892d01 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 09 16:19:07.860103 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:19:07.860103 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:19:07.860103 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:19:07.860103 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:19:07.860103 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:19:07.860103 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:19:07.860103 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:19:07.860103 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:19:07.860103 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:19:07.860103 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:19:07.860103 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:19:07.860103 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 16:19:07.860103 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 16:19:07.860103 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 16:19:07.860103 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 16:19:07.861326 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:19:07.861326 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:19:07.861326 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 16:19:07.861326 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 16:19:07.861326 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 16:19:07.861326 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 16:19:07.861326 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:19:07.861326 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:19:07.861326 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:19:07.861326 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:19:07.861326 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:19:07.861326 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 16:19:07.861326 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:19:07.861326 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:19:07.861326 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:19:07.861326 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:19:07.861326 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:19:07.861326 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:19:07.863250 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:19:07.863250 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:19:07.863250 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 16:19:07.863250 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 16:19:07.863250 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 16:19:07.863250 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 16:19:07.863250 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 16:19:07.863250 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 16:19:07.863250 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 09 16:19:07.863250 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 16:19:07.863250 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 418/857] 10.222.0.27 () {56 vars in 1117 bytes} [Fri Sep 9 16:19:07 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:19:07.863846 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9235a64-dd51-4217-927b-4d64e22bffb3 None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:07.863846 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9235a64-dd51-4217-927b-4d64e22bffb3 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:07.863979 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9235a64-dd51-4217-927b-4d64e22bffb3 None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:07.865214 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 419/858] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:19:07 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:19:07.870023 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9235a64-dd51-4217-927b-4d64e22bffb3 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:07.897601 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:07.922902 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e53e2d7-1f30-4c00-afc2-ff793d98dc16 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:07.964370 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45954847-b423-4ee1-8dbc-43cefb278547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:07.964982 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45954847-b423-4ee1-8dbc-43cefb278547 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:07.965257 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45954847-b423-4ee1-8dbc-43cefb278547 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:07.965537 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45954847-b423-4ee1-8dbc-43cefb278547 None admin] PATH_INFO: `/v3/services` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:07.966163 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45954847-b423-4ee1-8dbc-43cefb278547 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:19:07.966493 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45954847-b423-4ee1-8dbc-43cefb278547 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:07.967868 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45954847-b423-4ee1-8dbc-43cefb278547 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:07.972852 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 440/859] 10.222.0.27 () {56 vars in 1114 bytes} [Fri Sep 9 16:19:07 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:19:07.973985 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f536640-14f0-4005-829f-75cb53f19644 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:07.974269 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f536640-14f0-4005-829f-75cb53f19644 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:07.974570 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f536640-14f0-4005-829f-75cb53f19644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:07.984945 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:07.994917 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-9f536640-14f0-4005-829f-75cb53f19644 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:19:07.996144 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-9f536640-14f0-4005-829f-75cb53f19644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:19:08.010634 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9235a64-dd51-4217-927b-4d64e22bffb3 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:08.056491 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda695e1-2298-4466-87cd-33d5023e6e91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:08.057179 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda695e1-2298-4466-87cd-33d5023e6e91 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:08.057459 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda695e1-2298-4466-87cd-33d5023e6e91 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:08.057793 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda695e1-2298-4466-87cd-33d5023e6e91 None admin] PATH_INFO: `/v3/users` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:08.058726 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda695e1-2298-4466-87cd-33d5023e6e91 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:19:08.059048 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda695e1-2298-4466-87cd-33d5023e6e91 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:08.061081 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda695e1-2298-4466-87cd-33d5023e6e91 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:08.088150 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 420/860] 10.222.0.27 () {56 vars in 1149 bytes} [Fri Sep 9 16:19:07 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:19:08.088339 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 441/861] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:19:07 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 16:19:08.089759 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda695e1-2298-4466-87cd-33d5023e6e91 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:08.202764 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda695e1-2298-4466-87cd-33d5023e6e91 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:08.239268 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d99309-da67-4812-a2f8-b5cce0bec872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:08.239993 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d99309-da67-4812-a2f8-b5cce0bec872 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:08.240280 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d99309-da67-4812-a2f8-b5cce0bec872 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:08.240553 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d99309-da67-4812-a2f8-b5cce0bec872 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:08.254132 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:08.317395 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d99309-da67-4812-a2f8-b5cce0bec872 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:08.318891 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d99309-da67-4812-a2f8-b5cce0bec872 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:08.400743 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f536640-14f0-4005-829f-75cb53f19644 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:08.426928 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 421/862] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Sep 9 16:19:08 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 09 16:19:08.432410 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d99309-da67-4812-a2f8-b5cce0bec872 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:08.476501 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:08.489502 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:08.527834 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f536640-14f0-4005-829f-75cb53f19644 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:08.552778 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d99309-da67-4812-a2f8-b5cce0bec872 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:08.569072 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd2b16d-4a5d-4cef-b431-7b6e56fe67ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:08.569708 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd2b16d-4a5d-4cef-b431-7b6e56fe67ee None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:08.569987 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd2b16d-4a5d-4cef-b431-7b6e56fe67ee None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:08.570256 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd2b16d-4a5d-4cef-b431-7b6e56fe67ee None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:08.570880 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd2b16d-4a5d-4cef-b431-7b6e56fe67ee None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:08.572233 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd2b16d-4a5d-4cef-b431-7b6e56fe67ee None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:08.582973 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-9dd2b16d-4a5d-4cef-b431-7b6e56fe67ee None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 09 16:19:08.582973 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:19:08.582973 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 16:19:08.582973 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 16:19:08.582973 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 16:19:08.582973 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 16:19:08.582973 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 16:19:08.582973 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 16:19:08.582973 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 09 16:19:08.582973 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:19:08.582973 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 16:19:08.582973 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:19:08.582973 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:19:08.582973 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:19:08.582973 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:19:08.582973 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:19:08.589204 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:19:08.589204 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:19:08.589204 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:19:08.589204 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:19:08.589204 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:19:08.589204 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:19:08.589204 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:19:08.589204 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 16:19:08.589204 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 16:19:08.589204 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 16:19:08.589204 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 16:19:08.589204 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:19:08.589204 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:19:08.589204 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:19:08.589204 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:19:08.589204 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:19:08.589204 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:19:08.590179 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:19:08.590179 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Sep 09 16:19:08.590179 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:19:08.590179 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:19:08.590179 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:19:08.590179 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:19:08.590179 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:19:08.590179 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:19:08.590179 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:19:08.590179 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:19:08.590179 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 16:19:08.590179 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 16:19:08.590179 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 09 16:19:08.590179 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:19:08.590179 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 442/863] 10.222.0.27 () {56 vars in 1132 bytes} [Fri Sep 9 16:19:08 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 16:19:08.591371 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd2b16d-4a5d-4cef-b431-7b6e56fe67ee None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:08.603119 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d31865-7c64-43b5-b9fd-240bee38e657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:08.603746 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d31865-7c64-43b5-b9fd-240bee38e657 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:08.604022 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d31865-7c64-43b5-b9fd-240bee38e657 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:08.604291 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d31865-7c64-43b5-b9fd-240bee38e657 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:08.614595 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d31865-7c64-43b5-b9fd-240bee38e657 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:08.616117 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d31865-7c64-43b5-b9fd-240bee38e657 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:08.631745 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-c7d31865-7c64-43b5-b9fd-240bee38e657 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 16:19:08.631745 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:19:08.631745 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:19:08.631745 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:19:08.631745 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:19:08.631745 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:19:08.631745 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:19:08.631745 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:19:08.631745 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:19:08.631745 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:19:08.631745 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:19:08.631745 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:19:08.631745 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 16:19:08.631745 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 16:19:08.631745 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 16:19:08.631745 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 16:19:08.632763 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:19:08.632763 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:19:08.632763 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:19:08.632763 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:19:08.632763 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:19:08.632763 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:19:08.632763 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:19:08.632763 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 16:19:08.632763 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:19:08.632763 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:19:08.632763 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:19:08.632763 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:19:08.632763 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:19:08.632763 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:19:08.632763 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:19:08.632763 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:19:08.632763 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 16:19:08.633665 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 16:19:08.633665 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 16:19:08.633665 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 16:19:08.637748 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 422/864] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 16:19:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 16:19:08.638604 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d31865-7c64-43b5-b9fd-240bee38e657 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:08.717231 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd2b16d-4a5d-4cef-b431-7b6e56fe67ee None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:08.746438 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:08.756200 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d31865-7c64-43b5-b9fd-240bee38e657 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:08.757742 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0f38aa-a349-4a18-9e32-35339e8843c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:08.758634 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0f38aa-a349-4a18-9e32-35339e8843c1 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:08.758972 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0f38aa-a349-4a18-9e32-35339e8843c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:08.759248 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0f38aa-a349-4a18-9e32-35339e8843c1 None admin] PATH_INFO: `/v3/services` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:08.760796 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0f38aa-a349-4a18-9e32-35339e8843c1 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:19:08.761100 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0f38aa-a349-4a18-9e32-35339e8843c1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:08.762523 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0f38aa-a349-4a18-9e32-35339e8843c1 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:08.764448 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:08.774207 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 443/865] 10.222.0.27 () {56 vars in 1126 bytes} [Fri Sep 9 16:19:08 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:19:08.775676 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0f38aa-a349-4a18-9e32-35339e8843c1 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:08.801584 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4832bc-dfcd-407f-9bb7-1d115ad0fb80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:08.802600 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4832bc-dfcd-407f-9bb7-1d115ad0fb80 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:08.803435 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4832bc-dfcd-407f-9bb7-1d115ad0fb80 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:08.803719 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4832bc-dfcd-407f-9bb7-1d115ad0fb80 None admin] PATH_INFO: `/v3/domains` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:08.804357 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4832bc-dfcd-407f-9bb7-1d115ad0fb80 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:19:08.804665 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4832bc-dfcd-407f-9bb7-1d115ad0fb80 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:08.806339 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4832bc-dfcd-407f-9bb7-1d115ad0fb80 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:08.820758 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 423/866] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Sep 9 16:19:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 16:19:08.826730 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4832bc-dfcd-407f-9bb7-1d115ad0fb80 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:08.893267 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0f38aa-a349-4a18-9e32-35339e8843c1 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:08.928425 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e36d6e-1333-4706-baf8-de34cedc1018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:08.929047 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e36d6e-1333-4706-baf8-de34cedc1018 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:08.929311 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e36d6e-1333-4706-baf8-de34cedc1018 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:08.929585 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e36d6e-1333-4706-baf8-de34cedc1018 None admin] PATH_INFO: `/v3/services` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:08.930355 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e36d6e-1333-4706-baf8-de34cedc1018 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:19:08.930664 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e36d6e-1333-4706-baf8-de34cedc1018 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:08.932154 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e36d6e-1333-4706-baf8-de34cedc1018 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:08.944450 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 444/867] 10.222.0.27 () {56 vars in 1126 bytes} [Fri Sep 9 16:19:08 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 16:19:08.956290 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4832bc-dfcd-407f-9bb7-1d115ad0fb80 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:08.994134 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b024116-b0d3-44ad-a6d2-c3fa94fc574a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:08.994720 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b024116-b0d3-44ad-a6d2-c3fa94fc574a None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:08.994997 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b024116-b0d3-44ad-a6d2-c3fa94fc574a None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:08.995266 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b024116-b0d3-44ad-a6d2-c3fa94fc574a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:09.003282 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b024116-b0d3-44ad-a6d2-c3fa94fc574a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:09.004768 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b024116-b0d3-44ad-a6d2-c3fa94fc574a None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:09.018203 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-8b024116-b0d3-44ad-a6d2-c3fa94fc574a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 16:19:09.018203 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:19:09.018203 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:19:09.018203 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:19:09.018203 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:19:09.018203 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:19:09.018203 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:19:09.018203 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:19:09.018203 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:19:09.018203 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:19:09.018203 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:19:09.018203 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:19:09.018203 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 16:19:09.018203 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 16:19:09.018203 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 16:19:09.019229 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 16:19:09.019229 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:19:09.019229 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:19:09.019229 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:19:09.019229 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:19:09.019229 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:19:09.019229 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:19:09.019229 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:19:09.019229 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 16:19:09.019229 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:19:09.019229 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:19:09.019229 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:19:09.019229 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:19:09.019229 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:19:09.019229 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:19:09.019229 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:19:09.019229 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:19:09.020137 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 16:19:09.020137 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 16:19:09.020137 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 16:19:09.020137 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 16:19:09.020137 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 16:19:09.020137 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 16:19:09.020137 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 16:19:09.020137 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 16:19:09.020137 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 424/868] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Sep 9 16:19:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:19:09.026419 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e36d6e-1333-4706-baf8-de34cedc1018 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:09.108029 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:09.149041 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e36d6e-1333-4706-baf8-de34cedc1018 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:09.183756 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f33b1d-fb5a-4c8e-a692-0b8f83954ead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:09.184365 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f33b1d-fb5a-4c8e-a692-0b8f83954ead None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:09.184647 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f33b1d-fb5a-4c8e-a692-0b8f83954ead None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:09.185177 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f33b1d-fb5a-4c8e-a692-0b8f83954ead None admin] PATH_INFO: `/v3/projects` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:09.185862 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f33b1d-fb5a-4c8e-a692-0b8f83954ead None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:19:09.186171 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f33b1d-fb5a-4c8e-a692-0b8f83954ead None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:09.187635 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f33b1d-fb5a-4c8e-a692-0b8f83954ead None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:09.200518 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 445/869] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Sep 9 16:19:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:19:09.207002 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b024116-b0d3-44ad-a6d2-c3fa94fc574a None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:09.225204 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:09.320972 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b024116-b0d3-44ad-a6d2-c3fa94fc574a None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:09.356550 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cdae8c-f58b-4642-a154-604bb750ea71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:09.357422 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cdae8c-f58b-4642-a154-604bb750ea71 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:09.357846 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cdae8c-f58b-4642-a154-604bb750ea71 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:09.358260 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cdae8c-f58b-4642-a154-604bb750ea71 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:09.359159 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cdae8c-f58b-4642-a154-604bb750ea71 None admin] RBAC: Adding query filter params (role.id=1966594501e743aebf757851d9cd82a5, scope.project.id=68d6aaafab824657b08ca91f3d46d5f8, user.id=b9d05f3782d24127aa613c8d7ac8041b) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:19:09.359628 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cdae8c-f58b-4642-a154-604bb750ea71 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:09.361242 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cdae8c-f58b-4642-a154-604bb750ea71 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:09.368266 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 425/870] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Sep 9 16:19:09 2022] GET /identity/v3/role_assignments?user.id=b9d05f3782d24127aa613c8d7ac8041b&scope.project.id=68d6aaafab824657b08ca91f3d46d5f8&role.id=1966594501e743aebf757851d9cd82a5 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:19:09.760616 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f416ca-c1db-4710-a423-4e5005b7e527 None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:09.761598 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f416ca-c1db-4710-a423-4e5005b7e527 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:09.762103 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f416ca-c1db-4710-a423-4e5005b7e527 None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:09.763928 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 446/871] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:19:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:19:09.769536 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86451727-c899-44f0-8312-07b831d178ca None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:09.770100 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86451727-c899-44f0-8312-07b831d178ca None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:09.770612 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86451727-c899-44f0-8312-07b831d178ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:09.789346 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-86451727-c899-44f0-8312-07b831d178ca None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:19:09.790996 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-86451727-c899-44f0-8312-07b831d178ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:19:09.864222 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 426/872] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:19:09 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 16:19:10.131408 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f416ca-c1db-4710-a423-4e5005b7e527 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:10.246776 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f416ca-c1db-4710-a423-4e5005b7e527 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:10.274701 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:10.290276 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d41e35-90e3-4570-8cc6-e4639dc7a39b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:10.290938 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d41e35-90e3-4570-8cc6-e4639dc7a39b None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:10.291219 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d41e35-90e3-4570-8cc6-e4639dc7a39b None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:10.291489 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d41e35-90e3-4570-8cc6-e4639dc7a39b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:10.292075 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d41e35-90e3-4570-8cc6-e4639dc7a39b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:10.293445 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d41e35-90e3-4570-8cc6-e4639dc7a39b None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:10.303145 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-12d41e35-90e3-4570-8cc6-e4639dc7a39b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 09 16:19:10.303145 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:19:10.303145 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 16:19:10.303145 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 16:19:10.303145 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 16:19:10.303145 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 16:19:10.303145 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 16:19:10.303145 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 16:19:10.303145 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 09 16:19:10.303145 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:19:10.303145 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 16:19:10.303145 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:19:10.303145 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:19:10.303145 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:19:10.303145 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:19:10.303145 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:19:10.303145 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:19:10.304127 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:19:10.304127 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:19:10.304127 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:19:10.304127 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:19:10.304127 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:19:10.304127 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:19:10.304127 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 16:19:10.304127 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 16:19:10.304127 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 16:19:10.304127 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 16:19:10.304127 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:19:10.304127 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:19:10.304127 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:19:10.304127 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:19:10.304127 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:19:10.304127 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:19:10.304977 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:19:10.304977 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Sep 09 16:19:10.304977 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:19:10.304977 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:19:10.304977 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:19:10.304977 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:19:10.304977 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:19:10.304977 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:19:10.304977 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:19:10.304977 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:19:10.304977 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 16:19:10.304977 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 16:19:10.304977 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 09 16:19:10.304977 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:19:10.307711 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 447/873] 10.222.0.27 () {56 vars in 1126 bytes} [Fri Sep 9 16:19:10 2022] GET /identity/v3/services/object-store => generated 93 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:19:10.318363 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86451727-c899-44f0-8312-07b831d178ca None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:10.320522 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bca5cfc-d0cb-48a0-823b-a8246b20972d None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:10.321025 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bca5cfc-d0cb-48a0-823b-a8246b20972d None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:10.321523 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bca5cfc-d0cb-48a0-823b-a8246b20972d None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:10.323229 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 448/874] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:19:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:19:10.325648 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:10.330950 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9c0c45-49fc-4898-958f-973af4fd4d0b None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:10.331281 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9c0c45-49fc-4898-958f-973af4fd4d0b None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:10.331742 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9c0c45-49fc-4898-958f-973af4fd4d0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:10.353388 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-bd9c0c45-49fc-4898-958f-973af4fd4d0b None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:19:10.354607 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-bd9c0c45-49fc-4898-958f-973af4fd4d0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:19:10.423510 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86451727-c899-44f0-8312-07b831d178ca None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:10.434865 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 449/875] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:19:10 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 16:19:10.460663 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7938ca-a61d-46db-b49e-926b49175ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:10.461566 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7938ca-a61d-46db-b49e-926b49175ae9 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:10.462093 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7938ca-a61d-46db-b49e-926b49175ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:10.462599 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7938ca-a61d-46db-b49e-926b49175ae9 None admin] PATH_INFO: `/v3/services` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:10.463459 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7938ca-a61d-46db-b49e-926b49175ae9 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:19:10.463968 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7938ca-a61d-46db-b49e-926b49175ae9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:10.465548 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7938ca-a61d-46db-b49e-926b49175ae9 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:10.470787 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 427/876] 10.222.0.27 () {56 vars in 1122 bytes} [Fri Sep 9 16:19:10 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:19:10.476634 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9c0c45-49fc-4898-958f-973af4fd4d0b None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:10.587928 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9c0c45-49fc-4898-958f-973af4fd4d0b None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:10.605567 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:10.623588 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0e5702-7aa6-49e9-aaa8-86baeb1fc3ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:10.624250 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0e5702-7aa6-49e9-aaa8-86baeb1fc3ee None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:10.624535 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0e5702-7aa6-49e9-aaa8-86baeb1fc3ee None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:10.624807 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0e5702-7aa6-49e9-aaa8-86baeb1fc3ee None admin] PATH_INFO: `/v3/services` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:10.625431 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0e5702-7aa6-49e9-aaa8-86baeb1fc3ee None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:19:10.625732 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0e5702-7aa6-49e9-aaa8-86baeb1fc3ee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:10.627671 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0e5702-7aa6-49e9-aaa8-86baeb1fc3ee None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:10.632508 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 450/877] 10.222.0.27 () {56 vars in 1122 bytes} [Fri Sep 9 16:19:10 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:19:10.730663 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7938ca-a61d-46db-b49e-926b49175ae9 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:10.810824 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:10.843380 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7938ca-a61d-46db-b49e-926b49175ae9 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:10.879757 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54a80b6-05b7-4997-82dc-08197a13a5ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:10.880715 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54a80b6-05b7-4997-82dc-08197a13a5ba None admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:10.881215 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54a80b6-05b7-4997-82dc-08197a13a5ba None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:10.881685 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54a80b6-05b7-4997-82dc-08197a13a5ba None admin] PATH_INFO: `/v3/services` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:10.882554 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54a80b6-05b7-4997-82dc-08197a13a5ba None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:10.884140 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54a80b6-05b7-4997-82dc-08197a13a5ba None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:10.902994 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 428/878] 10.222.0.27 () {60 vars in 1141 bytes} [Fri Sep 9 16:19:10 2022] POST /identity/v3/services => generated 251 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:19:11.168210 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df17d7a2-cdb3-4bc9-aa45-6c918a80c5e5 None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:11.168722 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df17d7a2-cdb3-4bc9-aa45-6c918a80c5e5 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:11.168809 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df17d7a2-cdb3-4bc9-aa45-6c918a80c5e5 None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:11.170330 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 451/879] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:19:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:19:11.175779 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be70a53f-0ada-4a6c-b01a-d963ace5d7ff None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:11.176069 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be70a53f-0ada-4a6c-b01a-d963ace5d7ff None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:11.176348 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be70a53f-0ada-4a6c-b01a-d963ace5d7ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:11.195102 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-be70a53f-0ada-4a6c-b01a-d963ace5d7ff None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:19:11.196304 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-be70a53f-0ada-4a6c-b01a-d963ace5d7ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:19:11.273539 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 429/880] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:19:11 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 16:19:11.542521 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df17d7a2-cdb3-4bc9-aa45-6c918a80c5e5 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:11.632558 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71c87d6-e3b3-4cc9-bff3-cb7eac91beb2 None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:11.633093 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71c87d6-e3b3-4cc9-bff3-cb7eac91beb2 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:11.633093 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71c87d6-e3b3-4cc9-bff3-cb7eac91beb2 None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:11.634699 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 430/881] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:19:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:19:11.639935 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b23ddc-d12d-4894-b99b-3d66c45f3509 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:11.640226 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b23ddc-d12d-4894-b99b-3d66c45f3509 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:11.640501 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b23ddc-d12d-4894-b99b-3d66c45f3509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:11.653319 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df17d7a2-cdb3-4bc9-aa45-6c918a80c5e5 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:11.659319 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-59b23ddc-d12d-4894-b99b-3d66c45f3509 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:19:11.660520 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-59b23ddc-d12d-4894-b99b-3d66c45f3509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:19:11.689233 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c55fa2-bf32-4169-b5bd-6863182f93a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:11.690381 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c55fa2-bf32-4169-b5bd-6863182f93a2 None admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:11.690659 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c55fa2-bf32-4169-b5bd-6863182f93a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:11.690927 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c55fa2-bf32-4169-b5bd-6863182f93a2 None admin] PATH_INFO: `/v3/services` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:11.691578 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c55fa2-bf32-4169-b5bd-6863182f93a2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:11.692935 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c55fa2-bf32-4169-b5bd-6863182f93a2 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:11.712855 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 452/882] 10.222.0.27 () {60 vars in 1141 bytes} [Fri Sep 9 16:19:11 2022] POST /identity/v3/services => generated 269 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:19:11.728860 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:11.755823 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 431/883] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:19:11 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 16:19:12.032861 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c55fa2-bf32-4169-b5bd-6863182f93a2 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:12.078720 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:12.139151 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c55fa2-bf32-4169-b5bd-6863182f93a2 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:12.174511 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bbd2be-b76f-4c3e-9be7-d73cf67efc64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:12.175138 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bbd2be-b76f-4c3e-9be7-d73cf67efc64 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:12.175402 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bbd2be-b76f-4c3e-9be7-d73cf67efc64 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:12.175667 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bbd2be-b76f-4c3e-9be7-d73cf67efc64 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:12.186342 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bbd2be-b76f-4c3e-9be7-d73cf67efc64 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 16:19:12.191635 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-e4bbd2be-b76f-4c3e-9be7-d73cf67efc64 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 09 16:19:12.191635 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:19:12.191635 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:19:12.191635 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:19:12.191635 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:19:12.191635 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:19:12.191635 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:19:12.191635 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:19:12.191635 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:19:12.191635 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:19:12.191635 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:19:12.191635 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:19:12.191635 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 16:19:12.191635 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 16:19:12.191635 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 16:19:12.191635 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 16:19:12.192759 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 16:19:12.192759 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 16:19:12.192759 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 16:19:12.192759 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 16:19:12.192759 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:19:12.192759 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:19:12.192759 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:19:12.192759 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:19:12.192759 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:19:12.192759 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:19:12.192759 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:19:12.192759 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Sep 09 16:19:12.192759 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:19:12.192759 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:19:12.192759 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:19:12.192759 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:19:12.193884 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:19:12.193884 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:19:12.193884 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:19:12.193884 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:19:12.193884 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 16:19:12.193884 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 16:19:12.193884 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 16:19:12.193884 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 16:19:12.193884 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 16:19:12.193884 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 16:19:12.193884 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 09 16:19:12.193884 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:19:12.193884 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 453/884] 10.222.0.27 () {56 vars in 1120 bytes} [Fri Sep 9 16:19:12 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:19:12.198955 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b23ddc-d12d-4894-b99b-3d66c45f3509 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:12.304785 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b23ddc-d12d-4894-b99b-3d66c45f3509 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:12.343091 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd53e685-a6dc-4a3e-bc53-d58e85b33c57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:12.343702 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd53e685-a6dc-4a3e-bc53-d58e85b33c57 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:12.343986 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd53e685-a6dc-4a3e-bc53-d58e85b33c57 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:12.344318 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd53e685-a6dc-4a3e-bc53-d58e85b33c57 None admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:12.344969 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd53e685-a6dc-4a3e-bc53-d58e85b33c57 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:19:12.345322 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd53e685-a6dc-4a3e-bc53-d58e85b33c57 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:12.346791 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd53e685-a6dc-4a3e-bc53-d58e85b33c57 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:12.355265 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 432/885] 10.222.0.27 () {56 vars in 1115 bytes} [Fri Sep 9 16:19:12 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:19:12.360698 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bbd2be-b76f-4c3e-9be7-d73cf67efc64 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:12.476667 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bbd2be-b76f-4c3e-9be7-d73cf67efc64 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:12.478222 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:12.513314 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72643ca4-c63d-4fe1-9357-e1f9ded6cc8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:12.513945 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72643ca4-c63d-4fe1-9357-e1f9ded6cc8f None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:12.514219 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72643ca4-c63d-4fe1-9357-e1f9ded6cc8f None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:12.514517 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72643ca4-c63d-4fe1-9357-e1f9ded6cc8f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:12.526642 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72643ca4-c63d-4fe1-9357-e1f9ded6cc8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:12.528243 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72643ca4-c63d-4fe1-9357-e1f9ded6cc8f None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:12.542888 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-72643ca4-c63d-4fe1-9357-e1f9ded6cc8f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 16:19:12.542888 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:19:12.542888 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:19:12.542888 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:19:12.542888 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:19:12.542888 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:19:12.542888 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:19:12.542888 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:19:12.542888 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:19:12.542888 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:19:12.542888 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:19:12.542888 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:19:12.542888 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 16:19:12.542888 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 16:19:12.542888 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 16:19:12.542888 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 16:19:12.543839 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:19:12.543839 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:19:12.543839 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:19:12.543839 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:19:12.543839 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:19:12.543839 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:19:12.543839 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:19:12.543839 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Sep 09 16:19:12.543839 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:19:12.543839 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:19:12.543839 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:19:12.543839 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:19:12.543839 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:19:12.543839 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:19:12.543839 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:19:12.543839 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:19:12.543839 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 16:19:12.545193 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 16:19:12.545193 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 16:19:12.545193 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:19:12.545193 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 454/886] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 16:19:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:19:12.550144 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd53e685-a6dc-4a3e-bc53-d58e85b33c57 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:12.600982 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:12.659579 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd53e685-a6dc-4a3e-bc53-d58e85b33c57 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:12.696791 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2446f88c-03f1-4d87-a2f2-7dde7dcee4c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:12.697400 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2446f88c-03f1-4d87-a2f2-7dde7dcee4c1 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:12.697681 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2446f88c-03f1-4d87-a2f2-7dde7dcee4c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:12.697954 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2446f88c-03f1-4d87-a2f2-7dde7dcee4c1 None admin] PATH_INFO: `/v3/domains` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:12.698678 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2446f88c-03f1-4d87-a2f2-7dde7dcee4c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:19:12.698980 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2446f88c-03f1-4d87-a2f2-7dde7dcee4c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:12.700424 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2446f88c-03f1-4d87-a2f2-7dde7dcee4c1 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:12.712971 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 433/887] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Sep 9 16:19:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:19:12.718279 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72643ca4-c63d-4fe1-9357-e1f9ded6cc8f None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:12.835889 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72643ca4-c63d-4fe1-9357-e1f9ded6cc8f None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:12.870584 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbe50cf-6204-4869-aa65-086014f90d44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:12.871217 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbe50cf-6204-4869-aa65-086014f90d44 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:12.871493 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbe50cf-6204-4869-aa65-086014f90d44 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:12.871760 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbe50cf-6204-4869-aa65-086014f90d44 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:12.880113 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbe50cf-6204-4869-aa65-086014f90d44 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:12.881553 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbe50cf-6204-4869-aa65-086014f90d44 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:12.892842 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-0dbe50cf-6204-4869-aa65-086014f90d44 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 09 16:19:12.892842 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:19:12.892842 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:19:12.892842 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:19:12.892842 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:19:12.892842 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:19:12.892842 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:19:12.892842 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:19:12.892842 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:19:12.892842 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:19:12.892842 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:19:12.892842 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:19:12.892842 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 16:19:12.892842 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 16:19:12.892842 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 16:19:12.892842 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 16:19:12.893799 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:19:12.893799 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:19:12.893799 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 16:19:12.893799 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 16:19:12.893799 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 16:19:12.893799 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 16:19:12.893799 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:19:12.893799 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:19:12.893799 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:19:12.893799 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:19:12.893799 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:19:12.893799 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Sep 09 16:19:12.893799 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:19:12.893799 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:19:12.893799 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:19:12.893799 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:19:12.893799 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:19:12.893799 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:19:12.895335 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:19:12.895335 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:19:12.895335 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 16:19:12.895335 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 16:19:12.895335 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 16:19:12.895335 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 16:19:12.895335 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 16:19:12.895335 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 16:19:12.895335 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 09 16:19:12.895335 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:19:12.895335 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 455/888] 10.222.0.27 () {56 vars in 1117 bytes} [Fri Sep 9 16:19:12 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:19:12.896761 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eccd65d-1572-49db-9349-1975894efc38 None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:12.897144 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eccd65d-1572-49db-9349-1975894efc38 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:12.897527 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eccd65d-1572-49db-9349-1975894efc38 None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:12.899333 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 434/889] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:19:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:19:12.899714 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbe50cf-6204-4869-aa65-086014f90d44 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:12.904319 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee23966-9220-43c8-8b79-23f71f7170d1 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:12.904705 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee23966-9220-43c8-8b79-23f71f7170d1 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:12.905085 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee23966-9220-43c8-8b79-23f71f7170d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:12.918566 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:12.925055 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-cee23966-9220-43c8-8b79-23f71f7170d1 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:19:12.927247 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-cee23966-9220-43c8-8b79-23f71f7170d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:19:13.003026 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 435/890] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:19:12 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 16:19:13.011194 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbe50cf-6204-4869-aa65-086014f90d44 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:13.049503 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988e9c14-7d62-46d2-816c-85b8cfe23c0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:13.050509 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988e9c14-7d62-46d2-816c-85b8cfe23c0f None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:13.050989 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988e9c14-7d62-46d2-816c-85b8cfe23c0f None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:13.051470 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988e9c14-7d62-46d2-816c-85b8cfe23c0f None admin] PATH_INFO: `/v3/users` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:13.052433 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988e9c14-7d62-46d2-816c-85b8cfe23c0f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:19:13.052994 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988e9c14-7d62-46d2-816c-85b8cfe23c0f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:13.054681 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988e9c14-7d62-46d2-816c-85b8cfe23c0f None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:13.073695 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 456/891] 10.222.0.27 () {56 vars in 1149 bytes} [Fri Sep 9 16:19:12 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:19:13.079729 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee23966-9220-43c8-8b79-23f71f7170d1 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:13.117770 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:13.190786 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee23966-9220-43c8-8b79-23f71f7170d1 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:13.225610 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c65660-1f34-499e-b0f5-18ba586908cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:13.226569 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c65660-1f34-499e-b0f5-18ba586908cd None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:13.227095 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c65660-1f34-499e-b0f5-18ba586908cd None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:13.227572 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c65660-1f34-499e-b0f5-18ba586908cd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:13.258807 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f81c41d-b31e-4539-8b50-f011233d5f2b None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:13.259329 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f81c41d-b31e-4539-8b50-f011233d5f2b None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:13.259329 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f81c41d-b31e-4539-8b50-f011233d5f2b None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:13.261949 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 457/892] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:19:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 16:19:13.265799 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e625b12a-dea4-4008-80cb-640835c256f8 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:13.266079 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e625b12a-dea4-4008-80cb-640835c256f8 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:13.266381 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e625b12a-dea4-4008-80cb-640835c256f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:13.296034 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-e625b12a-dea4-4008-80cb-640835c256f8 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:19:13.297212 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-e625b12a-dea4-4008-80cb-640835c256f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:19:13.306658 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c65660-1f34-499e-b0f5-18ba586908cd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:13.309278 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c65660-1f34-499e-b0f5-18ba586908cd None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:13.352035 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:13.368702 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 458/893] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:19:13 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 16:19:13.369777 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e625b12a-dea4-4008-80cb-640835c256f8 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:13.376367 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:13.434348 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 436/894] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Sep 9 16:19:13 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 09 16:19:13.437486 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c65660-1f34-499e-b0f5-18ba586908cd None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:13.495171 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e625b12a-dea4-4008-80cb-640835c256f8 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:13.537168 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c662868-881b-46f4-a731-7ac5bf5a3598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:13.538135 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c662868-881b-46f4-a731-7ac5bf5a3598 None admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:13.538661 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c662868-881b-46f4-a731-7ac5bf5a3598 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:13.539688 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c662868-881b-46f4-a731-7ac5bf5a3598 None admin] PATH_INFO: `/v3/services` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:13.540860 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c662868-881b-46f4-a731-7ac5bf5a3598 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:13.542689 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c662868-881b-46f4-a731-7ac5bf5a3598 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:13.552806 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c65660-1f34-499e-b0f5-18ba586908cd None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:13.565498 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 459/895] 10.222.0.27 () {60 vars in 1141 bytes} [Fri Sep 9 16:19:13 2022] POST /identity/v3/services => generated 241 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:19:13.596450 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:13.603014 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c88867b-3759-4aa1-b9e0-08be1e57d04c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:13.604027 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c88867b-3759-4aa1-b9e0-08be1e57d04c None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:13.604578 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c88867b-3759-4aa1-b9e0-08be1e57d04c None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:13.605234 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c88867b-3759-4aa1-b9e0-08be1e57d04c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:13.620636 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c88867b-3759-4aa1-b9e0-08be1e57d04c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:13.622585 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c88867b-3759-4aa1-b9e0-08be1e57d04c None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:13.640025 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c662868-881b-46f4-a731-7ac5bf5a3598 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:13.642045 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-3c88867b-3759-4aa1-b9e0-08be1e57d04c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 16:19:13.642045 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:19:13.642045 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:19:13.642045 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:19:13.642045 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:19:13.642045 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:19:13.642045 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:19:13.642045 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:19:13.642045 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:19:13.642045 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:19:13.642045 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:19:13.642045 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:19:13.642045 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 16:19:13.642045 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 16:19:13.642045 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 16:19:13.642045 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 16:19:13.643253 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:19:13.643253 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:19:13.643253 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:19:13.643253 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:19:13.643253 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:19:13.643253 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:19:13.643253 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:19:13.643253 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 16:19:13.643253 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:19:13.643253 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:19:13.643253 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:19:13.643253 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:19:13.643253 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:19:13.643253 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:19:13.643253 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:19:13.643253 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:19:13.643253 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 16:19:13.644559 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 16:19:13.644559 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 16:19:13.644559 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 16:19:13.644559 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 437/896] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 16:19:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 16:19:13.649812 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c88867b-3759-4aa1-b9e0-08be1e57d04c None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:13.714209 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:13.758046 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c662868-881b-46f4-a731-7ac5bf5a3598 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:13.765469 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c88867b-3759-4aa1-b9e0-08be1e57d04c None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:13.800205 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126e2a43-2d3a-4715-a19e-88c0d48d9fa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:13.800513 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126e2a43-2d3a-4715-a19e-88c0d48d9fa6 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:13.801369 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126e2a43-2d3a-4715-a19e-88c0d48d9fa6 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:13.801369 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126e2a43-2d3a-4715-a19e-88c0d48d9fa6 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:13.801556 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126e2a43-2d3a-4715-a19e-88c0d48d9fa6 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:13.802597 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10744572-8142-405d-8237-e4fbc598685a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:13.803198 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10744572-8142-405d-8237-e4fbc598685a None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:13.803474 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10744572-8142-405d-8237-e4fbc598685a None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:13.803742 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10744572-8142-405d-8237-e4fbc598685a None admin] PATH_INFO: `/v3/domains` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:13.804445 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10744572-8142-405d-8237-e4fbc598685a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:19:13.804928 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10744572-8142-405d-8237-e4fbc598685a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:13.805027 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126e2a43-2d3a-4715-a19e-88c0d48d9fa6 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:13.806134 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10744572-8142-405d-8237-e4fbc598685a None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:13.814073 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-126e2a43-2d3a-4715-a19e-88c0d48d9fa6 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 09 16:19:13.814073 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:19:13.814073 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 16:19:13.814073 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 16:19:13.814073 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 16:19:13.814073 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 16:19:13.814073 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 16:19:13.814073 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 16:19:13.814073 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 09 16:19:13.814073 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:19:13.814073 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 16:19:13.814073 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:19:13.814073 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:19:13.814073 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:19:13.814073 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:19:13.814073 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:19:13.814073 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:19:13.815147 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:19:13.815147 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:19:13.815147 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:19:13.815147 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:19:13.815147 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:19:13.815147 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:19:13.815147 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 16:19:13.815147 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 16:19:13.815147 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 16:19:13.815147 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 16:19:13.815147 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:19:13.815147 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:19:13.815147 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:19:13.815147 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:19:13.815147 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:19:13.815147 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:19:13.816040 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:19:13.816040 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Sep 09 16:19:13.816040 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:19:13.816040 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:19:13.816040 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:19:13.816040 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:19:13.816040 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:19:13.816040 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:19:13.816040 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:19:13.816040 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:19:13.816040 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 16:19:13.816040 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 16:19:13.816040 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 09 16:19:13.816040 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:19:13.816040 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 460/897] 10.222.0.27 () {56 vars in 1114 bytes} [Fri Sep 9 16:19:13 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 16:19:13.821402 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 438/898] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Sep 9 16:19:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:19:13.822469 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126e2a43-2d3a-4715-a19e-88c0d48d9fa6 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:13.826801 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10744572-8142-405d-8237-e4fbc598685a None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:13.876229 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:13.939208 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10744572-8142-405d-8237-e4fbc598685a None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:13.967051 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126e2a43-2d3a-4715-a19e-88c0d48d9fa6 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:13.974956 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2782b1a-48e2-403a-9ab1-3615f0f01668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:13.975575 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2782b1a-48e2-403a-9ab1-3615f0f01668 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:13.975848 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2782b1a-48e2-403a-9ab1-3615f0f01668 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:13.976115 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2782b1a-48e2-403a-9ab1-3615f0f01668 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:13.983082 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2782b1a-48e2-403a-9ab1-3615f0f01668 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:13.984523 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2782b1a-48e2-403a-9ab1-3615f0f01668 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:13.998193 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-c2782b1a-48e2-403a-9ab1-3615f0f01668 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 16:19:13.998193 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:19:13.998193 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:19:13.998193 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:19:13.998193 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:19:13.998193 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:19:13.998193 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:19:13.998193 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:19:13.998193 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:19:13.998193 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:19:13.998193 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:19:13.998193 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:19:13.998193 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 16:19:13.998193 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 16:19:13.998193 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 16:19:13.999162 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 16:19:13.999162 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:19:13.999162 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:19:13.999162 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:19:13.999162 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:19:13.999162 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:19:13.999162 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:19:13.999162 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:19:13.999162 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 16:19:13.999162 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:19:13.999162 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:19:13.999162 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:19:13.999162 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:19:13.999162 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:19:13.999162 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:19:13.999162 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:19:13.999162 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:19:14.000076 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 16:19:14.000076 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 16:19:14.000076 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 16:19:14.000076 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 16:19:14.000076 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 16:19:14.000076 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 16:19:14.000076 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 16:19:14.000076 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 16:19:14.000497 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:14.000570 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 439/899] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Sep 9 16:19:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 16:19:14.006847 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2782b1a-48e2-403a-9ab1-3615f0f01668 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:14.014824 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a496f47-c295-4699-b2cc-d52da2829463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:14.015574 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a496f47-c295-4699-b2cc-d52da2829463 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:14.016473 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a496f47-c295-4699-b2cc-d52da2829463 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:14.016852 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a496f47-c295-4699-b2cc-d52da2829463 None admin] PATH_INFO: `/v3/services` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:14.017616 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a496f47-c295-4699-b2cc-d52da2829463 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:19:14.018008 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a496f47-c295-4699-b2cc-d52da2829463 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:14.020107 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a496f47-c295-4699-b2cc-d52da2829463 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:14.027286 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 461/900] 10.222.0.27 () {56 vars in 1114 bytes} [Fri Sep 9 16:19:13 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 16:19:14.028855 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3322534b-5b0c-430a-abaa-b6bd2fa3ad35 None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:14.029139 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3322534b-5b0c-430a-abaa-b6bd2fa3ad35 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:14.029409 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3322534b-5b0c-430a-abaa-b6bd2fa3ad35 None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:14.031212 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 462/901] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:19:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:19:14.032411 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3322534b-5b0c-430a-abaa-b6bd2fa3ad35 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:14.118587 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2782b1a-48e2-403a-9ab1-3615f0f01668 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:14.121411 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:14.144419 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3322534b-5b0c-430a-abaa-b6bd2fa3ad35 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:14.164828 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65264c0a-9f2d-47d0-96d4-e4a1b75275e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:14.165426 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65264c0a-9f2d-47d0-96d4-e4a1b75275e9 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:14.165699 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65264c0a-9f2d-47d0-96d4-e4a1b75275e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:14.165967 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65264c0a-9f2d-47d0-96d4-e4a1b75275e9 None admin] PATH_INFO: `/v3/projects` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:14.166674 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65264c0a-9f2d-47d0-96d4-e4a1b75275e9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:19:14.166973 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65264c0a-9f2d-47d0-96d4-e4a1b75275e9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:14.168398 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65264c0a-9f2d-47d0-96d4-e4a1b75275e9 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:14.185399 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 440/902] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Sep 9 16:19:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 16:19:14.185399 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ca980e-69a6-46cd-8296-28a1220b0c50 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:14.185399 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ca980e-69a6-46cd-8296-28a1220b0c50 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:14.185399 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ca980e-69a6-46cd-8296-28a1220b0c50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:14.196682 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d30678-87d1-4b2c-b847-4abae428362d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:14.197296 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d30678-87d1-4b2c-b847-4abae428362d None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:14.197578 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d30678-87d1-4b2c-b847-4abae428362d None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:14.197852 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d30678-87d1-4b2c-b847-4abae428362d None admin] PATH_INFO: `/v3/services` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:14.198507 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d30678-87d1-4b2c-b847-4abae428362d None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:19:14.198842 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d30678-87d1-4b2c-b847-4abae428362d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:14.200185 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d30678-87d1-4b2c-b847-4abae428362d None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:14.200421 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-42ca980e-69a6-46cd-8296-28a1220b0c50 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:19:14.201604 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-42ca980e-69a6-46cd-8296-28a1220b0c50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:19:14.207006 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 463/903] 10.222.0.27 () {56 vars in 1114 bytes} [Fri Sep 9 16:19:14 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 16:19:14.211174 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d30678-87d1-4b2c-b847-4abae428362d None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:14.270425 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:14.275240 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 441/904] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:19:14 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 16:19:14.286524 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ca980e-69a6-46cd-8296-28a1220b0c50 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:14.329172 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d30678-87d1-4b2c-b847-4abae428362d None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:14.366012 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565c6e1c-f46f-46a1-a20d-4cf37005e195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:14.367011 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565c6e1c-f46f-46a1-a20d-4cf37005e195 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:14.367502 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565c6e1c-f46f-46a1-a20d-4cf37005e195 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:14.367954 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565c6e1c-f46f-46a1-a20d-4cf37005e195 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:14.368878 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565c6e1c-f46f-46a1-a20d-4cf37005e195 None admin] RBAC: Adding query filter params (role.id=e2a4c6d72b844015a5daa58530c8a567, scope.project.id=68d6aaafab824657b08ca91f3d46d5f8, user.id=b9d05f3782d24127aa613c8d7ac8041b) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:19:14.369379 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565c6e1c-f46f-46a1-a20d-4cf37005e195 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:14.371185 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565c6e1c-f46f-46a1-a20d-4cf37005e195 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:14.377812 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 464/905] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Sep 9 16:19:14 2022] GET /identity/v3/role_assignments?user.id=b9d05f3782d24127aa613c8d7ac8041b&scope.project.id=68d6aaafab824657b08ca91f3d46d5f8&role.id=e2a4c6d72b844015a5daa58530c8a567 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:19:14.409685 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:14.418676 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ca980e-69a6-46cd-8296-28a1220b0c50 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:14.459301 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f171ec4-6138-4a89-ae77-51dfb08e2abf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:14.460420 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f171ec4-6138-4a89-ae77-51dfb08e2abf None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:14.460962 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f171ec4-6138-4a89-ae77-51dfb08e2abf None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:14.461411 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f171ec4-6138-4a89-ae77-51dfb08e2abf None admin] PATH_INFO: `/v3/endpoints` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:14.462329 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f171ec4-6138-4a89-ae77-51dfb08e2abf None admin] RBAC: Adding query filter params (interface=public, service_id=2dbee6d6914f4976a8d1c549fba5f3f3, region_id=RegionOne) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:19:14.462820 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f171ec4-6138-4a89-ae77-51dfb08e2abf None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:14.464459 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f171ec4-6138-4a89-ae77-51dfb08e2abf None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:14.475687 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 442/906] 10.222.0.27 () {56 vars in 1251 bytes} [Fri Sep 9 16:19:14 2022] GET /identity/v3/endpoints?service_id=2dbee6d6914f4976a8d1c549fba5f3f3&interface=public®ion_id=RegionOne => generated 194 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:19:14.477463 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565c6e1c-f46f-46a1-a20d-4cf37005e195 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:14.548338 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f171ec4-6138-4a89-ae77-51dfb08e2abf None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:14.616446 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565c6e1c-f46f-46a1-a20d-4cf37005e195 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:14.646725 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:14.659631 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f171ec4-6138-4a89-ae77-51dfb08e2abf None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:14.661859 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdfd6f7-99e8-4910-9515-be8268db4add None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:14.663501 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdfd6f7-99e8-4910-9515-be8268db4add None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:14.663793 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdfd6f7-99e8-4910-9515-be8268db4add None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:14.664066 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdfd6f7-99e8-4910-9515-be8268db4add None admin] PATH_INFO: `/v3/services` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:14.664670 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdfd6f7-99e8-4910-9515-be8268db4add None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:14.666045 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdfd6f7-99e8-4910-9515-be8268db4add None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:14.678359 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 465/907] 10.222.0.27 () {56 vars in 1087 bytes} [Fri Sep 9 16:19:14 2022] GET /identity/v3/services => generated 1497 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:19:14.709105 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef4dbd9-8d34-46b6-ba11-4112dcbcc2b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:14.710073 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef4dbd9-8d34-46b6-ba11-4112dcbcc2b0 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:14.710615 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef4dbd9-8d34-46b6-ba11-4112dcbcc2b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:14.711086 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef4dbd9-8d34-46b6-ba11-4112dcbcc2b0 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:14.711928 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef4dbd9-8d34-46b6-ba11-4112dcbcc2b0 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:14.713625 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef4dbd9-8d34-46b6-ba11-4112dcbcc2b0 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:14.724546 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-7ef4dbd9-8d34-46b6-ba11-4112dcbcc2b0 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 09 16:19:14.724546 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:19:14.724546 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 16:19:14.724546 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 16:19:14.724546 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 16:19:14.724546 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 16:19:14.724546 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 16:19:14.724546 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 16:19:14.724546 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 09 16:19:14.724546 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 16:19:14.724546 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 16:19:14.724546 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 16:19:14.724546 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:19:14.724546 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:19:14.724546 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:19:14.724546 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:19:14.725555 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:19:14.725555 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:19:14.725555 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:19:14.725555 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:19:14.725555 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:19:14.725555 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:19:14.725555 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:19:14.725555 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 16:19:14.725555 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 16:19:14.725555 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 16:19:14.725555 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 16:19:14.725555 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:19:14.725555 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:19:14.725555 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:19:14.725555 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:19:14.725555 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:19:14.725555 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:19:14.726504 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:19:14.726504 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 16:19:14.726504 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:19:14.726504 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:19:14.726504 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:19:14.726504 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:19:14.726504 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:19:14.726504 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:19:14.726504 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:19:14.726504 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:19:14.726504 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 16:19:14.726504 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 16:19:14.726504 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 09 16:19:14.726504 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 16:19:14.729074 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 443/908] 10.222.0.27 () {56 vars in 1132 bytes} [Fri Sep 9 16:19:14 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 16:19:14.737919 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdfd6f7-99e8-4910-9515-be8268db4add None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:14.853158 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdfd6f7-99e8-4910-9515-be8268db4add None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:14.888837 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83337c7b-3d84-4b57-8062-b0ae5d63126b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:14.889688 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83337c7b-3d84-4b57-8062-b0ae5d63126b None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:14.890114 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83337c7b-3d84-4b57-8062-b0ae5d63126b None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:14.890583 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83337c7b-3d84-4b57-8062-b0ae5d63126b None admin] PATH_INFO: `/v3/services` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:14.891432 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83337c7b-3d84-4b57-8062-b0ae5d63126b None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:19:14.891879 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83337c7b-3d84-4b57-8062-b0ae5d63126b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:14.893927 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83337c7b-3d84-4b57-8062-b0ae5d63126b None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:14.899705 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 466/909] 10.222.0.27 () {56 vars in 1126 bytes} [Fri Sep 9 16:19:14 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:19:14.907417 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef4dbd9-8d34-46b6-ba11-4112dcbcc2b0 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:14.933318 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:15.010514 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef4dbd9-8d34-46b6-ba11-4112dcbcc2b0 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:15.043195 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f705c8f4-37e0-47df-8c66-2452133de0ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:15.043801 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f705c8f4-37e0-47df-8c66-2452133de0ef None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:15.044080 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f705c8f4-37e0-47df-8c66-2452133de0ef None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:15.044348 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f705c8f4-37e0-47df-8c66-2452133de0ef None admin] PATH_INFO: `/v3/services` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:15.044960 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f705c8f4-37e0-47df-8c66-2452133de0ef None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:19:15.045254 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f705c8f4-37e0-47df-8c66-2452133de0ef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:15.046644 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f705c8f4-37e0-47df-8c66-2452133de0ef None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:15.052353 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 444/910] 10.222.0.27 () {56 vars in 1126 bytes} [Fri Sep 9 16:19:14 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:19:15.058260 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83337c7b-3d84-4b57-8062-b0ae5d63126b None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:15.108032 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:15.164427 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83337c7b-3d84-4b57-8062-b0ae5d63126b None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:15.199572 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5f5a5b-c364-4a19-a88f-f58d29f94e9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:15.200451 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5f5a5b-c364-4a19-a88f-f58d29f94e9b None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:15.200902 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5f5a5b-c364-4a19-a88f-f58d29f94e9b None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:15.201361 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5f5a5b-c364-4a19-a88f-f58d29f94e9b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:15.202223 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5f5a5b-c364-4a19-a88f-f58d29f94e9b None admin] RBAC: Adding query filter params (interface=public, service_id=e237bfb656004128b03dcd35651381a1, region_id=RegionOne) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:19:15.202722 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5f5a5b-c364-4a19-a88f-f58d29f94e9b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:15.204262 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5f5a5b-c364-4a19-a88f-f58d29f94e9b None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:15.209924 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 467/911] 10.222.0.27 () {56 vars in 1251 bytes} [Fri Sep 9 16:19:15 2022] GET /identity/v3/endpoints?service_id=e237bfb656004128b03dcd35651381a1&interface=public®ion_id=RegionOne => generated 194 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:19:15.215867 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f705c8f4-37e0-47df-8c66-2452133de0ef None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:15.318486 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:15.333932 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f705c8f4-37e0-47df-8c66-2452133de0ef None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:15.368676 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0fcde1-aa86-4959-8f01-0851c83926c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:15.369625 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0fcde1-aa86-4959-8f01-0851c83926c1 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:15.370126 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0fcde1-aa86-4959-8f01-0851c83926c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:15.370632 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0fcde1-aa86-4959-8f01-0851c83926c1 None admin] PATH_INFO: `/v3/services` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:15.371425 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0fcde1-aa86-4959-8f01-0851c83926c1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:15.372980 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0fcde1-aa86-4959-8f01-0851c83926c1 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:15.379752 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 445/912] 10.222.0.27 () {56 vars in 1087 bytes} [Fri Sep 9 16:19:15 2022] GET /identity/v3/services => generated 1497 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:19:15.934121 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956239d2-fad1-4c3e-8daa-4acb6cc23914 None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:15.934662 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956239d2-fad1-4c3e-8daa-4acb6cc23914 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:15.934742 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956239d2-fad1-4c3e-8daa-4acb6cc23914 None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:15.936503 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 468/913] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:19:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:19:15.942480 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0460b786-40ba-4216-9d6a-243c658cf7bf None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:15.942917 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0460b786-40ba-4216-9d6a-243c658cf7bf None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:15.943109 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0460b786-40ba-4216-9d6a-243c658cf7bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:15.961574 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-0460b786-40ba-4216-9d6a-243c658cf7bf None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:19:15.962855 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-0460b786-40ba-4216-9d6a-243c658cf7bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:19:16.034492 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 446/914] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:19:15 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 16:19:16.322189 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956239d2-fad1-4c3e-8daa-4acb6cc23914 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:16.430380 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956239d2-fad1-4c3e-8daa-4acb6cc23914 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:16.442183 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:16.471542 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159cde36-7c20-4530-a4b2-9cc247e68549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:16.472600 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159cde36-7c20-4530-a4b2-9cc247e68549 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:16.473122 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159cde36-7c20-4530-a4b2-9cc247e68549 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:16.473600 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159cde36-7c20-4530-a4b2-9cc247e68549 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:16.474457 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159cde36-7c20-4530-a4b2-9cc247e68549 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:16.476092 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159cde36-7c20-4530-a4b2-9cc247e68549 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:16.487182 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-159cde36-7c20-4530-a4b2-9cc247e68549 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 09 16:19:16.487182 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:19:16.487182 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 16:19:16.487182 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 16:19:16.487182 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 16:19:16.487182 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 16:19:16.487182 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 16:19:16.487182 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 16:19:16.487182 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 09 16:19:16.487182 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:19:16.487182 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 16:19:16.487182 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:19:16.487182 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:19:16.487182 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:19:16.487182 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:19:16.487182 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:19:16.487182 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:19:16.488301 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:19:16.488301 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:19:16.488301 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:19:16.488301 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:19:16.488301 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:19:16.488301 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:19:16.488301 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 16:19:16.488301 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 16:19:16.488301 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 16:19:16.488301 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 16:19:16.488301 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:19:16.488301 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:19:16.488301 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:19:16.488301 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:19:16.488301 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:19:16.488301 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:19:16.489157 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:19:16.489157 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Sep 09 16:19:16.489157 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:19:16.489157 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:19:16.489157 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:19:16.489157 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:19:16.489157 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:19:16.489157 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:19:16.489157 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:19:16.489157 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:19:16.489157 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 16:19:16.489157 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 16:19:16.489157 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 09 16:19:16.489157 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:19:16.492398 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 469/915] 10.222.0.27 () {56 vars in 1126 bytes} [Fri Sep 9 16:19:16 2022] GET /identity/v3/services/object-store => generated 93 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:19:16.500652 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0460b786-40ba-4216-9d6a-243c658cf7bf None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:16.592330 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f18dfc1-fba4-4eb4-9fb4-33a031ce01cf None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:16.592522 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f18dfc1-fba4-4eb4-9fb4-33a031ce01cf None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:16.592779 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f18dfc1-fba4-4eb4-9fb4-33a031ce01cf None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:16.594236 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 470/916] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:19:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 16:19:16.594920 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:16.600636 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602a2a33-50b5-4721-861d-6c5b087629bf None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:16.600910 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602a2a33-50b5-4721-861d-6c5b087629bf None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:16.601195 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602a2a33-50b5-4721-861d-6c5b087629bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:16.620014 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-602a2a33-50b5-4721-861d-6c5b087629bf None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:19:16.621203 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-602a2a33-50b5-4721-861d-6c5b087629bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:19:16.622384 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0460b786-40ba-4216-9d6a-243c658cf7bf None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:16.665373 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce862fc4-6b32-41df-9e27-633ccb796fc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:16.665983 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce862fc4-6b32-41df-9e27-633ccb796fc6 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:16.666260 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce862fc4-6b32-41df-9e27-633ccb796fc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:16.666564 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce862fc4-6b32-41df-9e27-633ccb796fc6 None admin] PATH_INFO: `/v3/services` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:16.667188 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce862fc4-6b32-41df-9e27-633ccb796fc6 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:19:16.667486 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce862fc4-6b32-41df-9e27-633ccb796fc6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:16.668857 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce862fc4-6b32-41df-9e27-633ccb796fc6 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:16.675978 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 447/917] 10.222.0.27 () {56 vars in 1122 bytes} [Fri Sep 9 16:19:16 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:19:16.681209 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce862fc4-6b32-41df-9e27-633ccb796fc6 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:16.703127 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 471/918] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:19:16 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 16:19:16.794426 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce862fc4-6b32-41df-9e27-633ccb796fc6 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:16.830936 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d800405-dcb3-438e-8ce7-b20ae6b4e1db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:16.831562 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d800405-dcb3-438e-8ce7-b20ae6b4e1db None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:16.831841 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d800405-dcb3-438e-8ce7-b20ae6b4e1db None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:16.832113 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d800405-dcb3-438e-8ce7-b20ae6b4e1db None admin] PATH_INFO: `/v3/services` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:16.832758 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d800405-dcb3-438e-8ce7-b20ae6b4e1db None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:19:16.833057 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d800405-dcb3-438e-8ce7-b20ae6b4e1db None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:16.834515 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d800405-dcb3-438e-8ce7-b20ae6b4e1db None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:16.840899 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 448/919] 10.222.0.27 () {56 vars in 1122 bytes} [Fri Sep 9 16:19:16 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 16:19:16.847170 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602a2a33-50b5-4721-861d-6c5b087629bf None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:16.957995 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1f3dda-ca5d-4fa2-ab61-0a4cd3198be2 None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:16.958528 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1f3dda-ca5d-4fa2-ab61-0a4cd3198be2 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:16.958632 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602a2a33-50b5-4721-861d-6c5b087629bf None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:16.958967 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1f3dda-ca5d-4fa2-ab61-0a4cd3198be2 None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:16.960122 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 449/920] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:19:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 16:19:16.960912 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:16.965686 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de71e92-f259-4467-b7e2-91d8906cb1b9 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:16.965964 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de71e92-f259-4467-b7e2-91d8906cb1b9 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:16.966233 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de71e92-f259-4467-b7e2-91d8906cb1b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:16.984663 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-0de71e92-f259-4467-b7e2-91d8906cb1b9 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:19:16.985841 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-0de71e92-f259-4467-b7e2-91d8906cb1b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:19:16.988046 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:16.998858 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85efdb6-ffb8-4d23-b7fa-f9d069574c49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:16.999627 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85efdb6-ffb8-4d23-b7fa-f9d069574c49 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:16.999907 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85efdb6-ffb8-4d23-b7fa-f9d069574c49 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:17.000181 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85efdb6-ffb8-4d23-b7fa-f9d069574c49 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:17.000875 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85efdb6-ffb8-4d23-b7fa-f9d069574c49 None admin] RBAC: Adding query filter params (interface=public, service_id=9ae9993acf8b47cab1074b9d539113e2, region_id=RegionOne) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:19:17.001181 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85efdb6-ffb8-4d23-b7fa-f9d069574c49 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:17.003096 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85efdb6-ffb8-4d23-b7fa-f9d069574c49 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:17.013475 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 472/921] 10.222.0.27 () {56 vars in 1251 bytes} [Fri Sep 9 16:19:16 2022] GET /identity/v3/endpoints?service_id=9ae9993acf8b47cab1074b9d539113e2&interface=public®ion_id=RegionOne => generated 194 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:19:17.013475 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85efdb6-ffb8-4d23-b7fa-f9d069574c49 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:17.062095 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 450/922] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:19:16 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 16:19:17.062980 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de71e92-f259-4467-b7e2-91d8906cb1b9 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:17.120072 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85efdb6-ffb8-4d23-b7fa-f9d069574c49 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:17.158806 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a786b3-d7d3-479c-89c3-d5f35675f637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:17.159788 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a786b3-d7d3-479c-89c3-d5f35675f637 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:17.160284 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a786b3-d7d3-479c-89c3-d5f35675f637 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:17.160745 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a786b3-d7d3-479c-89c3-d5f35675f637 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:17.171564 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a786b3-d7d3-479c-89c3-d5f35675f637 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 16:19:17.177253 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-02a786b3-d7d3-479c-89c3-d5f35675f637 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 09 16:19:17.177253 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:19:17.177253 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:19:17.177253 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:19:17.177253 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:19:17.177253 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:19:17.177253 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:19:17.177253 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:19:17.177253 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:19:17.177253 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:19:17.177253 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:19:17.177253 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:19:17.177253 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 16:19:17.177253 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 16:19:17.177253 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 16:19:17.177253 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 16:19:17.178215 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 16:19:17.178215 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 16:19:17.178215 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 16:19:17.178215 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 16:19:17.178215 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:19:17.178215 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:19:17.178215 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:19:17.178215 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:19:17.178215 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:19:17.178215 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:19:17.178215 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:19:17.178215 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Sep 09 16:19:17.178215 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:19:17.178215 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:19:17.178215 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:19:17.178215 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:19:17.179073 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:19:17.179073 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:19:17.179073 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:19:17.179073 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:19:17.179073 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 16:19:17.179073 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 16:19:17.179073 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 16:19:17.179073 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 16:19:17.179073 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 16:19:17.179073 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 16:19:17.179073 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 09 16:19:17.179073 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:19:17.180173 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de71e92-f259-4467-b7e2-91d8906cb1b9 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:17.181548 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 473/923] 10.222.0.27 () {56 vars in 1120 bytes} [Fri Sep 9 16:19:17 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:19:17.187590 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a786b3-d7d3-479c-89c3-d5f35675f637 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:17.221419 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:17.230340 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c0af36-202d-4118-86d6-4bb23fcf7120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:17.231132 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c0af36-202d-4118-86d6-4bb23fcf7120 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:17.231436 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c0af36-202d-4118-86d6-4bb23fcf7120 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:17.232247 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c0af36-202d-4118-86d6-4bb23fcf7120 None admin] PATH_INFO: `/v3/services` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:17.232954 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c0af36-202d-4118-86d6-4bb23fcf7120 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:17.234494 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c0af36-202d-4118-86d6-4bb23fcf7120 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:17.250638 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 451/924] 10.222.0.27 () {56 vars in 1087 bytes} [Fri Sep 9 16:19:17 2022] GET /identity/v3/services => generated 1497 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:19:17.313009 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a786b3-d7d3-479c-89c3-d5f35675f637 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:17.353380 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9176d0b9-2480-4094-a957-5c5000d53751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:17.354255 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9176d0b9-2480-4094-a957-5c5000d53751 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:17.354708 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9176d0b9-2480-4094-a957-5c5000d53751 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:17.355152 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9176d0b9-2480-4094-a957-5c5000d53751 None admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:17.355973 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9176d0b9-2480-4094-a957-5c5000d53751 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:19:17.356441 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9176d0b9-2480-4094-a957-5c5000d53751 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:17.357995 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9176d0b9-2480-4094-a957-5c5000d53751 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:17.359202 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c0af36-202d-4118-86d6-4bb23fcf7120 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:17.366645 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:17.367885 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 474/925] 10.222.0.27 () {56 vars in 1115 bytes} [Fri Sep 9 16:19:17 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 16:19:17.376244 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9176d0b9-2480-4094-a957-5c5000d53751 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:17.480762 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:17.492703 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9176d0b9-2480-4094-a957-5c5000d53751 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:17.501372 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c0af36-202d-4118-86d6-4bb23fcf7120 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:17.537783 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c8543a-9631-4a4f-bb3f-59963caafaf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:17.539072 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c8543a-9631-4a4f-bb3f-59963caafaf9 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:17.540132 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c8543a-9631-4a4f-bb3f-59963caafaf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:17.540418 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c8543a-9631-4a4f-bb3f-59963caafaf9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:17.554436 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722749f0-bab3-4429-b935-ab41a56ff7b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:17.555092 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722749f0-bab3-4429-b935-ab41a56ff7b3 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:17.555657 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722749f0-bab3-4429-b935-ab41a56ff7b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:17.555939 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722749f0-bab3-4429-b935-ab41a56ff7b3 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:17.556531 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722749f0-bab3-4429-b935-ab41a56ff7b3 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:17.556903 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c8543a-9631-4a4f-bb3f-59963caafaf9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:17.557930 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722749f0-bab3-4429-b935-ab41a56ff7b3 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:17.559016 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c8543a-9631-4a4f-bb3f-59963caafaf9 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:17.570402 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-722749f0-bab3-4429-b935-ab41a56ff7b3 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 09 16:19:17.570402 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:19:17.570402 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 16:19:17.570402 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 16:19:17.570402 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 16:19:17.570402 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 16:19:17.570402 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 16:19:17.570402 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 16:19:17.570402 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 09 16:19:17.570402 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 16:19:17.570402 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 16:19:17.570402 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 16:19:17.570402 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:19:17.570402 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:19:17.570402 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:19:17.570402 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:19:17.570402 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:19:17.571422 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:19:17.571422 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:19:17.571422 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:19:17.571422 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:19:17.571422 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:19:17.571422 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:19:17.571422 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 16:19:17.571422 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 16:19:17.571422 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 16:19:17.571422 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 16:19:17.571422 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:19:17.571422 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:19:17.571422 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:19:17.571422 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:19:17.571422 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:19:17.571422 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:19:17.572285 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:19:17.572285 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 16:19:17.572285 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:19:17.572285 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:19:17.572285 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:19:17.572285 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:19:17.572285 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:19:17.572285 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:19:17.572285 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:19:17.572285 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:19:17.572285 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 16:19:17.572285 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 16:19:17.572285 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 09 16:19:17.572285 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 16:19:17.572285 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 452/926] 10.222.0.27 () {56 vars in 1114 bytes} [Fri Sep 9 16:19:17 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:19:17.577092 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722749f0-bab3-4429-b935-ab41a56ff7b3 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:17.580788 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-31c8543a-9631-4a4f-bb3f-59963caafaf9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 16:19:17.580788 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:19:17.580788 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:19:17.580788 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:19:17.580788 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:19:17.580788 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:19:17.580788 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:19:17.580788 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:19:17.580788 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:19:17.580788 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:19:17.580788 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:19:17.580788 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:19:17.580788 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 16:19:17.580788 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 16:19:17.580788 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 16:19:17.580788 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 16:19:17.581717 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:19:17.581717 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:19:17.581717 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:19:17.581717 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:19:17.581717 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:19:17.581717 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:19:17.581717 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:19:17.581717 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Sep 09 16:19:17.581717 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:19:17.581717 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:19:17.581717 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:19:17.581717 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:19:17.581717 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:19:17.581717 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:19:17.581717 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:19:17.581717 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:19:17.581717 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 16:19:17.582648 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 16:19:17.582648 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 16:19:17.582648 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:19:17.585732 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 475/927] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 16:19:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 16:19:17.593941 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c8543a-9631-4a4f-bb3f-59963caafaf9 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:17.666988 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:17.705836 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722749f0-bab3-4429-b935-ab41a56ff7b3 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:17.712482 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c8543a-9631-4a4f-bb3f-59963caafaf9 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:17.740915 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9034f0-fa1d-4995-8cd7-b2a0eef2071d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:17.741495 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9034f0-fa1d-4995-8cd7-b2a0eef2071d None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:17.741772 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9034f0-fa1d-4995-8cd7-b2a0eef2071d None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:17.742040 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9034f0-fa1d-4995-8cd7-b2a0eef2071d None admin] PATH_INFO: `/v3/services` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:17.742687 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9034f0-fa1d-4995-8cd7-b2a0eef2071d None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:19:17.742985 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9034f0-fa1d-4995-8cd7-b2a0eef2071d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:17.744361 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9034f0-fa1d-4995-8cd7-b2a0eef2071d None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:17.748211 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9772d5-9bb9-44cc-98ac-1dbe9702e68f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:17.748821 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9772d5-9bb9-44cc-98ac-1dbe9702e68f None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:17.749361 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9772d5-9bb9-44cc-98ac-1dbe9702e68f None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:17.749467 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 453/928] 10.222.0.27 () {56 vars in 1114 bytes} [Fri Sep 9 16:19:17 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:19:17.749545 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9772d5-9bb9-44cc-98ac-1dbe9702e68f None admin] PATH_INFO: `/v3/domains` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:17.750161 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9772d5-9bb9-44cc-98ac-1dbe9702e68f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:19:17.750495 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9772d5-9bb9-44cc-98ac-1dbe9702e68f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:17.752492 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9772d5-9bb9-44cc-98ac-1dbe9702e68f None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:17.755451 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4d5306-c3a4-4482-a9b3-f80af87b2c12 None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:17.755848 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4d5306-c3a4-4482-a9b3-f80af87b2c12 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:17.756132 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4d5306-c3a4-4482-a9b3-f80af87b2c12 None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:17.757500 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 454/929] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:19:17 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:19:17.758058 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4d5306-c3a4-4482-a9b3-f80af87b2c12 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:17.772669 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 476/930] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Sep 9 16:19:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 16:19:17.772669 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce98bc4-60d5-42d6-bb75-56d6c801599b None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:17.772669 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce98bc4-60d5-42d6-bb75-56d6c801599b None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:17.772669 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce98bc4-60d5-42d6-bb75-56d6c801599b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:17.776689 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:17.789518 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-cce98bc4-60d5-42d6-bb75-56d6c801599b None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:19:17.790889 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-cce98bc4-60d5-42d6-bb75-56d6c801599b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:19:17.863233 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 477/931] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:19:17 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 16:19:17.864451 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce98bc4-60d5-42d6-bb75-56d6c801599b None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:17.890333 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4d5306-c3a4-4482-a9b3-f80af87b2c12 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:17.922607 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:17.931526 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c319afe-48af-4ccf-aa0e-84c7cc3465e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:17.932212 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c319afe-48af-4ccf-aa0e-84c7cc3465e9 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:17.932445 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c319afe-48af-4ccf-aa0e-84c7cc3465e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:17.932723 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c319afe-48af-4ccf-aa0e-84c7cc3465e9 None admin] PATH_INFO: `/v3/services` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:17.933352 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c319afe-48af-4ccf-aa0e-84c7cc3465e9 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:19:17.933660 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c319afe-48af-4ccf-aa0e-84c7cc3465e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:17.935411 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c319afe-48af-4ccf-aa0e-84c7cc3465e9 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:17.941705 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 455/932] 10.222.0.27 () {56 vars in 1114 bytes} [Fri Sep 9 16:19:17 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:19:17.946522 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c319afe-48af-4ccf-aa0e-84c7cc3465e9 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:17.993507 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce98bc4-60d5-42d6-bb75-56d6c801599b None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:18.025277 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:18.031689 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72add252-9936-499c-89d0-0afc2f65d2f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:18.032493 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72add252-9936-499c-89d0-0afc2f65d2f5 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:18.032896 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72add252-9936-499c-89d0-0afc2f65d2f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:18.033298 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72add252-9936-499c-89d0-0afc2f65d2f5 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:18.041078 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72add252-9936-499c-89d0-0afc2f65d2f5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:18.042737 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72add252-9936-499c-89d0-0afc2f65d2f5 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:18.056215 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-72add252-9936-499c-89d0-0afc2f65d2f5 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 09 16:19:18.056215 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:19:18.056215 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:19:18.056215 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:19:18.056215 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:19:18.056215 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:19:18.056215 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:19:18.056215 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:19:18.056215 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:19:18.056215 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:19:18.056215 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:19:18.056215 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:19:18.056215 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 16:19:18.056215 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 16:19:18.056215 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 16:19:18.056215 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 16:19:18.057352 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:19:18.057352 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:19:18.057352 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 16:19:18.057352 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 16:19:18.057352 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 16:19:18.057352 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 16:19:18.057352 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:19:18.057352 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:19:18.057352 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:19:18.057352 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:19:18.057352 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:19:18.057352 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Sep 09 16:19:18.057352 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:19:18.057352 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:19:18.057352 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:19:18.057352 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:19:18.057352 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:19:18.057352 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:19:18.058484 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:19:18.058484 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:19:18.058484 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 16:19:18.058484 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 16:19:18.058484 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 16:19:18.058484 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 16:19:18.058484 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 16:19:18.058484 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 16:19:18.058484 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 09 16:19:18.058484 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:19:18.058484 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 478/933] 10.222.0.27 () {56 vars in 1117 bytes} [Fri Sep 9 16:19:17 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:19:18.065366 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72add252-9936-499c-89d0-0afc2f65d2f5 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:18.075266 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c319afe-48af-4ccf-aa0e-84c7cc3465e9 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:18.121315 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1b93cd-327a-4da6-89e9-a20842c5337e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:18.122522 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1b93cd-327a-4da6-89e9-a20842c5337e None admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:18.122984 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1b93cd-327a-4da6-89e9-a20842c5337e None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:18.123707 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1b93cd-327a-4da6-89e9-a20842c5337e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:18.125038 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1b93cd-327a-4da6-89e9-a20842c5337e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:18.127769 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1b93cd-327a-4da6-89e9-a20842c5337e None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:18.156856 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 456/934] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 16:19:17 2022] POST /identity/v3/endpoints => generated 346 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:19:18.167874 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1b93cd-327a-4da6-89e9-a20842c5337e None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:18.194935 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72add252-9936-499c-89d0-0afc2f65d2f5 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:18.229767 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:18.246722 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9ed6d8-e7d4-4ccf-ac2e-df66263ad21f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:18.247932 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9ed6d8-e7d4-4ccf-ac2e-df66263ad21f None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:18.248839 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9ed6d8-e7d4-4ccf-ac2e-df66263ad21f None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:18.249714 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9ed6d8-e7d4-4ccf-ac2e-df66263ad21f None admin] PATH_INFO: `/v3/users` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:18.250811 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9ed6d8-e7d4-4ccf-ac2e-df66263ad21f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:19:18.251305 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9ed6d8-e7d4-4ccf-ac2e-df66263ad21f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:18.253693 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9ed6d8-e7d4-4ccf-ac2e-df66263ad21f None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:18.283769 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 479/935] 10.222.0.27 () {56 vars in 1149 bytes} [Fri Sep 9 16:19:18 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 16:19:18.285045 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9ed6d8-e7d4-4ccf-ac2e-df66263ad21f None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:18.311473 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1b93cd-327a-4da6-89e9-a20842c5337e None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:18.350552 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a921596c-36e4-403c-acfc-48ed1bf51b41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:18.351195 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a921596c-36e4-403c-acfc-48ed1bf51b41 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:18.351474 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a921596c-36e4-403c-acfc-48ed1bf51b41 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:18.351745 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a921596c-36e4-403c-acfc-48ed1bf51b41 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:18.352327 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a921596c-36e4-403c-acfc-48ed1bf51b41 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:18.354072 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a921596c-36e4-403c-acfc-48ed1bf51b41 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:18.356658 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:18.364928 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-a921596c-36e4-403c-acfc-48ed1bf51b41 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 09 16:19:18.364928 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:19:18.364928 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 16:19:18.364928 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 16:19:18.364928 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 16:19:18.364928 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 16:19:18.364928 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 16:19:18.364928 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 16:19:18.364928 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 09 16:19:18.364928 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 16:19:18.364928 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 16:19:18.364928 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 16:19:18.364928 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:19:18.364928 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:19:18.364928 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:19:18.364928 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:19:18.365905 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:19:18.365905 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:19:18.365905 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:19:18.365905 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:19:18.365905 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:19:18.365905 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:19:18.365905 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:19:18.365905 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 16:19:18.365905 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 16:19:18.365905 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 16:19:18.365905 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 16:19:18.365905 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:19:18.365905 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:19:18.365905 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:19:18.365905 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:19:18.365905 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:19:18.365905 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:19:18.366868 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:19:18.366868 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 16:19:18.366868 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:19:18.366868 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:19:18.366868 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:19:18.366868 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:19:18.366868 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:19:18.366868 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:19:18.366868 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:19:18.366868 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:19:18.366868 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 16:19:18.366868 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 16:19:18.366868 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 09 16:19:18.366868 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 16:19:18.366868 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 457/936] 10.222.0.27 () {56 vars in 1132 bytes} [Fri Sep 9 16:19:18 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 16:19:18.373001 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a921596c-36e4-403c-acfc-48ed1bf51b41 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:18.430968 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9ed6d8-e7d4-4ccf-ac2e-df66263ad21f None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:18.483291 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db65f91a-f489-4c3a-a44a-9d65fb98b833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:18.484000 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db65f91a-f489-4c3a-a44a-9d65fb98b833 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:18.484632 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db65f91a-f489-4c3a-a44a-9d65fb98b833 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:18.485007 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db65f91a-f489-4c3a-a44a-9d65fb98b833 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:18.489282 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a921596c-36e4-403c-acfc-48ed1bf51b41 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:18.499226 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db65f91a-f489-4c3a-a44a-9d65fb98b833 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:18.501504 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db65f91a-f489-4c3a-a44a-9d65fb98b833 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:18.506007 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:18.523304 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-db65f91a-f489-4c3a-a44a-9d65fb98b833 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 16:19:18.523304 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:19:18.523304 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:19:18.523304 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:19:18.523304 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:19:18.523304 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:19:18.523304 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:19:18.523304 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:19:18.523304 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:19:18.523304 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:19:18.523304 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:19:18.523304 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:19:18.523304 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 16:19:18.523304 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 16:19:18.523304 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 16:19:18.523304 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 16:19:18.524305 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:19:18.524305 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:19:18.524305 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:19:18.524305 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:19:18.524305 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:19:18.524305 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:19:18.524305 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:19:18.524305 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Sep 09 16:19:18.524305 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:19:18.524305 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:19:18.524305 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:19:18.524305 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:19:18.524305 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:19:18.524305 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:19:18.524305 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:19:18.524305 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:19:18.524305 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 16:19:18.525197 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 16:19:18.525197 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 16:19:18.525197 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:19:18.526379 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 480/937] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 16:19:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 16:19:18.530900 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db65f91a-f489-4c3a-a44a-9d65fb98b833 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:18.537003 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be57ca3a-ed42-4dad-990b-cc90824b60b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:18.537622 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be57ca3a-ed42-4dad-990b-cc90824b60b6 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:18.537906 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be57ca3a-ed42-4dad-990b-cc90824b60b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:18.538155 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be57ca3a-ed42-4dad-990b-cc90824b60b6 None admin] PATH_INFO: `/v3/services` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:18.538896 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be57ca3a-ed42-4dad-990b-cc90824b60b6 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:19:18.539194 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be57ca3a-ed42-4dad-990b-cc90824b60b6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:18.541113 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be57ca3a-ed42-4dad-990b-cc90824b60b6 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:18.548347 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 458/938] 10.222.0.27 () {56 vars in 1126 bytes} [Fri Sep 9 16:19:18 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:19:18.553808 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be57ca3a-ed42-4dad-990b-cc90824b60b6 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:18.658671 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:18.663547 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db65f91a-f489-4c3a-a44a-9d65fb98b833 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:18.665121 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be57ca3a-ed42-4dad-990b-cc90824b60b6 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:18.704609 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a901ca-b306-4973-8c61-d85802e543af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:18.705486 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a901ca-b306-4973-8c61-d85802e543af None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:18.705939 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a901ca-b306-4973-8c61-d85802e543af None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:18.706417 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a901ca-b306-4973-8c61-d85802e543af None admin] PATH_INFO: `/v3/services` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:18.707415 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a901ca-b306-4973-8c61-d85802e543af None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:19:18.707841 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f0f021-2651-4012-9a09-3afcef18d5f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:18.708140 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a901ca-b306-4973-8c61-d85802e543af None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:18.708452 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f0f021-2651-4012-9a09-3afcef18d5f5 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:18.708732 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f0f021-2651-4012-9a09-3afcef18d5f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:18.709005 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f0f021-2651-4012-9a09-3afcef18d5f5 None admin] PATH_INFO: `/v3/domains` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:18.709647 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f0f021-2651-4012-9a09-3afcef18d5f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:19:18.709958 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f0f021-2651-4012-9a09-3afcef18d5f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:18.710779 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a901ca-b306-4973-8c61-d85802e543af None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:18.711471 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f0f021-2651-4012-9a09-3afcef18d5f5 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:18.720991 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 459/939] 10.222.0.27 () {56 vars in 1126 bytes} [Fri Sep 9 16:19:18 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 16:19:18.723859 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a901ca-b306-4973-8c61-d85802e543af None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:18.726956 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 481/940] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Sep 9 16:19:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:19:18.735307 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f0f021-2651-4012-9a09-3afcef18d5f5 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:18.786356 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:18.849273 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a901ca-b306-4973-8c61-d85802e543af None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:18.858627 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f0f021-2651-4012-9a09-3afcef18d5f5 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:18.886717 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2544bc-b8cc-4eb8-8e56-682b8e7f06d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:18.887316 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2544bc-b8cc-4eb8-8e56-682b8e7f06d0 None admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:18.887614 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2544bc-b8cc-4eb8-8e56-682b8e7f06d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:18.887962 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2544bc-b8cc-4eb8-8e56-682b8e7f06d0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:18.888683 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2544bc-b8cc-4eb8-8e56-682b8e7f06d0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:18.890201 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2544bc-b8cc-4eb8-8e56-682b8e7f06d0 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:18.902100 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a721df2b-863b-46c7-aac8-4d69aac0f696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:18.903219 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a721df2b-863b-46c7-aac8-4d69aac0f696 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:18.903924 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a721df2b-863b-46c7-aac8-4d69aac0f696 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:18.903924 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a721df2b-863b-46c7-aac8-4d69aac0f696 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:18.913016 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a721df2b-863b-46c7-aac8-4d69aac0f696 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:18.914557 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a721df2b-863b-46c7-aac8-4d69aac0f696 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:18.921328 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 460/941] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 16:19:18 2022] POST /identity/v3/endpoints => generated 347 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 16:19:18.935477 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-a721df2b-863b-46c7-aac8-4d69aac0f696 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 16:19:18.935477 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:19:18.935477 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:19:18.935477 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:19:18.935477 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:19:18.935477 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:19:18.935477 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:19:18.935477 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:19:18.935477 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:19:18.935477 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:19:18.935477 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:19:18.935477 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:19:18.935477 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 16:19:18.935477 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 16:19:18.935477 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 16:19:18.936460 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 16:19:18.936460 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:19:18.936460 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:19:18.936460 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:19:18.936460 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:19:18.936460 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:19:18.936460 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:19:18.936460 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:19:18.936460 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Sep 09 16:19:18.936460 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:19:18.936460 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:19:18.936460 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:19:18.936460 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:19:18.936460 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:19:18.936460 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:19:18.936460 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:19:18.936460 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:19:18.937388 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 16:19:18.937388 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 16:19:18.937388 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 16:19:18.937388 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 16:19:18.937388 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 16:19:18.937388 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 16:19:18.937388 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 16:19:18.937388 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:19:18.945511 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 482/942] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Sep 9 16:19:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:19:18.947396 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2544bc-b8cc-4eb8-8e56-682b8e7f06d0 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:19.073379 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:19.084468 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2544bc-b8cc-4eb8-8e56-682b8e7f06d0 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:19.124056 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eb628d-9241-4d56-98da-ee2795a7d901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:19.124685 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eb628d-9241-4d56-98da-ee2795a7d901 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:19.124966 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eb628d-9241-4d56-98da-ee2795a7d901 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:19.125239 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eb628d-9241-4d56-98da-ee2795a7d901 None admin] PATH_INFO: `/v3/projects` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:19.125947 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33eb628d-9241-4d56-98da-ee2795a7d901 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:19:19.126253 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33eb628d-9241-4d56-98da-ee2795a7d901 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:19.127942 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33eb628d-9241-4d56-98da-ee2795a7d901 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:19.142134 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 461/943] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Sep 9 16:19:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:19:19.148166 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a721df2b-863b-46c7-aac8-4d69aac0f696 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:19.173428 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:19.261044 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a721df2b-863b-46c7-aac8-4d69aac0f696 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:19.297069 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989e24e8-3e39-4416-b982-f380773e4236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:19.297735 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989e24e8-3e39-4416-b982-f380773e4236 None admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:19.298012 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989e24e8-3e39-4416-b982-f380773e4236 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:19.298284 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989e24e8-3e39-4416-b982-f380773e4236 None admin] PATH_INFO: `/v3/projects/68d6aaafab824657b08ca91f3d46d5f8/users/b9d05f3782d24127aa613c8d7ac8041b/roles/e2a4c6d72b844015a5daa58530c8a567` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:19.301096 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989e24e8-3e39-4416-b982-f380773e4236 None admin] RBAC: Authorizing `identity:create_grant(project_id=68d6aaafab824657b08ca91f3d46d5f8, user_id=b9d05f3782d24127aa613c8d7ac8041b, role_id=e2a4c6d72b844015a5daa58530c8a567)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:19.302561 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989e24e8-3e39-4416-b982-f380773e4236 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:19.319236 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 483/944] 10.222.0.27 () {58 vars in 1439 bytes} [Fri Sep 9 16:19:19 2022] PUT /identity/v3/projects/68d6aaafab824657b08ca91f3d46d5f8/users/b9d05f3782d24127aa613c8d7ac8041b/roles/e2a4c6d72b844015a5daa58530c8a567 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:19:19.607556 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21ea8ce-f963-4b1a-b5fa-218b35a1c5a3 None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:19.607959 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21ea8ce-f963-4b1a-b5fa-218b35a1c5a3 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:19.608138 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21ea8ce-f963-4b1a-b5fa-218b35a1c5a3 None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:19.609698 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 462/945] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:19:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:19:19.615008 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292db266-68d3-4972-bbb4-d93b3735327a None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:19.615298 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292db266-68d3-4972-bbb4-d93b3735327a None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:19.615569 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292db266-68d3-4972-bbb4-d93b3735327a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:19.633843 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-292db266-68d3-4972-bbb4-d93b3735327a None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:19:19.635052 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-292db266-68d3-4972-bbb4-d93b3735327a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:19:19.705323 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 484/946] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:19:19 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 16:19:19.979872 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21ea8ce-f963-4b1a-b5fa-218b35a1c5a3 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:20.089698 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21ea8ce-f963-4b1a-b5fa-218b35a1c5a3 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:20.124953 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccadd998-688e-4e46-aaef-c783fc534108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:20.125579 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccadd998-688e-4e46-aaef-c783fc534108 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:20.125859 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccadd998-688e-4e46-aaef-c783fc534108 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:20.126136 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccadd998-688e-4e46-aaef-c783fc534108 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:20.126825 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccadd998-688e-4e46-aaef-c783fc534108 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:20.128198 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccadd998-688e-4e46-aaef-c783fc534108 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:20.137087 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-ccadd998-688e-4e46-aaef-c783fc534108 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 09 16:19:20.137087 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:19:20.137087 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 16:19:20.137087 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 16:19:20.137087 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 16:19:20.137087 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 16:19:20.137087 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 16:19:20.137087 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 16:19:20.137087 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 09 16:19:20.137087 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 16:19:20.137087 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 16:19:20.137087 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 16:19:20.137087 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:19:20.137087 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:19:20.137087 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:19:20.137087 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:19:20.137087 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:19:20.138042 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:19:20.138042 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:19:20.138042 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:19:20.138042 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:19:20.138042 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:19:20.138042 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:19:20.138042 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 16:19:20.138042 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 16:19:20.138042 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 16:19:20.138042 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 16:19:20.138042 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:19:20.138042 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:19:20.138042 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:19:20.138042 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:19:20.138042 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:19:20.138042 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:19:20.139264 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:19:20.139264 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 16:19:20.139264 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:19:20.139264 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:19:20.139264 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:19:20.139264 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:19:20.139264 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:19:20.139264 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:19:20.139264 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:19:20.139264 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:19:20.139264 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 16:19:20.139264 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 16:19:20.139264 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 09 16:19:20.139264 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 16:19:20.139264 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 463/947] 10.222.0.27 () {56 vars in 1126 bytes} [Fri Sep 9 16:19:19 2022] GET /identity/v3/services/object-store => generated 93 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:19:20.144832 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292db266-68d3-4972-bbb4-d93b3735327a None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:20.155170 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:20.252939 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292db266-68d3-4972-bbb4-d93b3735327a None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:20.302680 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8cdd77-ba0e-4c6c-95df-1a07ef327f14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:20.303312 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8cdd77-ba0e-4c6c-95df-1a07ef327f14 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:20.303590 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8cdd77-ba0e-4c6c-95df-1a07ef327f14 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:20.303861 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8cdd77-ba0e-4c6c-95df-1a07ef327f14 None admin] PATH_INFO: `/v3/services` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:20.304506 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8cdd77-ba0e-4c6c-95df-1a07ef327f14 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:19:20.304810 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8cdd77-ba0e-4c6c-95df-1a07ef327f14 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:20.306252 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8cdd77-ba0e-4c6c-95df-1a07ef327f14 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:20.312699 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 485/948] 10.222.0.27 () {56 vars in 1122 bytes} [Fri Sep 9 16:19:20 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:19:20.318664 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccadd998-688e-4e46-aaef-c783fc534108 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:20.341118 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:20.429115 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccadd998-688e-4e46-aaef-c783fc534108 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:20.430946 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7090197-76dc-48d7-a7a7-2fe369105ba9 None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:20.431340 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7090197-76dc-48d7-a7a7-2fe369105ba9 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:20.431718 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7090197-76dc-48d7-a7a7-2fe369105ba9 None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:20.433439 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 486/949] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:19:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 16:19:20.439004 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b1ad40-9d7d-46d8-a3d0-b679196e0204 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:20.439425 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b1ad40-9d7d-46d8-a3d0-b679196e0204 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:20.439802 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b1ad40-9d7d-46d8-a3d0-b679196e0204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:20.458703 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-07b1ad40-9d7d-46d8-a3d0-b679196e0204 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:19:20.460194 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-07b1ad40-9d7d-46d8-a3d0-b679196e0204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:19:20.467772 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a23691-8f28-4352-bb3d-b38a2edf9eb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:20.468612 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a23691-8f28-4352-bb3d-b38a2edf9eb1 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:20.469039 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a23691-8f28-4352-bb3d-b38a2edf9eb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:20.469449 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a23691-8f28-4352-bb3d-b38a2edf9eb1 None admin] PATH_INFO: `/v3/services` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:20.470215 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a23691-8f28-4352-bb3d-b38a2edf9eb1 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:19:20.471279 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a23691-8f28-4352-bb3d-b38a2edf9eb1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:20.472855 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a23691-8f28-4352-bb3d-b38a2edf9eb1 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:20.478392 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 464/950] 10.222.0.27 () {56 vars in 1122 bytes} [Fri Sep 9 16:19:20 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:19:20.483717 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a23691-8f28-4352-bb3d-b38a2edf9eb1 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:20.554813 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 487/951] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:19:20 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 16:19:20.594684 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:20.606682 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a23691-8f28-4352-bb3d-b38a2edf9eb1 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:20.642098 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7341bc-8b5e-432f-bb77-18a9cb143248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:20.643269 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7341bc-8b5e-432f-bb77-18a9cb143248 None admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:20.643547 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7341bc-8b5e-432f-bb77-18a9cb143248 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:20.643816 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7341bc-8b5e-432f-bb77-18a9cb143248 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:20.644473 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7341bc-8b5e-432f-bb77-18a9cb143248 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:20.645847 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7341bc-8b5e-432f-bb77-18a9cb143248 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:20.668407 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 465/952] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 16:19:20 2022] POST /identity/v3/endpoints => generated 349 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 16:19:20.851827 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b1ad40-9d7d-46d8-a3d0-b679196e0204 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:20.854504 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:20.962562 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b1ad40-9d7d-46d8-a3d0-b679196e0204 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:21.004547 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c872b79-9949-4158-8e80-f066cf8fd7ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:21.005161 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c872b79-9949-4158-8e80-f066cf8fd7ff None admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:21.005443 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c872b79-9949-4158-8e80-f066cf8fd7ff None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:21.005718 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c872b79-9949-4158-8e80-f066cf8fd7ff None admin] PATH_INFO: `/v3/projects` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:21.006390 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c872b79-9949-4158-8e80-f066cf8fd7ff None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:21.007829 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c872b79-9949-4158-8e80-f066cf8fd7ff None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:21.010567 dv-cinder-831247-27-smb devstack@keystone.service[81446]: WARNING keystone.server.flask.common [None req-1c872b79-9949-4158-8e80-f066cf8fd7ff None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 09 16:19:21.029126 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.sql.core [None req-1c872b79-9949-4158-8e80-f066cf8fd7ff None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 09 16:19:21.029126 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 09 16:19:21.029126 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [parameters: {'id': '90377824771f4ba6ab6151a4950ed4c9', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 09 16:19:21.029126 dv-cinder-831247-27-smb devstack@keystone.service[81446]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81446) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 09 16:19:21.037078 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-1c872b79-9949-4158-8e80-f066cf8fd7ff None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 90377824771f4ba6ab6151a4950ed4c9.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 90377824771f4ba6ab6151a4950ed4c9. Sep 09 16:19:21.037078 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:19:21.037078 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 09 16:19:21.037078 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 09 16:19:21.037078 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 09 16:19:21.037078 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 09 16:19:21.037078 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 09 16:19:21.037078 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application result = self._query(query) Sep 09 16:19:21.037078 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 09 16:19:21.037078 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application conn.query(q) Sep 09 16:19:21.037078 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 09 16:19:21.037078 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 09 16:19:21.037078 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 09 16:19:21.037920 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application result.read() Sep 09 16:19:21.037920 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 09 16:19:21.037920 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 09 16:19:21.037920 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 09 16:19:21.037920 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 09 16:19:21.037920 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 09 16:19:21.037920 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 09 16:19:21.037920 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 09 16:19:21.037920 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 09 16:19:21.037920 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 09 16:19:21.037920 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:19:21.037920 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 09 16:19:21.037920 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:19:21.037920 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:19:21.037920 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 09 16:19:21.037920 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 09 16:19:21.037920 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 09 16:19:21.037920 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 09 16:19:21.038915 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 09 16:19:21.038915 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application next(self.gen) Sep 09 16:19:21.038915 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 09 16:19:21.038915 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application yield resource Sep 09 16:19:21.038915 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 09 16:19:21.038915 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application next(self.gen) Sep 09 16:19:21.038915 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 09 16:19:21.038915 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application self.session.rollback() Sep 09 16:19:21.038915 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 09 16:19:21.038915 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application self.force_reraise() Sep 09 16:19:21.038915 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 09 16:19:21.038915 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise self.value Sep 09 16:19:21.038915 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 09 16:19:21.038915 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 09 16:19:21.038915 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 09 16:19:21.038915 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application session.commit() Sep 09 16:19:21.038915 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 09 16:19:21.039835 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 09 16:19:21.039835 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 09 16:19:21.039835 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application self._prepare_impl() Sep 09 16:19:21.039835 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 09 16:19:21.039835 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application self.session.flush() Sep 09 16:19:21.039835 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 09 16:19:21.039835 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application self._flush(objects) Sep 09 16:19:21.039835 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 09 16:19:21.039835 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 09 16:19:21.039835 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 09 16:19:21.039835 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application compat.raise_( Sep 09 16:19:21.039835 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 09 16:19:21.039835 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception Sep 09 16:19:21.039835 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 09 16:19:21.039835 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application flush_context.execute() Sep 09 16:19:21.039835 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 09 16:19:21.039835 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rec.execute(self) Sep 09 16:19:21.040741 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 09 16:19:21.040741 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 09 16:19:21.040741 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 09 16:19:21.040741 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 09 16:19:21.040741 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 09 16:19:21.040741 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 09 16:19:21.040741 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 09 16:19:21.040741 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 09 16:19:21.040741 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 09 16:19:21.040741 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 09 16:19:21.040741 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 09 16:19:21.040741 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 09 16:19:21.040741 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 09 16:19:21.040741 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 09 16:19:21.040741 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 09 16:19:21.041533 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 09 16:19:21.041533 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 09 16:19:21.041533 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception Sep 09 16:19:21.041533 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 09 16:19:21.041533 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 09 16:19:21.041533 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 09 16:19:21.041533 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 09 16:19:21.041533 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 09 16:19:21.041533 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application result = self._query(query) Sep 09 16:19:21.041533 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 09 16:19:21.041533 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application conn.query(q) Sep 09 16:19:21.041533 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 09 16:19:21.041533 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 09 16:19:21.041533 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 09 16:19:21.041533 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application result.read() Sep 09 16:19:21.041533 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 09 16:19:21.041533 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 09 16:19:21.043964 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 09 16:19:21.043964 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 09 16:19:21.043964 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 09 16:19:21.043964 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 09 16:19:21.043964 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 09 16:19:21.043964 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 09 16:19:21.043964 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 09 16:19:21.043964 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 09 16:19:21.043964 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [parameters: {'id': '90377824771f4ba6ab6151a4950ed4c9', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 09 16:19:21.043964 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 09 16:19:21.043964 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:19:21.043964 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 16:19:21.043964 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:19:21.043964 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:19:21.043964 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 09 16:19:21.046098 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 09 16:19:21.046098 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 09 16:19:21.046098 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 09 16:19:21.046098 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Sep 09 16:19:21.046098 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:19:21.046098 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 16:19:21.046098 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:19:21.046098 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:19:21.046098 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:19:21.046098 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:19:21.046098 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:19:21.046098 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:19:21.046098 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:19:21.046098 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:19:21.046098 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:19:21.046098 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:19:21.046098 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:19:21.048402 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:19:21.048402 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 09 16:19:21.048402 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 09 16:19:21.048402 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:19:21.048402 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:19:21.048402 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 09 16:19:21.048402 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 09 16:19:21.048402 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 90377824771f4ba6ab6151a4950ed4c9. Sep 09 16:19:21.048402 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:19:21.048402 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 488/953] 10.222.0.27 () {60 vars in 1140 bytes} [Fri Sep 9 16:19:20 2022] POST /identity/v3/projects => generated 262 bytes in 187 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:19:21.055110 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7341bc-8b5e-432f-bb77-18a9cb143248 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:21.155400 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7341bc-8b5e-432f-bb77-18a9cb143248 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:21.199753 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12fabab-32ef-4696-ad0f-dfd419e0254c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:21.200415 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12fabab-32ef-4696-ad0f-dfd419e0254c None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:21.200692 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12fabab-32ef-4696-ad0f-dfd419e0254c None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:21.200964 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12fabab-32ef-4696-ad0f-dfd419e0254c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:21.209381 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12fabab-32ef-4696-ad0f-dfd419e0254c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:21.210908 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12fabab-32ef-4696-ad0f-dfd419e0254c None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:21.219412 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:21.224698 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-f12fabab-32ef-4696-ad0f-dfd419e0254c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 16:19:21.224698 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:19:21.224698 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:19:21.224698 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:19:21.224698 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:19:21.224698 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:19:21.224698 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:19:21.224698 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:19:21.224698 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:19:21.224698 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:19:21.224698 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:19:21.224698 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:19:21.224698 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 16:19:21.224698 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 16:19:21.224698 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 16:19:21.226819 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 16:19:21.226819 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:19:21.226819 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:19:21.226819 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:19:21.226819 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:19:21.226819 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:19:21.226819 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:19:21.226819 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:19:21.226819 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 16:19:21.226819 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:19:21.226819 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:19:21.226819 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:19:21.226819 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:19:21.226819 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:19:21.226819 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:19:21.226819 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:19:21.226819 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:19:21.229174 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 16:19:21.229174 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 16:19:21.229174 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 16:19:21.229174 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 16:19:21.229174 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 16:19:21.229174 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 16:19:21.229174 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 16:19:21.229174 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 16:19:21.231986 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 466/954] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Sep 9 16:19:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:19:21.232224 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c872b79-9949-4158-8e80-f066cf8fd7ff None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:21.307768 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:21.310762 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a2370d-97c6-450c-a6fb-afe83b3b361f None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:21.311135 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a2370d-97c6-450c-a6fb-afe83b3b361f None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:21.311312 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a2370d-97c6-450c-a6fb-afe83b3b361f None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:21.312892 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 467/955] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:19:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 16:19:21.318401 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85233d1-9e4a-4a87-a0c9-5b941b4dbc20 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:21.318537 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85233d1-9e4a-4a87-a0c9-5b941b4dbc20 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:21.318815 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85233d1-9e4a-4a87-a0c9-5b941b4dbc20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:21.340112 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-d85233d1-9e4a-4a87-a0c9-5b941b4dbc20 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:19:21.342409 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-d85233d1-9e4a-4a87-a0c9-5b941b4dbc20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:19:21.360078 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c872b79-9949-4158-8e80-f066cf8fd7ff None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:21.397203 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d3cc6b-df8c-4983-85e2-7a1928de2259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:21.398765 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d3cc6b-df8c-4983-85e2-7a1928de2259 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:21.399573 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d3cc6b-df8c-4983-85e2-7a1928de2259 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:21.400214 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d3cc6b-df8c-4983-85e2-7a1928de2259 None admin] PATH_INFO: `/v3/projects` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:21.401157 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d3cc6b-df8c-4983-85e2-7a1928de2259 None admin] RBAC: Adding query filter params (name=service) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:19:21.401618 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d3cc6b-df8c-4983-85e2-7a1928de2259 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:21.404794 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d3cc6b-df8c-4983-85e2-7a1928de2259 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:21.439862 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 468/957] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:19:21 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 16:19:21.440220 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 489/957] 10.222.0.27 () {56 vars in 1112 bytes} [Fri Sep 9 16:19:21 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:19:21.535129 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28854863-debd-4f8d-877f-2cc06aceb345 None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:21.535415 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28854863-debd-4f8d-877f-2cc06aceb345 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:21.535683 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28854863-debd-4f8d-877f-2cc06aceb345 None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:21.537346 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 469/958] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:19:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:19:21.543133 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475f2d27-53ca-4dcd-9f26-f86e5d4c8b4f None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:21.543753 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475f2d27-53ca-4dcd-9f26-f86e5d4c8b4f None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:21.544256 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475f2d27-53ca-4dcd-9f26-f86e5d4c8b4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:21.566456 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-475f2d27-53ca-4dcd-9f26-f86e5d4c8b4f None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:19:21.568459 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-475f2d27-53ca-4dcd-9f26-f86e5d4c8b4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:19:21.643123 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 490/959] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:19:21 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 16:19:21.710032 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28854863-debd-4f8d-877f-2cc06aceb345 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:21.817678 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28854863-debd-4f8d-877f-2cc06aceb345 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:21.847015 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:21.855128 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbb05bd-9b8b-479f-9c25-d1d881748ca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:21.855866 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbb05bd-9b8b-479f-9c25-d1d881748ca9 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:21.856208 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbb05bd-9b8b-479f-9c25-d1d881748ca9 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:21.856484 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbb05bd-9b8b-479f-9c25-d1d881748ca9 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:21.857062 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbb05bd-9b8b-479f-9c25-d1d881748ca9 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:21.858519 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbb05bd-9b8b-479f-9c25-d1d881748ca9 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:21.868325 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-cbbb05bd-9b8b-479f-9c25-d1d881748ca9 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 09 16:19:21.868325 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:19:21.868325 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 16:19:21.868325 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 16:19:21.868325 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 16:19:21.868325 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 16:19:21.868325 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 16:19:21.868325 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 16:19:21.868325 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 09 16:19:21.868325 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 16:19:21.868325 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 16:19:21.868325 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 16:19:21.868325 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:19:21.868325 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:19:21.868325 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:19:21.868325 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:19:21.868325 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:19:21.869466 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:19:21.869466 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:19:21.869466 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:19:21.869466 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:19:21.869466 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:19:21.869466 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:19:21.869466 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 16:19:21.869466 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 16:19:21.869466 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 16:19:21.869466 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 16:19:21.869466 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:19:21.869466 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:19:21.869466 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:19:21.869466 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:19:21.869466 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:19:21.869466 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:19:21.870333 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:19:21.870333 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 16:19:21.870333 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:19:21.870333 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:19:21.870333 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:19:21.870333 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:19:21.870333 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:19:21.870333 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:19:21.870333 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:19:21.870333 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:19:21.870333 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 16:19:21.870333 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 16:19:21.870333 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 09 16:19:21.870333 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 16:19:21.870333 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 470/960] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Sep 9 16:19:21 2022] GET /identity/v3/services/compute => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:19:21.875314 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475f2d27-53ca-4dcd-9f26-f86e5d4c8b4f None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:21.921624 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:21.939203 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbb05bd-9b8b-479f-9c25-d1d881748ca9 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:21.980996 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475f2d27-53ca-4dcd-9f26-f86e5d4c8b4f None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:22.017774 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b244408-a26a-4092-97ef-54d30d586138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:22.018413 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b244408-a26a-4092-97ef-54d30d586138 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:22.018691 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b244408-a26a-4092-97ef-54d30d586138 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:22.018958 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b244408-a26a-4092-97ef-54d30d586138 None admin] PATH_INFO: `/v3/services` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:22.019573 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b244408-a26a-4092-97ef-54d30d586138 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:19:22.019868 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b244408-a26a-4092-97ef-54d30d586138 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:22.021230 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b244408-a26a-4092-97ef-54d30d586138 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:22.026521 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 491/961] 10.222.0.27 () {56 vars in 1112 bytes} [Fri Sep 9 16:19:21 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 16:19:22.035398 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b244408-a26a-4092-97ef-54d30d586138 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:22.049413 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbb05bd-9b8b-479f-9c25-d1d881748ca9 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:22.086565 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58d7581-5dbc-41be-b784-118fbb4b447e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:22.087703 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58d7581-5dbc-41be-b784-118fbb4b447e None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:22.088167 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58d7581-5dbc-41be-b784-118fbb4b447e None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:22.088617 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58d7581-5dbc-41be-b784-118fbb4b447e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:22.101305 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58d7581-5dbc-41be-b784-118fbb4b447e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 16:19:22.107172 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-e58d7581-5dbc-41be-b784-118fbb4b447e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 09 16:19:22.107172 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:19:22.107172 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:19:22.107172 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:19:22.107172 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:19:22.107172 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:19:22.107172 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:19:22.107172 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:19:22.107172 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:19:22.107172 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:19:22.107172 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:19:22.107172 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:19:22.107172 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 16:19:22.107172 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 16:19:22.107172 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 16:19:22.107172 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 16:19:22.108111 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 16:19:22.108111 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 16:19:22.108111 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 16:19:22.108111 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 16:19:22.108111 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:19:22.108111 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:19:22.108111 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:19:22.108111 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:19:22.108111 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:19:22.108111 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:19:22.108111 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:19:22.108111 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 16:19:22.108111 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:19:22.108111 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:19:22.108111 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:19:22.108111 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:19:22.108955 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:19:22.108955 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:19:22.108955 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:19:22.108955 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:19:22.108955 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 16:19:22.108955 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 16:19:22.108955 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 16:19:22.108955 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 16:19:22.108955 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 16:19:22.108955 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 16:19:22.108955 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 09 16:19:22.108955 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 16:19:22.116957 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 471/962] 10.222.0.27 () {56 vars in 1120 bytes} [Fri Sep 9 16:19:21 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 16:19:22.118133 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58d7581-5dbc-41be-b784-118fbb4b447e None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:22.142288 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b244408-a26a-4092-97ef-54d30d586138 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:22.153534 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:22.176861 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:22.186394 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59d43b6-ddaf-4765-bfb3-6cd8ec387f62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:22.187195 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59d43b6-ddaf-4765-bfb3-6cd8ec387f62 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:22.187852 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59d43b6-ddaf-4765-bfb3-6cd8ec387f62 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:22.188265 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59d43b6-ddaf-4765-bfb3-6cd8ec387f62 None admin] PATH_INFO: `/v3/services` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:22.189711 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59d43b6-ddaf-4765-bfb3-6cd8ec387f62 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:19:22.190158 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59d43b6-ddaf-4765-bfb3-6cd8ec387f62 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:22.191686 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59d43b6-ddaf-4765-bfb3-6cd8ec387f62 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:22.203477 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 492/963] 10.222.0.27 () {56 vars in 1112 bytes} [Fri Sep 9 16:19:22 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:19:22.238810 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58d7581-5dbc-41be-b784-118fbb4b447e None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:22.291122 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53633135-6511-4d7a-8e1f-49f4e8f5f250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:22.291753 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53633135-6511-4d7a-8e1f-49f4e8f5f250 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:22.292028 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53633135-6511-4d7a-8e1f-49f4e8f5f250 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:22.292294 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53633135-6511-4d7a-8e1f-49f4e8f5f250 None admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:22.292962 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53633135-6511-4d7a-8e1f-49f4e8f5f250 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:19:22.293261 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53633135-6511-4d7a-8e1f-49f4e8f5f250 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:22.302401 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53633135-6511-4d7a-8e1f-49f4e8f5f250 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:22.309343 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 472/964] 10.222.0.27 () {56 vars in 1115 bytes} [Fri Sep 9 16:19:22 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:19:22.311055 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59d43b6-ddaf-4765-bfb3-6cd8ec387f62 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:22.428716 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59d43b6-ddaf-4765-bfb3-6cd8ec387f62 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:22.468998 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd33a9f-f2bc-4ef3-b609-c26c6245174e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:22.469987 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd33a9f-f2bc-4ef3-b609-c26c6245174e None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:22.470539 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd33a9f-f2bc-4ef3-b609-c26c6245174e None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:22.471027 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd33a9f-f2bc-4ef3-b609-c26c6245174e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:22.481787 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd33a9f-f2bc-4ef3-b609-c26c6245174e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:22.483508 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd33a9f-f2bc-4ef3-b609-c26c6245174e None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:22.499758 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-7dd33a9f-f2bc-4ef3-b609-c26c6245174e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 16:19:22.499758 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:19:22.499758 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:19:22.499758 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:19:22.499758 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:19:22.499758 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:19:22.499758 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:19:22.499758 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:19:22.499758 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:19:22.499758 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:19:22.499758 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:19:22.499758 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:19:22.499758 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 16:19:22.499758 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 16:19:22.499758 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 16:19:22.499758 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 16:19:22.500730 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:19:22.500730 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:19:22.500730 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:19:22.500730 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:19:22.500730 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:19:22.500730 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:19:22.500730 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:19:22.500730 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Sep 09 16:19:22.500730 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:19:22.500730 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:19:22.500730 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:19:22.500730 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:19:22.500730 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:19:22.500730 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:19:22.500730 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:19:22.500730 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:19:22.500730 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 16:19:22.501644 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 16:19:22.501644 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 16:19:22.501644 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:19:22.509346 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 493/965] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 16:19:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:19:22.511139 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53633135-6511-4d7a-8e1f-49f4e8f5f250 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:22.634916 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53633135-6511-4d7a-8e1f-49f4e8f5f250 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:22.649337 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:22.670612 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a30fd2-7596-4c8a-aca4-12c7b9034498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:22.671531 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a30fd2-7596-4c8a-aca4-12c7b9034498 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:22.672042 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a30fd2-7596-4c8a-aca4-12c7b9034498 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:22.672503 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a30fd2-7596-4c8a-aca4-12c7b9034498 None admin] PATH_INFO: `/v3/domains` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:22.673320 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a30fd2-7596-4c8a-aca4-12c7b9034498 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:19:22.674362 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a30fd2-7596-4c8a-aca4-12c7b9034498 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:22.675958 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a30fd2-7596-4c8a-aca4-12c7b9034498 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:22.693596 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 473/966] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Sep 9 16:19:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:19:22.695198 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd33a9f-f2bc-4ef3-b609-c26c6245174e None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:22.723619 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:22.802114 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd33a9f-f2bc-4ef3-b609-c26c6245174e None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:22.838872 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a795b5f1-1922-4bbc-b3c3-132107f319fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:22.839867 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a795b5f1-1922-4bbc-b3c3-132107f319fb None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:22.840340 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a795b5f1-1922-4bbc-b3c3-132107f319fb None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:22.840803 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a795b5f1-1922-4bbc-b3c3-132107f319fb None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:22.849538 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a795b5f1-1922-4bbc-b3c3-132107f319fb None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:22.852039 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a795b5f1-1922-4bbc-b3c3-132107f319fb None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:22.871249 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-a795b5f1-1922-4bbc-b3c3-132107f319fb None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 09 16:19:22.871249 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:19:22.871249 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:19:22.871249 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:19:22.871249 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:19:22.871249 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:19:22.871249 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:19:22.871249 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:19:22.871249 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:19:22.871249 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:19:22.871249 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:19:22.871249 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:19:22.871249 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 16:19:22.871249 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 16:19:22.871249 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 16:19:22.871249 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 16:19:22.872748 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:19:22.872748 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:19:22.872748 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 16:19:22.872748 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 16:19:22.872748 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 16:19:22.872748 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 16:19:22.872748 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:19:22.872748 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:19:22.872748 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:19:22.872748 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:19:22.872748 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:19:22.872748 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Sep 09 16:19:22.872748 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:19:22.872748 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:19:22.872748 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:19:22.872748 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:19:22.872748 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:19:22.872748 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:19:22.874287 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:19:22.874287 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:19:22.874287 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 16:19:22.874287 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 16:19:22.874287 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 16:19:22.874287 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 16:19:22.874287 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 16:19:22.874287 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 16:19:22.874287 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 09 16:19:22.874287 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:19:22.882426 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 494/967] 10.222.0.27 () {56 vars in 1117 bytes} [Fri Sep 9 16:19:22 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:19:22.886611 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a30fd2-7596-4c8a-aca4-12c7b9034498 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:22.994658 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a30fd2-7596-4c8a-aca4-12c7b9034498 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:23.013193 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0de5a9-c927-4f34-bbea-6ec521d18dea None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:23.013514 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0de5a9-c927-4f34-bbea-6ec521d18dea None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:23.013752 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0de5a9-c927-4f34-bbea-6ec521d18dea None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:23.015371 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 495/968] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:19:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 16:19:23.021338 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d135c61e-8d29-4b8c-a1a3-5bdb0e3aad9a None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:23.021616 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d135c61e-8d29-4b8c-a1a3-5bdb0e3aad9a None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:23.021883 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d135c61e-8d29-4b8c-a1a3-5bdb0e3aad9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:23.032695 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838e3e13-7ae9-4759-a994-0ca806a32e04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:23.034133 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838e3e13-7ae9-4759-a994-0ca806a32e04 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:23.034631 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838e3e13-7ae9-4759-a994-0ca806a32e04 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:23.035098 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838e3e13-7ae9-4759-a994-0ca806a32e04 None admin] PATH_INFO: `/v3/users` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:23.036599 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838e3e13-7ae9-4759-a994-0ca806a32e04 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:19:23.037172 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838e3e13-7ae9-4759-a994-0ca806a32e04 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:23.039217 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838e3e13-7ae9-4759-a994-0ca806a32e04 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:23.042441 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-d135c61e-8d29-4b8c-a1a3-5bdb0e3aad9a None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:19:23.043890 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-d135c61e-8d29-4b8c-a1a3-5bdb0e3aad9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:19:23.061971 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 474/969] 10.222.0.27 () {56 vars in 1149 bytes} [Fri Sep 9 16:19:22 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:19:23.068360 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838e3e13-7ae9-4759-a994-0ca806a32e04 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:23.102714 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:23.126696 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 496/970] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:19:23 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 16:19:23.188078 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838e3e13-7ae9-4759-a994-0ca806a32e04 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:23.226069 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb253e15-304c-405f-ba6c-ae4826ab66bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:23.226931 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb253e15-304c-405f-ba6c-ae4826ab66bc None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:23.227403 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb253e15-304c-405f-ba6c-ae4826ab66bc None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:23.227814 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb253e15-304c-405f-ba6c-ae4826ab66bc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:23.299895 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb253e15-304c-405f-ba6c-ae4826ab66bc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:23.301343 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb253e15-304c-405f-ba6c-ae4826ab66bc None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:23.332725 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:23.389351 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d135c61e-8d29-4b8c-a1a3-5bdb0e3aad9a None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:23.405175 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:23.405437 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 475/971] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Sep 9 16:19:23 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 09 16:19:23.412740 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb253e15-304c-405f-ba6c-ae4826ab66bc None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:23.521324 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d135c61e-8d29-4b8c-a1a3-5bdb0e3aad9a None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:23.533413 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb253e15-304c-405f-ba6c-ae4826ab66bc None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:23.566188 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5e9a79-328e-42f3-9ea5-5896a192d234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:23.569314 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5e9a79-328e-42f3-9ea5-5896a192d234 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:23.569724 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5e9a79-328e-42f3-9ea5-5896a192d234 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:23.569994 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5e9a79-328e-42f3-9ea5-5896a192d234 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:23.570836 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5e9a79-328e-42f3-9ea5-5896a192d234 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:23.571848 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:23.573833 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5e9a79-328e-42f3-9ea5-5896a192d234 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:23.578791 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a091335-6895-4d0c-8a00-cc07afbae786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:23.579611 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a091335-6895-4d0c-8a00-cc07afbae786 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:23.580557 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a091335-6895-4d0c-8a00-cc07afbae786 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:23.580979 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a091335-6895-4d0c-8a00-cc07afbae786 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:23.585251 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-6b5e9a79-328e-42f3-9ea5-5896a192d234 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 09 16:19:23.585251 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:19:23.585251 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 16:19:23.585251 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 16:19:23.585251 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 16:19:23.585251 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 16:19:23.585251 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 16:19:23.585251 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 16:19:23.585251 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 09 16:19:23.585251 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:19:23.585251 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 16:19:23.585251 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:19:23.585251 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:19:23.585251 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:19:23.585251 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:19:23.585251 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:19:23.585251 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:19:23.586797 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:19:23.586797 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:19:23.586797 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:19:23.586797 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:19:23.586797 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:19:23.586797 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:19:23.586797 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 16:19:23.586797 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 16:19:23.586797 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 16:19:23.586797 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 16:19:23.586797 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:19:23.586797 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:19:23.586797 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:19:23.586797 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:19:23.586797 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:19:23.586797 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:19:23.587927 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:19:23.587927 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Sep 09 16:19:23.587927 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:19:23.587927 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:19:23.587927 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:19:23.587927 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:19:23.587927 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:19:23.587927 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:19:23.587927 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:19:23.587927 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:19:23.587927 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 16:19:23.587927 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 16:19:23.587927 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 09 16:19:23.587927 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:19:23.587927 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 497/972] 10.222.0.27 () {56 vars in 1126 bytes} [Fri Sep 9 16:19:23 2022] GET /identity/v3/services/object-store => generated 93 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 16:19:23.595309 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5e9a79-328e-42f3-9ea5-5896a192d234 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:23.598629 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a091335-6895-4d0c-8a00-cc07afbae786 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:23.600158 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a091335-6895-4d0c-8a00-cc07afbae786 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:23.616062 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-4a091335-6895-4d0c-8a00-cc07afbae786 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 16:19:23.616062 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:19:23.616062 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:19:23.616062 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:19:23.616062 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:19:23.616062 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:19:23.616062 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:19:23.616062 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:19:23.616062 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:19:23.616062 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:19:23.616062 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:19:23.616062 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:19:23.616062 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 16:19:23.616062 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 16:19:23.616062 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 16:19:23.616062 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 16:19:23.617241 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:19:23.617241 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:19:23.617241 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:19:23.617241 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:19:23.617241 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:19:23.617241 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:19:23.617241 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:19:23.617241 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 16:19:23.617241 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:19:23.617241 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:19:23.617241 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:19:23.617241 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:19:23.617241 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:19:23.617241 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:19:23.617241 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:19:23.617241 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:19:23.617241 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 16:19:23.619145 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 16:19:23.619145 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 16:19:23.619145 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 16:19:23.619480 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 476/973] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 16:19:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 16:19:23.626647 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a091335-6895-4d0c-8a00-cc07afbae786 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:23.695497 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:23.724817 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5e9a79-328e-42f3-9ea5-5896a192d234 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:23.742292 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a091335-6895-4d0c-8a00-cc07afbae786 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:23.763906 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb4eca5-499f-4e89-a65a-25a1073c1580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:23.764514 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb4eca5-499f-4e89-a65a-25a1073c1580 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:23.764789 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb4eca5-499f-4e89-a65a-25a1073c1580 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:23.765061 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb4eca5-499f-4e89-a65a-25a1073c1580 None admin] PATH_INFO: `/v3/services` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:23.765670 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb4eca5-499f-4e89-a65a-25a1073c1580 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:19:23.765996 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb4eca5-499f-4e89-a65a-25a1073c1580 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:23.767726 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb4eca5-499f-4e89-a65a-25a1073c1580 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:23.774458 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 498/974] 10.222.0.27 () {56 vars in 1122 bytes} [Fri Sep 9 16:19:23 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:19:23.779882 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb4eca5-499f-4e89-a65a-25a1073c1580 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:23.784577 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c7cc3a-c70c-4053-ba07-3b5b2fa2e9b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:23.785491 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c7cc3a-c70c-4053-ba07-3b5b2fa2e9b5 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:23.785977 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c7cc3a-c70c-4053-ba07-3b5b2fa2e9b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:23.786485 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c7cc3a-c70c-4053-ba07-3b5b2fa2e9b5 None admin] PATH_INFO: `/v3/domains` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:23.787311 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c7cc3a-c70c-4053-ba07-3b5b2fa2e9b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:19:23.787802 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c7cc3a-c70c-4053-ba07-3b5b2fa2e9b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:23.789444 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c7cc3a-c70c-4053-ba07-3b5b2fa2e9b5 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:23.803398 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 477/975] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Sep 9 16:19:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 16:19:23.808991 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c7cc3a-c70c-4053-ba07-3b5b2fa2e9b5 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:23.858688 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:23.893639 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb4eca5-499f-4e89-a65a-25a1073c1580 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:23.916346 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c7cc3a-c70c-4053-ba07-3b5b2fa2e9b5 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:23.934501 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc152f7-aff0-4e36-a04f-e9a36cae6462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:23.935591 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc152f7-aff0-4e36-a04f-e9a36cae6462 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:23.936006 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc152f7-aff0-4e36-a04f-e9a36cae6462 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:23.936603 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc152f7-aff0-4e36-a04f-e9a36cae6462 None admin] PATH_INFO: `/v3/services` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:23.938033 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc152f7-aff0-4e36-a04f-e9a36cae6462 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:19:23.938854 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc152f7-aff0-4e36-a04f-e9a36cae6462 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:23.941032 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc152f7-aff0-4e36-a04f-e9a36cae6462 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:23.949782 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 499/976] 10.222.0.27 () {56 vars in 1122 bytes} [Fri Sep 9 16:19:23 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:19:23.951653 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951261a9-4b4b-4564-a5e3-67c4ab84a5bc None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:23.952072 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951261a9-4b4b-4564-a5e3-67c4ab84a5bc None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:23.952479 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951261a9-4b4b-4564-a5e3-67c4ab84a5bc None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:23.959111 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 500/977] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:19:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:19:23.959111 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951261a9-4b4b-4564-a5e3-67c4ab84a5bc None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:23.966574 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fd9fa8-5c46-44c6-a2ee-80ca1e473196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:23.967270 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fd9fa8-5c46-44c6-a2ee-80ca1e473196 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:23.967547 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fd9fa8-5c46-44c6-a2ee-80ca1e473196 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:23.967810 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fd9fa8-5c46-44c6-a2ee-80ca1e473196 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:23.968821 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:23.976135 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fd9fa8-5c46-44c6-a2ee-80ca1e473196 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:23.977608 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fd9fa8-5c46-44c6-a2ee-80ca1e473196 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:23.989991 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-f1fd9fa8-5c46-44c6-a2ee-80ca1e473196 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 16:19:23.989991 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:19:23.989991 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:19:23.989991 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:19:23.989991 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:19:23.989991 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:19:23.989991 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:19:23.989991 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:19:23.989991 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:19:23.989991 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:19:23.989991 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:19:23.989991 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:19:23.989991 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 16:19:23.989991 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 16:19:23.989991 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 16:19:23.991141 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 16:19:23.991141 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:19:23.991141 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:19:23.991141 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:19:23.991141 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:19:23.991141 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:19:23.991141 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:19:23.991141 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:19:23.991141 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 16:19:23.991141 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:19:23.991141 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:19:23.991141 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:19:23.991141 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:19:23.991141 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:19:23.991141 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:19:23.991141 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:19:23.991141 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:19:23.995257 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 16:19:23.995257 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 16:19:23.995257 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 16:19:23.995257 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 16:19:23.995257 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 16:19:23.995257 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 16:19:23.995257 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 16:19:23.995257 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 16:19:23.995257 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 478/978] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Sep 9 16:19:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:19:23.995257 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7999036-d304-4254-9bc0-37a974b5b5d8 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:23.995257 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7999036-d304-4254-9bc0-37a974b5b5d8 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:23.996345 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7999036-d304-4254-9bc0-37a974b5b5d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:24.011904 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-a7999036-d304-4254-9bc0-37a974b5b5d8 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:19:24.013092 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-a7999036-d304-4254-9bc0-37a974b5b5d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:19:24.078011 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951261a9-4b4b-4564-a5e3-67c4ab84a5bc None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:24.094327 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 479/979] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:19:23 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 16:19:24.094327 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7999036-d304-4254-9bc0-37a974b5b5d8 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:24.126682 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457543c0-98d9-4eb0-b1cc-06d0ed9030ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:24.127360 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457543c0-98d9-4eb0-b1cc-06d0ed9030ad None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:24.127735 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457543c0-98d9-4eb0-b1cc-06d0ed9030ad None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:24.128107 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457543c0-98d9-4eb0-b1cc-06d0ed9030ad None admin] PATH_INFO: `/v3/endpoints` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:24.128926 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457543c0-98d9-4eb0-b1cc-06d0ed9030ad None admin] RBAC: Adding query filter params (interface=admin, service_id=9ae9993acf8b47cab1074b9d539113e2, region_id=RegionOne) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:19:24.129313 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457543c0-98d9-4eb0-b1cc-06d0ed9030ad None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:24.130780 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457543c0-98d9-4eb0-b1cc-06d0ed9030ad None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:24.134098 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:24.137179 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 501/980] 10.222.0.27 () {56 vars in 1249 bytes} [Fri Sep 9 16:19:23 2022] GET /identity/v3/endpoints?service_id=9ae9993acf8b47cab1074b9d539113e2&interface=admin®ion_id=RegionOne => generated 193 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:19:24.144015 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457543c0-98d9-4eb0-b1cc-06d0ed9030ad None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:24.210527 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7999036-d304-4254-9bc0-37a974b5b5d8 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:24.231314 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:24.247597 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fe6344-4bce-493e-a5d6-d09435216832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:24.248449 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fe6344-4bce-493e-a5d6-d09435216832 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:24.248828 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fe6344-4bce-493e-a5d6-d09435216832 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:24.249194 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fe6344-4bce-493e-a5d6-d09435216832 None admin] PATH_INFO: `/v3/projects` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:24.250079 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fe6344-4bce-493e-a5d6-d09435216832 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:19:24.250512 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fe6344-4bce-493e-a5d6-d09435216832 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:24.252568 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fe6344-4bce-493e-a5d6-d09435216832 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:24.270836 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457543c0-98d9-4eb0-b1cc-06d0ed9030ad None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:24.271983 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 480/981] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Sep 9 16:19:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:19:24.282328 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fe6344-4bce-493e-a5d6-d09435216832 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:24.320251 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9a99a9-1733-4267-8116-a8364d4652bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:24.320857 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9a99a9-1733-4267-8116-a8364d4652bf None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:24.321139 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9a99a9-1733-4267-8116-a8364d4652bf None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:24.321409 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9a99a9-1733-4267-8116-a8364d4652bf None admin] PATH_INFO: `/v3/services` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:24.322009 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9a99a9-1733-4267-8116-a8364d4652bf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:24.323410 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9a99a9-1733-4267-8116-a8364d4652bf None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:24.330418 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 502/982] 10.222.0.27 () {56 vars in 1087 bytes} [Fri Sep 9 16:19:24 2022] GET /identity/v3/services => generated 1497 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:19:24.384667 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9a99a9-1733-4267-8116-a8364d4652bf None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:24.412938 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:24.425436 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fe6344-4bce-493e-a5d6-d09435216832 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:24.469652 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6689c9b1-8ac8-4ef4-82f7-84345c633b85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:24.470265 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6689c9b1-8ac8-4ef4-82f7-84345c633b85 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:24.470701 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6689c9b1-8ac8-4ef4-82f7-84345c633b85 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:24.470974 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6689c9b1-8ac8-4ef4-82f7-84345c633b85 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:24.471749 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6689c9b1-8ac8-4ef4-82f7-84345c633b85 None admin] RBAC: Adding query filter params (role.id=e2a4c6d72b844015a5daa58530c8a567, scope.project.id=68d6aaafab824657b08ca91f3d46d5f8, user.id=b9d05f3782d24127aa613c8d7ac8041b) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:19:24.472057 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6689c9b1-8ac8-4ef4-82f7-84345c633b85 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:24.474090 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6689c9b1-8ac8-4ef4-82f7-84345c633b85 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:24.480593 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 481/983] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Sep 9 16:19:24 2022] GET /identity/v3/role_assignments?user.id=b9d05f3782d24127aa613c8d7ac8041b&scope.project.id=68d6aaafab824657b08ca91f3d46d5f8&role.id=e2a4c6d72b844015a5daa58530c8a567 => generated 608 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:19:24.481878 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ab09c6-dc3c-45ee-9535-99d4d7b0857f None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:24.482161 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ab09c6-dc3c-45ee-9535-99d4d7b0857f None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:24.482461 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ab09c6-dc3c-45ee-9535-99d4d7b0857f None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:24.484225 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 482/984] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:19:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:19:24.492771 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14e844a-4056-404e-a5d3-927f710935b7 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:24.493122 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14e844a-4056-404e-a5d3-927f710935b7 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:24.493320 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14e844a-4056-404e-a5d3-927f710935b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:24.516317 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-f14e844a-4056-404e-a5d3-927f710935b7 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:19:24.518144 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-f14e844a-4056-404e-a5d3-927f710935b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:19:24.524188 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9a99a9-1733-4267-8116-a8364d4652bf None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:24.569103 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e6f7b3-d73e-4c18-86a2-6752bff6e1a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:24.569731 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e6f7b3-d73e-4c18-86a2-6752bff6e1a6 None admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:24.570008 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e6f7b3-d73e-4c18-86a2-6752bff6e1a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:24.570278 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e6f7b3-d73e-4c18-86a2-6752bff6e1a6 None admin] PATH_INFO: `/v3/users` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:24.571672 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e6f7b3-d73e-4c18-86a2-6752bff6e1a6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:24.572445 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e6f7b3-d73e-4c18-86a2-6752bff6e1a6 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:24.584152 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:24.591742 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.sql.core [None req-98e6f7b3-d73e-4c18-86a2-6752bff6e1a6 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 09 16:19:24.591742 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 09 16:19:24.591742 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [parameters: {'user_id': 'ecb162fdbc334a638d39caf50491cb70', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 09 16:19:24.591742 dv-cinder-831247-27-smb devstack@keystone.service[81446]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81446) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 09 16:19:24.599365 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-98e6f7b3-d73e-4c18-86a2-6752bff6e1a6 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 09 16:19:24.599365 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:19:24.599365 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 09 16:19:24.599365 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 09 16:19:24.599365 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 09 16:19:24.599365 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 09 16:19:24.599365 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 09 16:19:24.599365 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application result = self._query(query) Sep 09 16:19:24.599365 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 09 16:19:24.599365 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application conn.query(q) Sep 09 16:19:24.599365 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 09 16:19:24.599365 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 09 16:19:24.599365 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 09 16:19:24.599365 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application result.read() Sep 09 16:19:24.599365 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 09 16:19:24.600350 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 09 16:19:24.600350 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 09 16:19:24.600350 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 09 16:19:24.600350 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 09 16:19:24.600350 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 09 16:19:24.600350 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 09 16:19:24.600350 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 09 16:19:24.600350 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 09 16:19:24.600350 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:19:24.600350 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 09 16:19:24.600350 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:19:24.600350 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:19:24.600350 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 09 16:19:24.600350 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 09 16:19:24.600350 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Sep 09 16:19:24.600350 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Sep 09 16:19:24.600350 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 09 16:19:24.600350 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application next(self.gen) Sep 09 16:19:24.601313 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 09 16:19:24.601313 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application yield resource Sep 09 16:19:24.601313 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 09 16:19:24.601313 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application next(self.gen) Sep 09 16:19:24.601313 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 09 16:19:24.601313 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application self.session.rollback() Sep 09 16:19:24.601313 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 09 16:19:24.601313 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application self.force_reraise() Sep 09 16:19:24.601313 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 09 16:19:24.601313 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise self.value Sep 09 16:19:24.601313 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 09 16:19:24.601313 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 09 16:19:24.601313 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 09 16:19:24.601313 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application session.commit() Sep 09 16:19:24.601313 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 09 16:19:24.601313 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 09 16:19:24.601313 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 09 16:19:24.602209 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application self._prepare_impl() Sep 09 16:19:24.602209 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 09 16:19:24.602209 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application self.session.flush() Sep 09 16:19:24.602209 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 09 16:19:24.602209 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application self._flush(objects) Sep 09 16:19:24.602209 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 09 16:19:24.602209 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 09 16:19:24.602209 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 09 16:19:24.602209 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application compat.raise_( Sep 09 16:19:24.602209 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 09 16:19:24.602209 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception Sep 09 16:19:24.602209 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 09 16:19:24.602209 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application flush_context.execute() Sep 09 16:19:24.602209 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 09 16:19:24.602209 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rec.execute(self) Sep 09 16:19:24.602209 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 09 16:19:24.602209 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 09 16:19:24.603255 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 09 16:19:24.603255 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 09 16:19:24.603255 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 09 16:19:24.603255 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application result = connection._execute_20( Sep 09 16:19:24.603255 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 09 16:19:24.603255 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 09 16:19:24.603255 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 09 16:19:24.603255 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 09 16:19:24.603255 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 09 16:19:24.603255 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 09 16:19:24.603255 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 09 16:19:24.603255 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 09 16:19:24.603255 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 09 16:19:24.603255 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 09 16:19:24.603255 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 09 16:19:24.603255 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception Sep 09 16:19:24.604166 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 09 16:19:24.604166 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 09 16:19:24.604166 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 09 16:19:24.604166 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 09 16:19:24.604166 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 09 16:19:24.604166 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application result = self._query(query) Sep 09 16:19:24.604166 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 09 16:19:24.604166 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application conn.query(q) Sep 09 16:19:24.604166 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 09 16:19:24.604166 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 09 16:19:24.604166 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 09 16:19:24.604166 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application result.read() Sep 09 16:19:24.604166 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 09 16:19:24.604166 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 09 16:19:24.604166 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 09 16:19:24.604166 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 09 16:19:24.605003 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 09 16:19:24.605003 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 09 16:19:24.605003 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 09 16:19:24.605003 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 09 16:19:24.605003 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 09 16:19:24.605003 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 09 16:19:24.605003 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [parameters: {'user_id': 'ecb162fdbc334a638d39caf50491cb70', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 09 16:19:24.605003 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 09 16:19:24.605003 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:19:24.605003 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 16:19:24.605003 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:19:24.605003 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:19:24.605003 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:19:24.605003 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:19:24.605003 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:19:24.605814 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:19:24.605814 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:19:24.605814 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:19:24.605814 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:19:24.605814 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:19:24.605814 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:19:24.605814 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:19:24.605814 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 09 16:19:24.605814 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 09 16:19:24.605814 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:19:24.605814 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:19:24.605814 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 16:19:24.605814 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 16:19:24.605814 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 16:19:24.605814 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 16:19:24.605814 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Sep 09 16:19:24.605814 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Sep 09 16:19:24.609586 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Sep 09 16:19:24.609586 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Sep 09 16:19:24.609586 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 09 16:19:24.609586 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 09 16:19:24.609586 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 09 16:19:24.609586 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:19:24.609586 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 503/985] 10.222.0.27 () {60 vars in 1131 bytes} [Fri Sep 9 16:19:24 2022] POST /identity/v3/users => generated 160 bytes in 217 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Sep 09 16:19:24.609586 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e6f7b3-d73e-4c18-86a2-6752bff6e1a6 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:24.624499 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 483/986] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:19:24 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 16:19:24.722895 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e6f7b3-d73e-4c18-86a2-6752bff6e1a6 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:24.759273 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32f58d1-9ae6-41f7-bad8-c9ce4e9ae526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:24.759906 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32f58d1-9ae6-41f7-bad8-c9ce4e9ae526 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:24.760184 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32f58d1-9ae6-41f7-bad8-c9ce4e9ae526 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:24.760454 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32f58d1-9ae6-41f7-bad8-c9ce4e9ae526 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:24.768695 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32f58d1-9ae6-41f7-bad8-c9ce4e9ae526 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:24.770383 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32f58d1-9ae6-41f7-bad8-c9ce4e9ae526 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:24.782055 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-b32f58d1-9ae6-41f7-bad8-c9ce4e9ae526 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 09 16:19:24.782055 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:19:24.782055 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:19:24.782055 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:19:24.782055 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:19:24.782055 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:19:24.782055 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:19:24.782055 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:19:24.782055 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:19:24.782055 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:19:24.782055 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:19:24.782055 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:19:24.782055 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 16:19:24.782055 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 16:19:24.782055 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 16:19:24.782055 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 16:19:24.783154 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:19:24.783154 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:19:24.783154 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 16:19:24.783154 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 16:19:24.783154 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 16:19:24.783154 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 16:19:24.783154 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:19:24.783154 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:19:24.783154 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:19:24.783154 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:19:24.783154 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:19:24.783154 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Sep 09 16:19:24.783154 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:19:24.783154 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:19:24.783154 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:19:24.783154 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:19:24.783154 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:19:24.783154 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:19:24.784334 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:19:24.784334 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:19:24.784334 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 16:19:24.784334 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 16:19:24.784334 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 16:19:24.784334 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 16:19:24.784334 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 16:19:24.784334 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 16:19:24.784334 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 09 16:19:24.784334 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:19:24.784334 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 504/987] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Sep 9 16:19:24 2022] GET /identity/v3/users/cinder => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 16:19:24.790991 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14e844a-4056-404e-a5d3-927f710935b7 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:24.883702 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:24.896383 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14e844a-4056-404e-a5d3-927f710935b7 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:24.913460 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32f58d1-9ae6-41f7-bad8-c9ce4e9ae526 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:24.940018 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aa1a09-65f9-4f60-90c9-07fdf0764f84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:24.940634 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aa1a09-65f9-4f60-90c9-07fdf0764f84 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:24.941016 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aa1a09-65f9-4f60-90c9-07fdf0764f84 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:24.941287 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aa1a09-65f9-4f60-90c9-07fdf0764f84 None admin] PATH_INFO: `/v3/users` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:24.941980 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89aa1a09-65f9-4f60-90c9-07fdf0764f84 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:19:24.942279 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89aa1a09-65f9-4f60-90c9-07fdf0764f84 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:24.943862 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89aa1a09-65f9-4f60-90c9-07fdf0764f84 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:24.981876 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 484/988] 10.222.0.27 () {56 vars in 1101 bytes} [Fri Sep 9 16:19:24 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 16:19:24.989036 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:25.040648 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32f58d1-9ae6-41f7-bad8-c9ce4e9ae526 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:25.080398 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e0c82f-3217-45c8-a09c-95cd782fa5c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:25.081017 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e0c82f-3217-45c8-a09c-95cd782fa5c3 None admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:25.081297 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e0c82f-3217-45c8-a09c-95cd782fa5c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:25.081572 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e0c82f-3217-45c8-a09c-95cd782fa5c3 None admin] PATH_INFO: `/v3/services` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:25.082250 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e0c82f-3217-45c8-a09c-95cd782fa5c3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:25.083681 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e0c82f-3217-45c8-a09c-95cd782fa5c3 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:25.106506 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 505/989] 10.222.0.27 () {60 vars in 1141 bytes} [Fri Sep 9 16:19:24 2022] POST /identity/v3/services => generated 242 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 16:19:26.600563 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35b5e8a-500c-4d84-9c25-18ee352db2c5 None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:26.601053 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35b5e8a-500c-4d84-9c25-18ee352db2c5 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:26.601053 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35b5e8a-500c-4d84-9c25-18ee352db2c5 None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:26.602545 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 485/990] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:19:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:19:26.607687 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a79c38-980d-403e-82f9-538740466063 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:26.608094 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a79c38-980d-403e-82f9-538740466063 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:26.608302 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a79c38-980d-403e-82f9-538740466063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:26.626981 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-90a79c38-980d-403e-82f9-538740466063 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:19:26.628478 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-90a79c38-980d-403e-82f9-538740466063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:19:26.706899 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 506/991] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:19:26 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 16:19:26.796727 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2590bf-9303-48fd-a4a3-e14d49865a59 None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:26.797053 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2590bf-9303-48fd-a4a3-e14d49865a59 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:26.797271 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2590bf-9303-48fd-a4a3-e14d49865a59 None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:26.799412 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 486/992] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:19:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:19:26.804748 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88344f93-5630-405e-8c63-b09c75071365 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:26.805034 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88344f93-5630-405e-8c63-b09c75071365 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:26.805297 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88344f93-5630-405e-8c63-b09c75071365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:26.823430 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-88344f93-5630-405e-8c63-b09c75071365 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:19:26.824596 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-88344f93-5630-405e-8c63-b09c75071365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:19:26.859151 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:26.891504 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 507/993] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:19:26 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 16:19:26.999925 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2590bf-9303-48fd-a4a3-e14d49865a59 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:27.103591 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2590bf-9303-48fd-a4a3-e14d49865a59 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:27.137530 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a450c3-8153-411d-b822-bcddc34e67af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:27.138127 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a450c3-8153-411d-b822-bcddc34e67af None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:27.138440 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a450c3-8153-411d-b822-bcddc34e67af None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:27.138716 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a450c3-8153-411d-b822-bcddc34e67af None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:27.139288 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a450c3-8153-411d-b822-bcddc34e67af None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:27.140661 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a450c3-8153-411d-b822-bcddc34e67af None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:27.149873 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-86a450c3-8153-411d-b822-bcddc34e67af None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 09 16:19:27.149873 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:19:27.149873 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 16:19:27.149873 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 16:19:27.149873 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 16:19:27.149873 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 16:19:27.149873 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 16:19:27.149873 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 16:19:27.149873 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 09 16:19:27.149873 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 16:19:27.149873 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 16:19:27.149873 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 16:19:27.149873 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:19:27.149873 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:19:27.149873 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:19:27.149873 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:19:27.149873 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:19:27.151121 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:19:27.151121 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:19:27.151121 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:19:27.151121 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:19:27.151121 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:19:27.151121 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:19:27.151121 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 16:19:27.151121 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 16:19:27.151121 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 16:19:27.151121 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 16:19:27.151121 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:19:27.151121 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:19:27.151121 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:19:27.151121 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:19:27.151121 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:19:27.151121 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:19:27.152352 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:19:27.152352 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 16:19:27.152352 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:19:27.152352 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:19:27.152352 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:19:27.152352 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:19:27.152352 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:19:27.152352 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:19:27.152352 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:19:27.152352 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:19:27.152352 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 16:19:27.152352 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 16:19:27.152352 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 09 16:19:27.152352 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 16:19:27.154661 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 487/994] 10.222.0.27 () {56 vars in 1126 bytes} [Fri Sep 9 16:19:26 2022] GET /identity/v3/services/object-store => generated 93 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:19:27.155094 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88344f93-5630-405e-8c63-b09c75071365 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:27.156890 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a450c3-8153-411d-b822-bcddc34e67af None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:27.175375 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:27.263909 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88344f93-5630-405e-8c63-b09c75071365 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:27.269871 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a450c3-8153-411d-b822-bcddc34e67af None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:27.301566 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80beb2d4-563f-4ec9-b731-d6a49e721903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:27.302196 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80beb2d4-563f-4ec9-b731-d6a49e721903 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:27.302526 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80beb2d4-563f-4ec9-b731-d6a49e721903 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:27.302801 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80beb2d4-563f-4ec9-b731-d6a49e721903 None admin] PATH_INFO: `/v3/services/image` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:27.303381 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80beb2d4-563f-4ec9-b731-d6a49e721903 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:27.304753 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80beb2d4-563f-4ec9-b731-d6a49e721903 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:27.307602 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682c4c31-af36-41d0-aac0-a99211d71d97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:27.308199 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682c4c31-af36-41d0-aac0-a99211d71d97 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:27.308475 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682c4c31-af36-41d0-aac0-a99211d71d97 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:27.308742 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682c4c31-af36-41d0-aac0-a99211d71d97 None admin] PATH_INFO: `/v3/services` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:27.309347 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682c4c31-af36-41d0-aac0-a99211d71d97 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:19:27.309643 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682c4c31-af36-41d0-aac0-a99211d71d97 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:27.311261 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682c4c31-af36-41d0-aac0-a99211d71d97 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:27.313734 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-80beb2d4-563f-4ec9-b731-d6a49e721903 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 09 16:19:27.313734 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:19:27.313734 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 16:19:27.313734 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 16:19:27.313734 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 16:19:27.313734 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 16:19:27.313734 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 16:19:27.313734 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 16:19:27.313734 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 09 16:19:27.313734 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:19:27.313734 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 16:19:27.313734 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:19:27.313734 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:19:27.313734 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:19:27.313734 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:19:27.313734 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:19:27.313734 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:19:27.315585 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:19:27.315585 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:19:27.315585 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:19:27.315585 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:19:27.315585 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:19:27.315585 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:19:27.315585 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 16:19:27.315585 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 16:19:27.315585 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 16:19:27.315585 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 16:19:27.315585 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:19:27.315585 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:19:27.315585 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:19:27.315585 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:19:27.315585 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:19:27.315585 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:19:27.317055 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:19:27.317055 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Sep 09 16:19:27.317055 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:19:27.317055 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:19:27.317055 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:19:27.317055 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:19:27.317055 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:19:27.317055 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:19:27.317055 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:19:27.317055 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:19:27.317055 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 16:19:27.317055 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 16:19:27.317055 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 09 16:19:27.317055 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:19:27.317055 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 508/995] 10.222.0.27 () {56 vars in 1105 bytes} [Fri Sep 9 16:19:27 2022] GET /identity/v3/services/image => generated 86 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 16:19:27.318638 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5205271b-7cd2-45ea-ae60-5332cbead022 None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:27.318638 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5205271b-7cd2-45ea-ae60-5332cbead022 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:27.318638 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5205271b-7cd2-45ea-ae60-5332cbead022 None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:27.318638 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 509/996] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:19:27 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:19:27.320848 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 488/997] 10.222.0.27 () {56 vars in 1122 bytes} [Fri Sep 9 16:19:27 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 16:19:27.321195 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5205271b-7cd2-45ea-ae60-5332cbead022 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:27.323782 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869e0885-a4b1-4dfe-a379-b8b5d013f9a7 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:27.324068 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869e0885-a4b1-4dfe-a379-b8b5d013f9a7 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:27.324335 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869e0885-a4b1-4dfe-a379-b8b5d013f9a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:27.342254 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-869e0885-a4b1-4dfe-a379-b8b5d013f9a7 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:19:27.343470 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-869e0885-a4b1-4dfe-a379-b8b5d013f9a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:19:27.360437 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:27.408522 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 489/998] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:19:27 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 16:19:27.409257 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869e0885-a4b1-4dfe-a379-b8b5d013f9a7 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:27.423443 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:27.426253 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5205271b-7cd2-45ea-ae60-5332cbead022 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:27.463152 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3087891c-3200-4fa9-905f-8ea0577ef524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:27.463756 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3087891c-3200-4fa9-905f-8ea0577ef524 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:27.464046 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3087891c-3200-4fa9-905f-8ea0577ef524 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:27.464310 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3087891c-3200-4fa9-905f-8ea0577ef524 None admin] PATH_INFO: `/v3/services` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:27.465034 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3087891c-3200-4fa9-905f-8ea0577ef524 None admin] RBAC: Adding query filter params (name=image) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:19:27.465341 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3087891c-3200-4fa9-905f-8ea0577ef524 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:27.466775 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3087891c-3200-4fa9-905f-8ea0577ef524 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:27.472098 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 510/999] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 16:19:27 2022] GET /identity/v3/services?name=image => generated 122 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:19:27.477645 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3087891c-3200-4fa9-905f-8ea0577ef524 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:27.536488 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869e0885-a4b1-4dfe-a379-b8b5d013f9a7 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:27.570406 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0a07db-59e4-45c5-aa6b-b8441508fce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:27.571260 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0a07db-59e4-45c5-aa6b-b8441508fce1 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:27.571744 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0a07db-59e4-45c5-aa6b-b8441508fce1 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:27.572198 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0a07db-59e4-45c5-aa6b-b8441508fce1 None admin] PATH_INFO: `/v3/services` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:27.573016 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0a07db-59e4-45c5-aa6b-b8441508fce1 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:19:27.573512 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0a07db-59e4-45c5-aa6b-b8441508fce1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:27.574982 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0a07db-59e4-45c5-aa6b-b8441508fce1 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:27.580636 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 490/1000] 10.222.0.27 () {56 vars in 1122 bytes} [Fri Sep 9 16:19:27 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:19:27.581371 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:27.584573 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3087891c-3200-4fa9-905f-8ea0577ef524 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:27.586484 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0a07db-59e4-45c5-aa6b-b8441508fce1 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:27.623218 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ba2df9-7952-494f-acbc-473dac524f61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:27.623824 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ba2df9-7952-494f-acbc-473dac524f61 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:27.624095 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ba2df9-7952-494f-acbc-473dac524f61 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:27.624363 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ba2df9-7952-494f-acbc-473dac524f61 None admin] PATH_INFO: `/v3/services` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:27.624978 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ba2df9-7952-494f-acbc-473dac524f61 None admin] RBAC: Adding query filter params (type=image) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:19:27.625276 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ba2df9-7952-494f-acbc-473dac524f61 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:27.626715 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ba2df9-7952-494f-acbc-473dac524f61 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:27.642720 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 511/1001] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 16:19:27 2022] GET /identity/v3/services?type=image => generated 122 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 16:19:27.674139 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:27.687841 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ba2df9-7952-494f-acbc-473dac524f61 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:27.713433 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0a07db-59e4-45c5-aa6b-b8441508fce1 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:27.754695 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6639d401-6c29-4127-9ac9-9f6448e897d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:27.755323 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6639d401-6c29-4127-9ac9-9f6448e897d8 None admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:27.755600 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6639d401-6c29-4127-9ac9-9f6448e897d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:27.755872 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6639d401-6c29-4127-9ac9-9f6448e897d8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:27.756541 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6639d401-6c29-4127-9ac9-9f6448e897d8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:27.757950 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6639d401-6c29-4127-9ac9-9f6448e897d8 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:27.782539 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 491/1002] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 16:19:27 2022] POST /identity/v3/endpoints => generated 325 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 16:19:27.804337 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ba2df9-7952-494f-acbc-473dac524f61 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:27.851268 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08856773-81c0-421b-b23e-d28295d0e97e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:27.851935 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08856773-81c0-421b-b23e-d28295d0e97e None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:27.852206 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08856773-81c0-421b-b23e-d28295d0e97e None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:27.852473 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08856773-81c0-421b-b23e-d28295d0e97e None admin] PATH_INFO: `/v3/services/compute` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:27.853054 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08856773-81c0-421b-b23e-d28295d0e97e None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:27.854551 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08856773-81c0-421b-b23e-d28295d0e97e None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:27.864030 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-08856773-81c0-421b-b23e-d28295d0e97e None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 09 16:19:27.864030 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:19:27.864030 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 16:19:27.864030 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 16:19:27.864030 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 16:19:27.864030 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 16:19:27.864030 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 16:19:27.864030 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 16:19:27.864030 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 09 16:19:27.864030 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:19:27.864030 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 16:19:27.864030 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:19:27.864030 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:19:27.864030 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:19:27.864030 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:19:27.864030 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:19:27.864030 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:19:27.865324 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:19:27.865324 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:19:27.865324 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:19:27.865324 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:19:27.865324 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:19:27.865324 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:19:27.865324 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 16:19:27.865324 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 16:19:27.865324 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 16:19:27.865324 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 16:19:27.865324 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:19:27.865324 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:19:27.865324 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:19:27.865324 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:19:27.865324 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:19:27.865324 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:19:27.866551 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:19:27.866551 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Sep 09 16:19:27.866551 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:19:27.866551 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:19:27.866551 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:19:27.866551 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:19:27.866551 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:19:27.866551 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:19:27.866551 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:19:27.866551 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:19:27.866551 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 16:19:27.866551 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 16:19:27.866551 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 09 16:19:27.866551 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:19:27.866551 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 512/1003] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Sep 9 16:19:27 2022] GET /identity/v3/services/compute => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 16:19:27.871224 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6639d401-6c29-4127-9ac9-9f6448e897d8 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:27.979356 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6639d401-6c29-4127-9ac9-9f6448e897d8 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:28.009301 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:28.033538 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854a2ebb-727c-40c4-8036-fd797e6aaf88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:28.033538 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854a2ebb-727c-40c4-8036-fd797e6aaf88 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:28.033538 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854a2ebb-727c-40c4-8036-fd797e6aaf88 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:28.033538 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854a2ebb-727c-40c4-8036-fd797e6aaf88 None admin] PATH_INFO: `/v3/services` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:28.034007 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854a2ebb-727c-40c4-8036-fd797e6aaf88 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:19:28.034007 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854a2ebb-727c-40c4-8036-fd797e6aaf88 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:28.034007 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854a2ebb-727c-40c4-8036-fd797e6aaf88 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:28.038939 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 492/1004] 10.222.0.27 () {56 vars in 1112 bytes} [Fri Sep 9 16:19:27 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:19:28.044579 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08856773-81c0-421b-b23e-d28295d0e97e None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:28.072581 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:28.149455 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08856773-81c0-421b-b23e-d28295d0e97e None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:28.183073 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2f3a4d-2986-406b-a09c-44b1fabb72e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:28.183801 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2f3a4d-2986-406b-a09c-44b1fabb72e0 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:28.183981 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2f3a4d-2986-406b-a09c-44b1fabb72e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:28.184204 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2f3a4d-2986-406b-a09c-44b1fabb72e0 None admin] PATH_INFO: `/v3/services` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:28.184816 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2f3a4d-2986-406b-a09c-44b1fabb72e0 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:19:28.185110 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2f3a4d-2986-406b-a09c-44b1fabb72e0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:28.186752 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2f3a4d-2986-406b-a09c-44b1fabb72e0 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:28.192265 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 513/1005] 10.222.0.27 () {56 vars in 1112 bytes} [Fri Sep 9 16:19:28 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:19:28.197834 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854a2ebb-727c-40c4-8036-fd797e6aaf88 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:28.303927 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854a2ebb-727c-40c4-8036-fd797e6aaf88 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:28.343133 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701956ea-03fd-4f05-9def-8b6ccf5bf2bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:28.343744 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701956ea-03fd-4f05-9def-8b6ccf5bf2bc None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:28.344014 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701956ea-03fd-4f05-9def-8b6ccf5bf2bc None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:28.344283 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701956ea-03fd-4f05-9def-8b6ccf5bf2bc None admin] PATH_INFO: `/v3/endpoints` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:28.344973 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701956ea-03fd-4f05-9def-8b6ccf5bf2bc None admin] RBAC: Adding query filter params (interface=public, service_id=84a2054eb4b6428fa566d0e4d4ed7ee1, region_id=RegionOne) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:19:28.345277 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701956ea-03fd-4f05-9def-8b6ccf5bf2bc None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:28.349251 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701956ea-03fd-4f05-9def-8b6ccf5bf2bc None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:28.362178 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 493/1006] 10.222.0.27 () {56 vars in 1251 bytes} [Fri Sep 9 16:19:28 2022] GET /identity/v3/endpoints?service_id=84a2054eb4b6428fa566d0e4d4ed7ee1&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:19:28.363367 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2f3a4d-2986-406b-a09c-44b1fabb72e0 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:28.454835 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:28.468132 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2f3a4d-2986-406b-a09c-44b1fabb72e0 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:28.502459 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970f7b61-994e-4d59-8af4-8dba18f52074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:28.503070 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970f7b61-994e-4d59-8af4-8dba18f52074 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:28.503345 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970f7b61-994e-4d59-8af4-8dba18f52074 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:28.503611 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970f7b61-994e-4d59-8af4-8dba18f52074 None admin] PATH_INFO: `/v3/services` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:28.504205 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970f7b61-994e-4d59-8af4-8dba18f52074 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:28.505594 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970f7b61-994e-4d59-8af4-8dba18f52074 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:28.518347 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 514/1007] 10.222.0.27 () {56 vars in 1087 bytes} [Fri Sep 9 16:19:28 2022] GET /identity/v3/services => generated 1727 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 16:19:29.870958 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efe2ea2-654d-44a2-aa0f-8779d5bf6791 None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:29.871603 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efe2ea2-654d-44a2-aa0f-8779d5bf6791 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:29.871603 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efe2ea2-654d-44a2-aa0f-8779d5bf6791 None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:29.873077 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 494/1008] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:19:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:19:29.878857 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93e0e16-6c04-4639-8813-5903b5b4c796 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:29.879372 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93e0e16-6c04-4639-8813-5903b5b4c796 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:29.879478 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93e0e16-6c04-4639-8813-5903b5b4c796 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:29.899211 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-a93e0e16-6c04-4639-8813-5903b5b4c796 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:19:29.900414 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-a93e0e16-6c04-4639-8813-5903b5b4c796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:19:29.966580 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 515/1009] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:19:29 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 16:19:29.984267 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ebc36d-5f20-4d5f-93de-e767ef453b97 None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:29.984557 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ebc36d-5f20-4d5f-93de-e767ef453b97 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:29.984838 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ebc36d-5f20-4d5f-93de-e767ef453b97 None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:29.986339 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 495/1010] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:19:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:19:29.991289 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994ee14e-4b0a-4f4e-9ad3-048ad5a69814 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:29.991581 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994ee14e-4b0a-4f4e-9ad3-048ad5a69814 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:29.991855 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994ee14e-4b0a-4f4e-9ad3-048ad5a69814 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:30.009612 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-994ee14e-4b0a-4f4e-9ad3-048ad5a69814 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:19:30.010816 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-994ee14e-4b0a-4f4e-9ad3-048ad5a69814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:19:30.081686 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 516/1011] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:19:29 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 16:19:30.243531 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ebc36d-5f20-4d5f-93de-e767ef453b97 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:30.308828 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:30.351421 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994ee14e-4b0a-4f4e-9ad3-048ad5a69814 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:30.357555 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ebc36d-5f20-4d5f-93de-e767ef453b97 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:30.365989 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:30.395223 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a9f58f-e0cd-48e5-9351-52eb75703609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:30.395829 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a9f58f-e0cd-48e5-9351-52eb75703609 None admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:30.396168 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a9f58f-e0cd-48e5-9351-52eb75703609 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:30.396442 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a9f58f-e0cd-48e5-9351-52eb75703609 None admin] PATH_INFO: `/v3/services` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:30.397082 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a9f58f-e0cd-48e5-9351-52eb75703609 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:30.398481 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a9f58f-e0cd-48e5-9351-52eb75703609 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:30.416114 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 496/1012] 10.222.0.27 () {60 vars in 1141 bytes} [Fri Sep 9 16:19:30 2022] POST /identity/v3/services => generated 242 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:19:30.468733 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994ee14e-4b0a-4f4e-9ad3-048ad5a69814 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:30.512750 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d658374-1a99-443d-821d-4f7b7b96684b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:30.513298 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d658374-1a99-443d-821d-4f7b7b96684b None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:30.513572 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d658374-1a99-443d-821d-4f7b7b96684b None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:30.513837 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d658374-1a99-443d-821d-4f7b7b96684b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:30.514980 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d658374-1a99-443d-821d-4f7b7b96684b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:30.516429 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d658374-1a99-443d-821d-4f7b7b96684b None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:30.522353 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 517/1013] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 16:19:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 16:19:30.524690 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a9f58f-e0cd-48e5-9351-52eb75703609 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:30.639714 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a9f58f-e0cd-48e5-9351-52eb75703609 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:30.660598 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:30.679772 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835f54b6-339b-4827-989f-015cc0502bfe None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:30.680074 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835f54b6-339b-4827-989f-015cc0502bfe None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:30.680329 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835f54b6-339b-4827-989f-015cc0502bfe None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:30.681347 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8448ea-05f7-4216-bee2-b3a9be5860b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:30.681795 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 518/1014] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:19:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 16:19:30.681979 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8448ea-05f7-4216-bee2-b3a9be5860b3 None admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:30.682276 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8448ea-05f7-4216-bee2-b3a9be5860b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:30.682577 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8448ea-05f7-4216-bee2-b3a9be5860b3 None admin] PATH_INFO: `/v3/projects` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:30.683234 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8448ea-05f7-4216-bee2-b3a9be5860b3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:30.684668 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8448ea-05f7-4216-bee2-b3a9be5860b3 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:30.686986 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e17f957-8266-41f9-8c34-1d184d0d1106 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:30.687266 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e17f957-8266-41f9-8c34-1d184d0d1106 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:30.687642 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e17f957-8266-41f9-8c34-1d184d0d1106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:30.708924 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-7e17f957-8266-41f9-8c34-1d184d0d1106 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:19:30.710099 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-7e17f957-8266-41f9-8c34-1d184d0d1106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:19:30.716659 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 497/1015] 10.222.0.27 () {60 vars in 1141 bytes} [Fri Sep 9 16:19:30 2022] POST /identity/v3/projects => generated 311 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:19:30.790084 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 519/1016] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:19:30 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 16:19:31.059665 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8448ea-05f7-4216-bee2-b3a9be5860b3 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:31.160050 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8448ea-05f7-4216-bee2-b3a9be5860b3 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:31.198330 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cf7f1c-f1fc-450b-83a4-4f533caebca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:31.199371 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cf7f1c-f1fc-450b-83a4-4f533caebca7 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:31.199852 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cf7f1c-f1fc-450b-83a4-4f533caebca7 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:31.200319 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cf7f1c-f1fc-450b-83a4-4f533caebca7 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:31.201089 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cf7f1c-f1fc-450b-83a4-4f533caebca7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:31.202705 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cf7f1c-f1fc-450b-83a4-4f533caebca7 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:31.211855 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-73cf7f1c-f1fc-450b-83a4-4f533caebca7 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 09 16:19:31.211855 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:19:31.211855 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 16:19:31.211855 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 16:19:31.211855 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 16:19:31.211855 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 16:19:31.211855 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 16:19:31.211855 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 16:19:31.211855 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 09 16:19:31.211855 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 16:19:31.211855 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 16:19:31.211855 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 16:19:31.211855 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:19:31.211855 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:19:31.211855 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:19:31.211855 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:19:31.211855 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:19:31.212846 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:19:31.212846 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:19:31.212846 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:19:31.212846 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:19:31.212846 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:19:31.212846 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:19:31.212846 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 16:19:31.212846 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 16:19:31.212846 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 16:19:31.212846 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 16:19:31.212846 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:19:31.212846 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:19:31.212846 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:19:31.212846 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:19:31.212846 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:19:31.212846 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:19:31.213698 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:19:31.213698 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 16:19:31.213698 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:19:31.213698 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:19:31.213698 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:19:31.213698 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:19:31.213698 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:19:31.213698 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:19:31.213698 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:19:31.213698 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:19:31.213698 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 16:19:31.213698 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 16:19:31.213698 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 09 16:19:31.213698 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 16:19:31.215798 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 498/1017] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Sep 9 16:19:31 2022] GET /identity/v3/services/compute => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:19:31.222066 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e17f957-8266-41f9-8c34-1d184d0d1106 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:31.231048 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:31.332409 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e17f957-8266-41f9-8c34-1d184d0d1106 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:31.369624 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c004dc15-cfbe-4631-a44b-a3f80f16660b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:31.370229 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c004dc15-cfbe-4631-a44b-a3f80f16660b None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:31.370537 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c004dc15-cfbe-4631-a44b-a3f80f16660b None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:31.370807 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c004dc15-cfbe-4631-a44b-a3f80f16660b None admin] PATH_INFO: `/v3/services` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:31.371426 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c004dc15-cfbe-4631-a44b-a3f80f16660b None admin] RBAC: Adding query filter params (name=compute) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:19:31.371726 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c004dc15-cfbe-4631-a44b-a3f80f16660b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:31.373097 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c004dc15-cfbe-4631-a44b-a3f80f16660b None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:31.378355 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 520/1018] 10.222.0.27 () {56 vars in 1112 bytes} [Fri Sep 9 16:19:31 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:19:31.384551 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cf7f1c-f1fc-450b-83a4-4f533caebca7 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:31.428050 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:31.515220 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cf7f1c-f1fc-450b-83a4-4f533caebca7 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:31.558881 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e2bb73-5ea5-45da-84ce-13e2e50a752c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:31.559483 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e2bb73-5ea5-45da-84ce-13e2e50a752c None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:31.559756 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e2bb73-5ea5-45da-84ce-13e2e50a752c None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:31.560060 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e2bb73-5ea5-45da-84ce-13e2e50a752c None admin] PATH_INFO: `/v3/services` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:31.560976 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e2bb73-5ea5-45da-84ce-13e2e50a752c None admin] RBAC: Adding query filter params (type=compute) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:19:31.561273 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e2bb73-5ea5-45da-84ce-13e2e50a752c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:31.562728 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e2bb73-5ea5-45da-84ce-13e2e50a752c None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:31.572502 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 499/1019] 10.222.0.27 () {56 vars in 1112 bytes} [Fri Sep 9 16:19:31 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 16:19:31.573667 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c004dc15-cfbe-4631-a44b-a3f80f16660b None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:31.652035 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:31.686924 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c004dc15-cfbe-4631-a44b-a3f80f16660b None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:31.730819 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0eab03-719b-4993-9bc4-462902ac13b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:31.731508 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0eab03-719b-4993-9bc4-462902ac13b0 None admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:31.731833 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0eab03-719b-4993-9bc4-462902ac13b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:31.732107 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0eab03-719b-4993-9bc4-462902ac13b0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:31.732778 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0eab03-719b-4993-9bc4-462902ac13b0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:31.734148 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0eab03-719b-4993-9bc4-462902ac13b0 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:31.762338 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 521/1020] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 16:19:31 2022] POST /identity/v3/endpoints => generated 334 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:19:32.710953 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4f9daa-45b6-401f-bd05-9905205894ed None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:32.711470 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4f9daa-45b6-401f-bd05-9905205894ed None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:32.711547 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4f9daa-45b6-401f-bd05-9905205894ed None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:32.712873 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 500/1021] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:19:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:19:32.720261 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44432280-6246-4b32-a439-8356d38982ba None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:32.722135 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44432280-6246-4b32-a439-8356d38982ba None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:32.722453 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44432280-6246-4b32-a439-8356d38982ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:32.742542 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-44432280-6246-4b32-a439-8356d38982ba None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:19:32.743755 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-44432280-6246-4b32-a439-8356d38982ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:19:32.824186 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 522/1022] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:19:32 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 16:19:32.928082 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9bab83-a8d8-4af1-b0e5-042643b32baa None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:32.928449 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9bab83-a8d8-4af1-b0e5-042643b32baa None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:32.928797 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9bab83-a8d8-4af1-b0e5-042643b32baa None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:32.933941 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 501/1023] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:19:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:19:32.935958 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36495f95-a788-46a8-81d8-5ff24062f950 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:32.936245 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36495f95-a788-46a8-81d8-5ff24062f950 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:32.936515 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36495f95-a788-46a8-81d8-5ff24062f950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:32.955184 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-36495f95-a788-46a8-81d8-5ff24062f950 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:19:32.956350 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-36495f95-a788-46a8-81d8-5ff24062f950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:19:33.004514 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:33.025923 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 523/1024] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:19:32 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 16:19:33.089028 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9bab83-a8d8-4af1-b0e5-042643b32baa None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:33.181676 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:33.190438 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9bab83-a8d8-4af1-b0e5-042643b32baa None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:33.223432 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e07756-b4df-4a33-a207-b32896e87e6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:33.224049 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e07756-b4df-4a33-a207-b32896e87e6d None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:33.224320 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e07756-b4df-4a33-a207-b32896e87e6d None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:33.224584 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e07756-b4df-4a33-a207-b32896e87e6d None admin] PATH_INFO: `/v3/services/image` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:33.225149 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e07756-b4df-4a33-a207-b32896e87e6d None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:33.226547 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e07756-b4df-4a33-a207-b32896e87e6d None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:33.235191 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-95e07756-b4df-4a33-a207-b32896e87e6d None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 09 16:19:33.235191 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:19:33.235191 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 16:19:33.235191 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 16:19:33.235191 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 16:19:33.235191 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 16:19:33.235191 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 16:19:33.235191 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 16:19:33.235191 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 09 16:19:33.235191 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 16:19:33.235191 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 16:19:33.235191 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 16:19:33.235191 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:19:33.235191 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:19:33.235191 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:19:33.235191 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:19:33.235191 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:19:33.236697 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:19:33.236697 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:19:33.236697 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:19:33.236697 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:19:33.236697 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:19:33.236697 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:19:33.236697 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 16:19:33.236697 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 16:19:33.236697 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 16:19:33.236697 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 16:19:33.236697 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:19:33.236697 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:19:33.236697 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:19:33.236697 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:19:33.236697 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:19:33.236697 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:19:33.237638 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:19:33.237638 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 16:19:33.237638 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:19:33.237638 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:19:33.237638 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:19:33.237638 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:19:33.237638 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:19:33.237638 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:19:33.237638 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:19:33.237638 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:19:33.237638 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 16:19:33.237638 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 16:19:33.237638 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 09 16:19:33.237638 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 16:19:33.241605 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 502/1025] 10.222.0.27 () {56 vars in 1105 bytes} [Fri Sep 9 16:19:33 2022] GET /identity/v3/services/image => generated 86 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:19:33.242899 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36495f95-a788-46a8-81d8-5ff24062f950 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:33.296416 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e07756-b4df-4a33-a207-b32896e87e6d None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:33.354954 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36495f95-a788-46a8-81d8-5ff24062f950 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:33.396490 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e07756-b4df-4a33-a207-b32896e87e6d None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:33.397574 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2feada-7bbe-4adc-bd86-dd31c6f0c1c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:33.398333 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2feada-7bbe-4adc-bd86-dd31c6f0c1c1 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:33.398733 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2feada-7bbe-4adc-bd86-dd31c6f0c1c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:33.399231 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2feada-7bbe-4adc-bd86-dd31c6f0c1c1 None admin] PATH_INFO: `/v3/services` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:33.399891 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2feada-7bbe-4adc-bd86-dd31c6f0c1c1 None admin] RBAC: Adding query filter params (name=image) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:19:33.400193 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2feada-7bbe-4adc-bd86-dd31c6f0c1c1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:33.401568 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2feada-7bbe-4adc-bd86-dd31c6f0c1c1 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:33.411801 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 524/1026] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 16:19:33 2022] GET /identity/v3/services?name=image => generated 122 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:19:33.413643 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2feada-7bbe-4adc-bd86-dd31c6f0c1c1 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:33.437077 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8858a651-8112-4f0d-8c82-0fc09d0f4c83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:33.437713 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8858a651-8112-4f0d-8c82-0fc09d0f4c83 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:33.438269 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8858a651-8112-4f0d-8c82-0fc09d0f4c83 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:33.438269 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8858a651-8112-4f0d-8c82-0fc09d0f4c83 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:33.439422 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8858a651-8112-4f0d-8c82-0fc09d0f4c83 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:33.440856 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8858a651-8112-4f0d-8c82-0fc09d0f4c83 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:33.446355 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 503/1027] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 16:19:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 16:19:33.447996 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8858a651-8112-4f0d-8c82-0fc09d0f4c83 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:33.468413 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:33.476762 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:33.527859 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2feada-7bbe-4adc-bd86-dd31c6f0c1c1 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:33.552561 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8858a651-8112-4f0d-8c82-0fc09d0f4c83 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:33.566518 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a3cf31-686c-49bc-b0e3-bea19b9fa8bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:33.567132 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a3cf31-686c-49bc-b0e3-bea19b9fa8bd None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:33.567412 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a3cf31-686c-49bc-b0e3-bea19b9fa8bd None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:33.567683 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a3cf31-686c-49bc-b0e3-bea19b9fa8bd None admin] PATH_INFO: `/v3/services` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:33.568305 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a3cf31-686c-49bc-b0e3-bea19b9fa8bd None admin] RBAC: Adding query filter params (type=image) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:19:33.568612 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a3cf31-686c-49bc-b0e3-bea19b9fa8bd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:33.569977 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a3cf31-686c-49bc-b0e3-bea19b9fa8bd None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:33.575440 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 525/1028] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 16:19:33 2022] GET /identity/v3/services?type=image => generated 350 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 16:19:33.581657 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a3cf31-686c-49bc-b0e3-bea19b9fa8bd None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:33.590996 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bb1423-c2eb-493b-86b6-4dc3f51b52bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:33.591603 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bb1423-c2eb-493b-86b6-4dc3f51b52bd None admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:33.591879 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bb1423-c2eb-493b-86b6-4dc3f51b52bd None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:33.592154 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bb1423-c2eb-493b-86b6-4dc3f51b52bd None admin] PATH_INFO: `/v3/users` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:33.592792 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bb1423-c2eb-493b-86b6-4dc3f51b52bd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:33.594223 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bb1423-c2eb-493b-86b6-4dc3f51b52bd None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:33.618142 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 504/1029] 10.222.0.27 () {60 vars in 1132 bytes} [Fri Sep 9 16:19:33 2022] POST /identity/v3/users => generated 285 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 16:19:33.700042 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a3cf31-686c-49bc-b0e3-bea19b9fa8bd None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:33.712507 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:33.739639 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8066ea43-34e9-40e2-93d4-60a225ec75f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:33.740989 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8066ea43-34e9-40e2-93d4-60a225ec75f7 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:33.741442 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8066ea43-34e9-40e2-93d4-60a225ec75f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:33.741850 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8066ea43-34e9-40e2-93d4-60a225ec75f7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:33.742742 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8066ea43-34e9-40e2-93d4-60a225ec75f7 None admin] RBAC: Adding query filter params (interface=public, service_id=8a3099084ded45faa91708ccf424a72f, region_id=RegionOne) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:19:33.743195 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8066ea43-34e9-40e2-93d4-60a225ec75f7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:33.744821 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8066ea43-34e9-40e2-93d4-60a225ec75f7 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:33.751060 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 526/1030] 10.222.0.27 () {56 vars in 1251 bytes} [Fri Sep 9 16:19:33 2022] GET /identity/v3/endpoints?service_id=8a3099084ded45faa91708ccf424a72f&interface=public®ion_id=RegionOne => generated 194 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 16:19:33.757475 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bb1423-c2eb-493b-86b6-4dc3f51b52bd None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:33.855067 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:33.873677 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bb1423-c2eb-493b-86b6-4dc3f51b52bd None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:33.909474 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0fa9a1-7bba-4cf7-a316-10bed2cd3c26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:33.910107 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0fa9a1-7bba-4cf7-a316-10bed2cd3c26 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:33.910418 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0fa9a1-7bba-4cf7-a316-10bed2cd3c26 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:33.910692 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0fa9a1-7bba-4cf7-a316-10bed2cd3c26 None admin] PATH_INFO: `/v3/services` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:33.911340 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0fa9a1-7bba-4cf7-a316-10bed2cd3c26 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:33.912780 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0fa9a1-7bba-4cf7-a316-10bed2cd3c26 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:33.920500 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 505/1031] 10.222.0.27 () {56 vars in 1087 bytes} [Fri Sep 9 16:19:33 2022] GET /identity/v3/services => generated 1957 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:19:34.036137 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63f1a19-f781-4a35-a76e-9fbd3cfd2a63 None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:34.036475 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63f1a19-f781-4a35-a76e-9fbd3cfd2a63 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:34.036687 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63f1a19-f781-4a35-a76e-9fbd3cfd2a63 None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:34.038243 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 527/1032] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:19:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:19:34.043714 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85db462-0b1a-4595-b387-e2071986bb11 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:34.044021 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85db462-0b1a-4595-b387-e2071986bb11 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:34.044279 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85db462-0b1a-4595-b387-e2071986bb11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:34.063796 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-b85db462-0b1a-4595-b387-e2071986bb11 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:19:34.065537 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-b85db462-0b1a-4595-b387-e2071986bb11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:19:34.142063 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 506/1033] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:19:34 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 16:19:34.407533 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63f1a19-f781-4a35-a76e-9fbd3cfd2a63 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:34.511513 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63f1a19-f781-4a35-a76e-9fbd3cfd2a63 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:34.545467 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a08fd04-b990-4e61-b675-480d72fcccb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:34.546084 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a08fd04-b990-4e61-b675-480d72fcccb5 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:34.546386 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a08fd04-b990-4e61-b675-480d72fcccb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:34.546656 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a08fd04-b990-4e61-b675-480d72fcccb5 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:34.556551 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a08fd04-b990-4e61-b675-480d72fcccb5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 16:19:34.561530 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-7a08fd04-b990-4e61-b675-480d72fcccb5 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 09 16:19:34.561530 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:19:34.561530 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:19:34.561530 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:19:34.561530 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:19:34.561530 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:19:34.561530 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:19:34.561530 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:19:34.561530 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:19:34.561530 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:19:34.561530 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:19:34.561530 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:19:34.561530 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 16:19:34.561530 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 16:19:34.561530 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 16:19:34.561530 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 16:19:34.562668 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 16:19:34.562668 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 16:19:34.562668 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 16:19:34.562668 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 16:19:34.562668 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:19:34.562668 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:19:34.562668 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:19:34.562668 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:19:34.562668 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:19:34.562668 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:19:34.562668 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:19:34.562668 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Sep 09 16:19:34.562668 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:19:34.562668 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:19:34.562668 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:19:34.562668 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:19:34.563711 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:19:34.563711 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:19:34.563711 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:19:34.563711 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:19:34.563711 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 16:19:34.563711 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 16:19:34.563711 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 16:19:34.563711 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 16:19:34.563711 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 16:19:34.563711 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 16:19:34.563711 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 09 16:19:34.563711 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:19:34.563711 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 528/1034] 10.222.0.27 () {56 vars in 1120 bytes} [Fri Sep 9 16:19:34 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:19:34.568567 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85db462-0b1a-4595-b387-e2071986bb11 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:34.647757 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:34.671333 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85db462-0b1a-4595-b387-e2071986bb11 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:34.705616 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673a36e8-0922-4e69-80fd-2c194c61d116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:34.706220 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673a36e8-0922-4e69-80fd-2c194c61d116 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:34.706521 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673a36e8-0922-4e69-80fd-2c194c61d116 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:34.706789 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673a36e8-0922-4e69-80fd-2c194c61d116 None admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:34.707444 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673a36e8-0922-4e69-80fd-2c194c61d116 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:19:34.707744 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673a36e8-0922-4e69-80fd-2c194c61d116 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:34.709110 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673a36e8-0922-4e69-80fd-2c194c61d116 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:34.722373 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 507/1035] 10.222.0.27 () {56 vars in 1115 bytes} [Fri Sep 9 16:19:34 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 16:19:34.723662 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a08fd04-b990-4e61-b675-480d72fcccb5 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:34.758343 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:34.827490 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a08fd04-b990-4e61-b675-480d72fcccb5 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:34.861606 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae57722-678d-4384-9788-3c7a08ec6b50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:34.862230 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae57722-678d-4384-9788-3c7a08ec6b50 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:34.862547 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae57722-678d-4384-9788-3c7a08ec6b50 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:34.862817 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae57722-678d-4384-9788-3c7a08ec6b50 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:34.872561 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae57722-678d-4384-9788-3c7a08ec6b50 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:34.874006 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae57722-678d-4384-9788-3c7a08ec6b50 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:34.888535 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-9ae57722-678d-4384-9788-3c7a08ec6b50 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 16:19:34.888535 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:19:34.888535 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:19:34.888535 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:19:34.888535 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:19:34.888535 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:19:34.888535 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:19:34.888535 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:19:34.888535 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:19:34.888535 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:19:34.888535 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:19:34.888535 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:19:34.888535 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 16:19:34.888535 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 16:19:34.888535 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 16:19:34.888535 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 16:19:34.889474 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:19:34.889474 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:19:34.889474 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:19:34.889474 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:19:34.889474 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:19:34.889474 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:19:34.889474 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:19:34.889474 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Sep 09 16:19:34.889474 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:19:34.889474 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:19:34.889474 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:19:34.889474 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:19:34.889474 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:19:34.889474 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:19:34.889474 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:19:34.889474 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:19:34.889474 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 16:19:34.890509 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 16:19:34.890509 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 16:19:34.890509 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:19:34.890509 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 529/1036] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 16:19:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:19:34.897078 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673a36e8-0922-4e69-80fd-2c194c61d116 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:34.999989 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673a36e8-0922-4e69-80fd-2c194c61d116 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:35.033560 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5c77e9-c898-4428-acb6-ef0adaa2e239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:35.034385 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5c77e9-c898-4428-acb6-ef0adaa2e239 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:35.034811 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5c77e9-c898-4428-acb6-ef0adaa2e239 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:35.035253 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5c77e9-c898-4428-acb6-ef0adaa2e239 None admin] PATH_INFO: `/v3/domains` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:35.036039 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5c77e9-c898-4428-acb6-ef0adaa2e239 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:19:35.036489 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5c77e9-c898-4428-acb6-ef0adaa2e239 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:35.038058 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5c77e9-c898-4428-acb6-ef0adaa2e239 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:35.046873 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:35.054348 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 508/1037] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Sep 9 16:19:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:19:35.056701 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae57722-678d-4384-9788-3c7a08ec6b50 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:35.143499 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:35.159100 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae57722-678d-4384-9788-3c7a08ec6b50 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:35.193930 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4ffe10-5565-4ff4-9220-b75be63ee8ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:35.194581 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4ffe10-5565-4ff4-9220-b75be63ee8ca None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:35.194859 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4ffe10-5565-4ff4-9220-b75be63ee8ca None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:35.195125 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4ffe10-5565-4ff4-9220-b75be63ee8ca None admin] PATH_INFO: `/v3/users/nova` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:35.202633 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4ffe10-5565-4ff4-9220-b75be63ee8ca None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:35.204066 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4ffe10-5565-4ff4-9220-b75be63ee8ca None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:35.215502 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-9c4ffe10-5565-4ff4-9220-b75be63ee8ca None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 09 16:19:35.215502 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:19:35.215502 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:19:35.215502 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:19:35.215502 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:19:35.215502 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:19:35.215502 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:19:35.215502 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:19:35.215502 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:19:35.215502 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:19:35.215502 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:19:35.215502 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:19:35.215502 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 16:19:35.215502 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 16:19:35.215502 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 16:19:35.215502 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 16:19:35.216463 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:19:35.216463 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:19:35.216463 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 16:19:35.216463 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 16:19:35.216463 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 16:19:35.216463 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 16:19:35.216463 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:19:35.216463 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:19:35.216463 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:19:35.216463 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:19:35.216463 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:19:35.216463 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Sep 09 16:19:35.216463 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:19:35.216463 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:19:35.216463 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:19:35.216463 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:19:35.216463 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:19:35.216463 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:19:35.218004 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:19:35.218004 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:19:35.218004 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 16:19:35.218004 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 16:19:35.218004 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 16:19:35.218004 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 16:19:35.218004 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 16:19:35.218004 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 16:19:35.218004 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 09 16:19:35.218004 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:19:35.218004 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 530/1038] 10.222.0.27 () {56 vars in 1093 bytes} [Fri Sep 9 16:19:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:19:35.223546 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5c77e9-c898-4428-acb6-ef0adaa2e239 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:35.330444 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5c77e9-c898-4428-acb6-ef0adaa2e239 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:35.364951 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693cf815-2517-4938-bc7a-d04e60c10bc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:35.365548 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693cf815-2517-4938-bc7a-d04e60c10bc0 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:35.365823 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693cf815-2517-4938-bc7a-d04e60c10bc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:35.366092 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693cf815-2517-4938-bc7a-d04e60c10bc0 None admin] PATH_INFO: `/v3/users` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:35.366833 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693cf815-2517-4938-bc7a-d04e60c10bc0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:19:35.367137 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693cf815-2517-4938-bc7a-d04e60c10bc0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:35.368561 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693cf815-2517-4938-bc7a-d04e60c10bc0 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:35.389858 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 509/1039] 10.222.0.27 () {56 vars in 1133 bytes} [Fri Sep 9 16:19:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:19:35.391210 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4ffe10-5565-4ff4-9220-b75be63ee8ca None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:35.499417 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4ffe10-5565-4ff4-9220-b75be63ee8ca None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:35.533567 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23785878-48f8-413f-9d6e-f6769802d342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:35.534171 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23785878-48f8-413f-9d6e-f6769802d342 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:35.534479 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23785878-48f8-413f-9d6e-f6769802d342 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:35.534800 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23785878-48f8-413f-9d6e-f6769802d342 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:35.551194 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:35.604202 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23785878-48f8-413f-9d6e-f6769802d342 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:35.605656 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23785878-48f8-413f-9d6e-f6769802d342 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:35.713063 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 531/1040] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Sep 9 16:19:35 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 09 16:19:35.713261 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693cf815-2517-4938-bc7a-d04e60c10bc0 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:35.779311 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:35.822132 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693cf815-2517-4938-bc7a-d04e60c10bc0 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:35.857384 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6ebe7a-b41a-4cef-b410-c2c1cec38a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:35.858009 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6ebe7a-b41a-4cef-b410-c2c1cec38a73 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:35.858287 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6ebe7a-b41a-4cef-b410-c2c1cec38a73 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:35.858584 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6ebe7a-b41a-4cef-b410-c2c1cec38a73 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:35.864244 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ded69b-262d-45f3-aeea-258f8647e627 None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:35.864711 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ded69b-262d-45f3-aeea-258f8647e627 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:35.864790 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ded69b-262d-45f3-aeea-258f8647e627 None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:35.866790 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 532/1041] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:19:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 16:19:35.869156 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6ebe7a-b41a-4cef-b410-c2c1cec38a73 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:35.870638 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6ebe7a-b41a-4cef-b410-c2c1cec38a73 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:35.871587 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3df698-f1cd-49e5-973d-eca8fb475c9f None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:35.871869 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3df698-f1cd-49e5-973d-eca8fb475c9f None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:35.872134 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3df698-f1cd-49e5-973d-eca8fb475c9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:35.887001 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-9b6ebe7a-b41a-4cef-b410-c2c1cec38a73 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 16:19:35.887001 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:19:35.887001 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:19:35.887001 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:19:35.887001 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:19:35.887001 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:19:35.887001 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:19:35.887001 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:19:35.887001 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:19:35.887001 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:19:35.887001 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:19:35.887001 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:19:35.887001 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 16:19:35.887001 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 16:19:35.887001 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 16:19:35.887001 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 16:19:35.887975 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:19:35.887975 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:19:35.887975 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:19:35.887975 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:19:35.887975 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:19:35.887975 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:19:35.887975 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:19:35.887975 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 16:19:35.887975 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:19:35.887975 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:19:35.887975 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:19:35.887975 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:19:35.887975 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:19:35.887975 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:19:35.887975 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:19:35.887975 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:19:35.887975 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 16:19:35.888869 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 16:19:35.888869 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 16:19:35.888869 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 16:19:35.888869 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 510/1042] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 16:19:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:19:35.893736 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-df3df698-f1cd-49e5-973d-eca8fb475c9f None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:19:35.894467 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6ebe7a-b41a-4cef-b410-c2c1cec38a73 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:35.894950 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-df3df698-f1cd-49e5-973d-eca8fb475c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:19:35.941994 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:35.968436 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 533/1043] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:19:35 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 16:19:36.004217 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6ebe7a-b41a-4cef-b410-c2c1cec38a73 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:36.015363 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:36.040840 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f21802-94c0-4618-a156-67b806873e00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:36.041453 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f21802-94c0-4618-a156-67b806873e00 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:36.041733 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f21802-94c0-4618-a156-67b806873e00 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:36.042004 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f21802-94c0-4618-a156-67b806873e00 None admin] PATH_INFO: `/v3/domains` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:36.042657 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f21802-94c0-4618-a156-67b806873e00 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:19:36.042960 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f21802-94c0-4618-a156-67b806873e00 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:36.044333 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f21802-94c0-4618-a156-67b806873e00 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:36.056887 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 511/1044] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Sep 9 16:19:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 16:19:36.062657 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3df698-f1cd-49e5-973d-eca8fb475c9f None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:36.096488 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c61a9dd-4cfd-4ee4-b6bc-ce0e42d4c8a0 None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:36.096774 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c61a9dd-4cfd-4ee4-b6bc-ce0e42d4c8a0 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:36.096957 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c61a9dd-4cfd-4ee4-b6bc-ce0e42d4c8a0 None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:36.098294 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 512/1045] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:19:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 16:19:36.104394 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ca8a38-9867-4929-82c4-500e97c0a8e1 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:36.104675 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ca8a38-9867-4929-82c4-500e97c0a8e1 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:36.104949 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ca8a38-9867-4929-82c4-500e97c0a8e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:36.123953 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-40ca8a38-9867-4929-82c4-500e97c0a8e1 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:19:36.125134 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-40ca8a38-9867-4929-82c4-500e97c0a8e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:19:36.167985 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3df698-f1cd-49e5-973d-eca8fb475c9f None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:36.194297 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 513/1046] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:19:36 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 16:19:36.205617 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f4b700-7535-4e82-b20d-b46f78fa34cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:36.206239 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f4b700-7535-4e82-b20d-b46f78fa34cf None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:36.206537 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f4b700-7535-4e82-b20d-b46f78fa34cf None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:36.206810 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f4b700-7535-4e82-b20d-b46f78fa34cf None admin] PATH_INFO: `/v3/projects/service` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:36.213572 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f4b700-7535-4e82-b20d-b46f78fa34cf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:36.215045 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f4b700-7535-4e82-b20d-b46f78fa34cf None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:36.226386 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-26f4b700-7535-4e82-b20d-b46f78fa34cf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 16:19:36.226386 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:19:36.226386 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:19:36.226386 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:19:36.226386 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:19:36.226386 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:19:36.226386 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:19:36.226386 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:19:36.226386 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:19:36.226386 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:19:36.226386 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:19:36.226386 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:19:36.226386 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 16:19:36.226386 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 16:19:36.226386 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 16:19:36.227302 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 16:19:36.227302 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:19:36.227302 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:19:36.227302 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:19:36.227302 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:19:36.227302 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:19:36.227302 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:19:36.227302 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:19:36.227302 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Sep 09 16:19:36.227302 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:19:36.227302 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:19:36.227302 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:19:36.227302 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:19:36.227302 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:19:36.227302 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:19:36.227302 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:19:36.227302 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:19:36.233048 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 16:19:36.233048 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 16:19:36.233048 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 16:19:36.233048 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 16:19:36.233048 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 16:19:36.233048 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 16:19:36.233048 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 16:19:36.233048 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:19:36.233048 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 534/1047] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Sep 9 16:19:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:19:36.233548 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ca8a38-9867-4929-82c4-500e97c0a8e1 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:36.237603 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f4b700-7535-4e82-b20d-b46f78fa34cf None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:36.273748 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:36.344232 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:36.347464 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f4b700-7535-4e82-b20d-b46f78fa34cf None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:36.348215 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ca8a38-9867-4929-82c4-500e97c0a8e1 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:36.384740 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a043df8a-14a4-4563-b804-467e5fa6eaaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:36.385450 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a043df8a-14a4-4563-b804-467e5fa6eaaf None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:36.385826 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a043df8a-14a4-4563-b804-467e5fa6eaaf None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:36.386108 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a043df8a-14a4-4563-b804-467e5fa6eaaf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:36.386711 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6606e33-c9a6-4143-8e85-f6163b02d68e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:36.387389 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6606e33-c9a6-4143-8e85-f6163b02d68e None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:36.387673 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6606e33-c9a6-4143-8e85-f6163b02d68e None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:36.387945 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6606e33-c9a6-4143-8e85-f6163b02d68e None admin] PATH_INFO: `/v3/projects` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:36.388622 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6606e33-c9a6-4143-8e85-f6163b02d68e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:19:36.388928 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6606e33-c9a6-4143-8e85-f6163b02d68e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:36.390438 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6606e33-c9a6-4143-8e85-f6163b02d68e None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:36.399567 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a043df8a-14a4-4563-b804-467e5fa6eaaf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 16:19:36.403106 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 514/1048] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Sep 9 16:19:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:19:36.409370 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-a043df8a-14a4-4563-b804-467e5fa6eaaf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 16:19:36.409370 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:19:36.409370 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:19:36.409370 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:19:36.409370 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:19:36.409370 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:19:36.409370 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:19:36.409370 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:19:36.409370 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:19:36.409370 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:19:36.409370 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:19:36.409370 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:19:36.409370 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 16:19:36.409370 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 16:19:36.409370 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 16:19:36.409370 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 16:19:36.410370 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 16:19:36.410370 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 16:19:36.410370 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 16:19:36.410370 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 16:19:36.410370 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:19:36.410370 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:19:36.410370 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:19:36.410370 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:19:36.410370 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:19:36.410370 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:19:36.410370 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:19:36.410370 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Sep 09 16:19:36.410370 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:19:36.410370 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:19:36.410370 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:19:36.410370 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:19:36.411219 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:19:36.411219 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:19:36.411219 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:19:36.411219 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:19:36.411219 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 16:19:36.411219 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 16:19:36.411219 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 16:19:36.411219 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 16:19:36.411219 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 16:19:36.411219 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 16:19:36.411219 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 16:19:36.411219 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:19:36.411870 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6606e33-c9a6-4143-8e85-f6163b02d68e None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:36.411945 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 535/1049] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Sep 9 16:19:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 16:19:36.416651 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a043df8a-14a4-4563-b804-467e5fa6eaaf None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:36.514608 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6606e33-c9a6-4143-8e85-f6163b02d68e None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:36.516341 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:36.522988 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a043df8a-14a4-4563-b804-467e5fa6eaaf None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:36.547645 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbeb8bcd-b0a3-4bf9-945a-8bc0935dd59e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:36.549049 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeb8bcd-b0a3-4bf9-945a-8bc0935dd59e None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:36.549324 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeb8bcd-b0a3-4bf9-945a-8bc0935dd59e None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:36.549588 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeb8bcd-b0a3-4bf9-945a-8bc0935dd59e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:36.550296 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbeb8bcd-b0a3-4bf9-945a-8bc0935dd59e None admin] RBAC: Adding query filter params (role.id=e2a4c6d72b844015a5daa58530c8a567, scope.project.id=68d6aaafab824657b08ca91f3d46d5f8, user.id=a332b9b4980646a3b14633293f77b505) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:19:36.550622 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbeb8bcd-b0a3-4bf9-945a-8bc0935dd59e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:36.552084 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbeb8bcd-b0a3-4bf9-945a-8bc0935dd59e None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:36.557357 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 515/1050] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Sep 9 16:19:36 2022] GET /identity/v3/role_assignments?user.id=a332b9b4980646a3b14633293f77b505&scope.project.id=68d6aaafab824657b08ca91f3d46d5f8&role.id=e2a4c6d72b844015a5daa58530c8a567 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 16:19:36.558117 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbeb8bcd-b0a3-4bf9-945a-8bc0935dd59e None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:36.558236 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251cb9ce-6a2e-4b88-ac00-3ff88109edf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:36.558872 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251cb9ce-6a2e-4b88-ac00-3ff88109edf1 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:36.559142 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251cb9ce-6a2e-4b88-ac00-3ff88109edf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:36.559413 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251cb9ce-6a2e-4b88-ac00-3ff88109edf1 None admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:36.560077 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251cb9ce-6a2e-4b88-ac00-3ff88109edf1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:19:36.560379 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251cb9ce-6a2e-4b88-ac00-3ff88109edf1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:36.562033 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251cb9ce-6a2e-4b88-ac00-3ff88109edf1 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:36.573004 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 536/1051] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Sep 9 16:19:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 16:19:36.579030 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251cb9ce-6a2e-4b88-ac00-3ff88109edf1 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:36.590378 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:36.678834 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbeb8bcd-b0a3-4bf9-945a-8bc0935dd59e None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:36.696120 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251cb9ce-6a2e-4b88-ac00-3ff88109edf1 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:36.726544 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c7ec3d-cb81-4d99-82c8-aede2942252c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:36.727318 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c7ec3d-cb81-4d99-82c8-aede2942252c None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:36.727591 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c7ec3d-cb81-4d99-82c8-aede2942252c None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:36.727856 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c7ec3d-cb81-4d99-82c8-aede2942252c None admin] PATH_INFO: `/v3/services/image` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:36.728597 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c7ec3d-cb81-4d99-82c8-aede2942252c None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:36.730232 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c7ec3d-cb81-4d99-82c8-aede2942252c None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:36.740593 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-60c7ec3d-cb81-4d99-82c8-aede2942252c None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 09 16:19:36.740593 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:19:36.740593 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 16:19:36.740593 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 16:19:36.740593 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 16:19:36.740593 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 16:19:36.740593 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 16:19:36.740593 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 16:19:36.740593 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 09 16:19:36.740593 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 16:19:36.740593 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 16:19:36.740593 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 16:19:36.740593 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:19:36.740593 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:19:36.740593 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:19:36.740593 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:19:36.740593 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:19:36.741799 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:19:36.741799 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:19:36.741799 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:19:36.741799 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:19:36.741799 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:19:36.741799 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:19:36.741799 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 16:19:36.741799 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 16:19:36.741799 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 16:19:36.741799 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 16:19:36.741799 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:19:36.741799 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:19:36.741799 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:19:36.741799 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:19:36.741799 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:19:36.741799 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:19:36.742854 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:19:36.742854 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 16:19:36.742854 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:19:36.742854 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:19:36.742854 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:19:36.742854 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:19:36.742854 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:19:36.742854 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:19:36.742854 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:19:36.742854 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:19:36.742854 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 16:19:36.742854 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 16:19:36.742854 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 09 16:19:36.742854 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 16:19:36.742854 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 516/1052] 10.222.0.27 () {56 vars in 1105 bytes} [Fri Sep 9 16:19:36 2022] GET /identity/v3/services/image => generated 86 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:19:36.747698 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c7ec3d-cb81-4d99-82c8-aede2942252c None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:36.748061 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd8f174-0129-4bd4-af74-eb37497fabac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:36.748633 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd8f174-0129-4bd4-af74-eb37497fabac None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:36.748908 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd8f174-0129-4bd4-af74-eb37497fabac None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:36.749175 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd8f174-0129-4bd4-af74-eb37497fabac None admin] PATH_INFO: `/v3/users/899f26c4d3e8486b928668f3c9be08fa` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:36.765148 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd8f174-0129-4bd4-af74-eb37497fabac None admin] RBAC: Authorizing `identity:get_user(user_id=899f26c4d3e8486b928668f3c9be08fa)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:36.767556 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd8f174-0129-4bd4-af74-eb37497fabac None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:36.773852 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 537/1053] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Sep 9 16:19:36 2022] GET /identity/v3/users/899f26c4d3e8486b928668f3c9be08fa => generated 285 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 16:19:36.774885 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd8f174-0129-4bd4-af74-eb37497fabac None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:36.796054 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:36.851130 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:36.866549 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c7ec3d-cb81-4d99-82c8-aede2942252c None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:36.888537 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd8f174-0129-4bd4-af74-eb37497fabac None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:36.901992 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c86966-f448-42a1-9c66-e13aad5eadf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:36.902754 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c86966-f448-42a1-9c66-e13aad5eadf0 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:36.903027 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c86966-f448-42a1-9c66-e13aad5eadf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:36.903292 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c86966-f448-42a1-9c66-e13aad5eadf0 None admin] PATH_INFO: `/v3/services` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:36.903905 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c86966-f448-42a1-9c66-e13aad5eadf0 None admin] RBAC: Adding query filter params (name=image) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:19:36.904206 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c86966-f448-42a1-9c66-e13aad5eadf0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:36.905561 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c86966-f448-42a1-9c66-e13aad5eadf0 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:36.911081 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 517/1054] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 16:19:36 2022] GET /identity/v3/services?name=image => generated 122 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 16:19:36.916771 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c86966-f448-42a1-9c66-e13aad5eadf0 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:36.929308 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6c18c1-f2e6-403a-8c8f-71bd3f0ae641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:36.930477 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6c18c1-f2e6-403a-8c8f-71bd3f0ae641 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:36.930955 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6c18c1-f2e6-403a-8c8f-71bd3f0ae641 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:36.931639 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6c18c1-f2e6-403a-8c8f-71bd3f0ae641 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:37.012369 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6c18c1-f2e6-403a-8c8f-71bd3f0ae641 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:37.013803 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6c18c1-f2e6-403a-8c8f-71bd3f0ae641 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:37.022359 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c86966-f448-42a1-9c66-e13aad5eadf0 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:37.034401 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:37.056654 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc189e64-b540-4723-ac46-209182a16cdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:37.057254 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc189e64-b540-4723-ac46-209182a16cdc None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:37.057527 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc189e64-b540-4723-ac46-209182a16cdc None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:37.057792 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc189e64-b540-4723-ac46-209182a16cdc None admin] PATH_INFO: `/v3/services` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:37.058437 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc189e64-b540-4723-ac46-209182a16cdc None admin] RBAC: Adding query filter params (type=image) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:19:37.058733 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc189e64-b540-4723-ac46-209182a16cdc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:37.060222 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc189e64-b540-4723-ac46-209182a16cdc None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:37.066057 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 518/1055] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 16:19:36 2022] GET /identity/v3/services?type=image => generated 350 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:19:37.071664 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc189e64-b540-4723-ac46-209182a16cdc None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:37.089790 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:37.129872 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 538/1056] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Sep 9 16:19:36 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 09 16:19:37.135474 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6c18c1-f2e6-403a-8c8f-71bd3f0ae641 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:37.173203 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc189e64-b540-4723-ac46-209182a16cdc None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:37.209736 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf862aab-b68b-4d59-9a3e-868a03677dd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:37.210252 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf862aab-b68b-4d59-9a3e-868a03677dd2 None admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:37.210663 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf862aab-b68b-4d59-9a3e-868a03677dd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:37.210931 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf862aab-b68b-4d59-9a3e-868a03677dd2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:37.211579 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf862aab-b68b-4d59-9a3e-868a03677dd2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:37.213078 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf862aab-b68b-4d59-9a3e-868a03677dd2 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:37.242332 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 519/1057] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 16:19:37 2022] POST /identity/v3/endpoints => generated 327 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 16:19:37.242580 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6c18c1-f2e6-403a-8c8f-71bd3f0ae641 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:37.262233 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:37.299565 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f981ff1-cbbc-4cfe-9883-ffa69b89fc7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:37.300214 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f981ff1-cbbc-4cfe-9883-ffa69b89fc7d None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:37.300484 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f981ff1-cbbc-4cfe-9883-ffa69b89fc7d None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:37.300744 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f981ff1-cbbc-4cfe-9883-ffa69b89fc7d None admin] PATH_INFO: `/v3/projects/cc56bb49235c4d5292a50446bbce6672` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:37.301936 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f981ff1-cbbc-4cfe-9883-ffa69b89fc7d None admin] RBAC: Authorizing `identity:get_project(project_id=cc56bb49235c4d5292a50446bbce6672)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:37.303443 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f981ff1-cbbc-4cfe-9883-ffa69b89fc7d None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:37.310730 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 539/1058] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Sep 9 16:19:37 2022] GET /identity/v3/projects/cc56bb49235c4d5292a50446bbce6672 => generated 311 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 16:19:37.312120 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf862aab-b68b-4d59-9a3e-868a03677dd2 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:37.389932 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:37.426833 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf862aab-b68b-4d59-9a3e-868a03677dd2 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:37.464255 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409b5ae7-9c28-4695-a009-f38768dae9cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:37.465152 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409b5ae7-9c28-4695-a009-f38768dae9cf None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:37.465434 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409b5ae7-9c28-4695-a009-f38768dae9cf None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:37.465705 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409b5ae7-9c28-4695-a009-f38768dae9cf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:37.466463 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409b5ae7-9c28-4695-a009-f38768dae9cf None admin] RBAC: Adding query filter params (role.id=0a36d1be416f4089be19be979943b731, scope.project.id=cc56bb49235c4d5292a50446bbce6672, user.id=899f26c4d3e8486b928668f3c9be08fa) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:19:37.466774 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409b5ae7-9c28-4695-a009-f38768dae9cf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:37.468221 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409b5ae7-9c28-4695-a009-f38768dae9cf None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:37.473660 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 520/1059] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Sep 9 16:19:37 2022] GET /identity/v3/role_assignments?user.id=899f26c4d3e8486b928668f3c9be08fa&scope.project.id=cc56bb49235c4d5292a50446bbce6672&role.id=0a36d1be416f4089be19be979943b731 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:19:38.701297 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5c0995-5681-45c2-bc83-fa30900d5c12 None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:38.701910 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5c0995-5681-45c2-bc83-fa30900d5c12 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:38.701910 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5c0995-5681-45c2-bc83-fa30900d5c12 None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:38.703344 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 540/1060] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:19:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:19:38.708224 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510478e5-8d75-4ca6-bf09-5a08a9ba309c None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:38.708620 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510478e5-8d75-4ca6-bf09-5a08a9ba309c None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:38.708780 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510478e5-8d75-4ca6-bf09-5a08a9ba309c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:38.727905 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-510478e5-8d75-4ca6-bf09-5a08a9ba309c None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:19:38.729049 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-510478e5-8d75-4ca6-bf09-5a08a9ba309c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:19:38.795592 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 521/1061] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:19:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 16:19:39.057314 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5c0995-5681-45c2-bc83-fa30900d5c12 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:39.161606 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5c0995-5681-45c2-bc83-fa30900d5c12 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:39.195492 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb9b81e-8933-487c-b569-95bca788c794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:39.196114 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb9b81e-8933-487c-b569-95bca788c794 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:39.196393 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb9b81e-8933-487c-b569-95bca788c794 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:39.196660 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb9b81e-8933-487c-b569-95bca788c794 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:39.207186 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb9b81e-8933-487c-b569-95bca788c794 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 16:19:39.211895 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-2fb9b81e-8933-487c-b569-95bca788c794 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 09 16:19:39.211895 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:19:39.211895 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:19:39.211895 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:19:39.211895 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:19:39.211895 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:19:39.211895 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:19:39.211895 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:19:39.211895 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:19:39.211895 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:19:39.211895 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:19:39.211895 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:19:39.211895 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 16:19:39.211895 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 16:19:39.211895 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 16:19:39.211895 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 16:19:39.212882 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 16:19:39.212882 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 16:19:39.212882 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 16:19:39.212882 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 16:19:39.212882 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:19:39.212882 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:19:39.212882 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:19:39.212882 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:19:39.212882 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:19:39.212882 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:19:39.212882 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:19:39.212882 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Sep 09 16:19:39.212882 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:19:39.212882 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:19:39.212882 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:19:39.212882 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:19:39.213789 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:19:39.213789 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:19:39.213789 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:19:39.213789 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:19:39.213789 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 16:19:39.213789 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 16:19:39.213789 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 16:19:39.213789 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 16:19:39.213789 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 16:19:39.213789 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 16:19:39.213789 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 09 16:19:39.213789 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:19:39.221718 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 541/1062] 10.222.0.27 () {56 vars in 1120 bytes} [Fri Sep 9 16:19:39 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:19:39.221875 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510478e5-8d75-4ca6-bf09-5a08a9ba309c None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:39.289594 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:39.324949 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510478e5-8d75-4ca6-bf09-5a08a9ba309c None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:39.362072 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf79636-aaca-4b59-8cf8-5468d374930c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:39.362755 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf79636-aaca-4b59-8cf8-5468d374930c None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:39.363033 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf79636-aaca-4b59-8cf8-5468d374930c None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:39.363298 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf79636-aaca-4b59-8cf8-5468d374930c None admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:39.363947 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf79636-aaca-4b59-8cf8-5468d374930c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:19:39.364239 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf79636-aaca-4b59-8cf8-5468d374930c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:39.365598 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf79636-aaca-4b59-8cf8-5468d374930c None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:39.373679 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 522/1063] 10.222.0.27 () {56 vars in 1115 bytes} [Fri Sep 9 16:19:39 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:19:39.379669 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb9b81e-8933-487c-b569-95bca788c794 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:39.424210 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:39.443875 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b650d408-59ec-4f14-9b76-08ab18f81706 None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:39.444169 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b650d408-59ec-4f14-9b76-08ab18f81706 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:39.444440 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b650d408-59ec-4f14-9b76-08ab18f81706 None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:39.445931 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 523/1064] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:19:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 16:19:39.451085 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1bc237-e2e8-4c46-8ab7-bbc7e7005998 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:39.451366 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1bc237-e2e8-4c46-8ab7-bbc7e7005998 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:39.451637 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1bc237-e2e8-4c46-8ab7-bbc7e7005998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:39.471074 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-0c1bc237-e2e8-4c46-8ab7-bbc7e7005998 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:19:39.472703 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-0c1bc237-e2e8-4c46-8ab7-bbc7e7005998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:19:39.487518 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb9b81e-8933-487c-b569-95bca788c794 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:39.526645 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8913174-b015-4072-bbb4-92622beba4ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:39.527299 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8913174-b015-4072-bbb4-92622beba4ca None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:39.527579 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8913174-b015-4072-bbb4-92622beba4ca None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:39.527853 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8913174-b015-4072-bbb4-92622beba4ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:39.540001 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8913174-b015-4072-bbb4-92622beba4ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:39.541462 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8913174-b015-4072-bbb4-92622beba4ca None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:39.556312 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 524/1065] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:19:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 16:19:39.556905 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-a8913174-b015-4072-bbb4-92622beba4ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 16:19:39.556905 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:19:39.556905 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:19:39.556905 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:19:39.556905 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:19:39.556905 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:19:39.556905 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:19:39.556905 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:19:39.556905 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:19:39.556905 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:19:39.556905 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:19:39.556905 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:19:39.556905 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 16:19:39.556905 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 16:19:39.556905 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 16:19:39.556905 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 16:19:39.557827 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:19:39.557827 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:19:39.557827 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:19:39.557827 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:19:39.557827 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:19:39.557827 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:19:39.557827 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:19:39.557827 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Sep 09 16:19:39.557827 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:19:39.557827 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:19:39.557827 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:19:39.557827 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:19:39.557827 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:19:39.557827 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:19:39.557827 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:19:39.557827 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:19:39.557827 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 16:19:39.558881 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 16:19:39.558881 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 16:19:39.558881 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:19:39.558881 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 542/1066] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 16:19:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:19:39.568510 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1bc237-e2e8-4c46-8ab7-bbc7e7005998 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:39.629870 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:39.633116 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5d0562-7464-4901-b040-434665e574a3 None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:39.633637 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5d0562-7464-4901-b040-434665e574a3 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:39.633990 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5d0562-7464-4901-b040-434665e574a3 None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:39.635906 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 543/1067] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:19:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:19:39.642993 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66eb594-17d9-4542-bc25-2ae9be33f921 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:39.643343 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66eb594-17d9-4542-bc25-2ae9be33f921 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:39.643687 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66eb594-17d9-4542-bc25-2ae9be33f921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:39.661847 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-f66eb594-17d9-4542-bc25-2ae9be33f921 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:19:39.663057 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-f66eb594-17d9-4542-bc25-2ae9be33f921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:19:39.679751 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1bc237-e2e8-4c46-8ab7-bbc7e7005998 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:39.717693 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df831f7b-ccd8-4f48-b368-02d3ff703443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:39.718517 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df831f7b-ccd8-4f48-b368-02d3ff703443 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:39.718660 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df831f7b-ccd8-4f48-b368-02d3ff703443 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:39.718942 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df831f7b-ccd8-4f48-b368-02d3ff703443 None admin] PATH_INFO: `/v3/domains` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:39.719576 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df831f7b-ccd8-4f48-b368-02d3ff703443 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:19:39.719886 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df831f7b-ccd8-4f48-b368-02d3ff703443 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:39.721442 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df831f7b-ccd8-4f48-b368-02d3ff703443 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:39.736909 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 525/1068] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Sep 9 16:19:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:19:39.743133 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df831f7b-ccd8-4f48-b368-02d3ff703443 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:39.759198 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 544/1069] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:19:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 16:19:39.825103 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66eb594-17d9-4542-bc25-2ae9be33f921 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:39.847137 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df831f7b-ccd8-4f48-b368-02d3ff703443 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:39.850996 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:39.866095 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:39.884430 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c945d8-340f-4c90-8b69-c63d7e49c0b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:39.884983 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c945d8-340f-4c90-8b69-c63d7e49c0b1 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:39.885256 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c945d8-340f-4c90-8b69-c63d7e49c0b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:39.885524 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c945d8-340f-4c90-8b69-c63d7e49c0b1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:39.893000 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c945d8-340f-4c90-8b69-c63d7e49c0b1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:39.894453 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c945d8-340f-4c90-8b69-c63d7e49c0b1 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:39.905395 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-59c945d8-340f-4c90-8b69-c63d7e49c0b1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 09 16:19:39.905395 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:19:39.905395 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:19:39.905395 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:19:39.905395 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:19:39.905395 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:19:39.905395 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:19:39.905395 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:19:39.905395 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:19:39.905395 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:19:39.905395 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:19:39.905395 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:19:39.905395 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 16:19:39.905395 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 16:19:39.905395 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 16:19:39.905395 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 16:19:39.906560 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:19:39.906560 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:19:39.906560 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 16:19:39.906560 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 16:19:39.906560 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 16:19:39.906560 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 16:19:39.906560 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:19:39.906560 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:19:39.906560 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:19:39.906560 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:19:39.906560 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:19:39.906560 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 16:19:39.906560 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:19:39.906560 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:19:39.906560 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:19:39.906560 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:19:39.906560 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:19:39.906560 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:19:39.907710 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:19:39.907710 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:19:39.907710 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 16:19:39.907710 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 16:19:39.907710 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 16:19:39.907710 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 16:19:39.907710 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 16:19:39.907710 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 16:19:39.907710 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 09 16:19:39.907710 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 16:19:39.910464 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 526/1070] 10.222.0.27 () {56 vars in 1093 bytes} [Fri Sep 9 16:19:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 16:19:39.912273 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c945d8-340f-4c90-8b69-c63d7e49c0b1 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:39.938639 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66eb594-17d9-4542-bc25-2ae9be33f921 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:39.976008 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5391d77b-deea-4111-b697-ad0657c262a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:39.976656 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5391d77b-deea-4111-b697-ad0657c262a7 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:39.976939 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5391d77b-deea-4111-b697-ad0657c262a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:39.977206 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5391d77b-deea-4111-b697-ad0657c262a7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:40.020784 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c945d8-340f-4c90-8b69-c63d7e49c0b1 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:40.045562 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5391d77b-deea-4111-b697-ad0657c262a7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:40.047109 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5391d77b-deea-4111-b697-ad0657c262a7 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:40.054677 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0415d8b-3ab7-44da-8492-3982c1514a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:40.055283 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0415d8b-3ab7-44da-8492-3982c1514a15 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:40.055555 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0415d8b-3ab7-44da-8492-3982c1514a15 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:40.055823 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0415d8b-3ab7-44da-8492-3982c1514a15 None admin] PATH_INFO: `/v3/users` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:40.056533 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0415d8b-3ab7-44da-8492-3982c1514a15 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:19:40.056831 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0415d8b-3ab7-44da-8492-3982c1514a15 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:40.058245 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0415d8b-3ab7-44da-8492-3982c1514a15 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:40.070753 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:40.075518 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 527/1071] 10.222.0.27 () {56 vars in 1133 bytes} [Fri Sep 9 16:19:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:19:40.076164 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0415d8b-3ab7-44da-8492-3982c1514a15 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:40.108976 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:40.146160 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 545/1072] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Sep 9 16:19:39 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 09 16:19:40.147035 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5391d77b-deea-4111-b697-ad0657c262a7 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:40.175799 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0415d8b-3ab7-44da-8492-3982c1514a15 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:40.208374 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70f2f98-788e-4e02-ba3d-7dd3f5711df3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:40.208994 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70f2f98-788e-4e02-ba3d-7dd3f5711df3 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:40.209267 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70f2f98-788e-4e02-ba3d-7dd3f5711df3 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:40.209533 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70f2f98-788e-4e02-ba3d-7dd3f5711df3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:40.219427 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70f2f98-788e-4e02-ba3d-7dd3f5711df3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 16:19:40.224613 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-c70f2f98-788e-4e02-ba3d-7dd3f5711df3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 16:19:40.224613 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:19:40.224613 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:19:40.224613 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:19:40.224613 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:19:40.224613 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:19:40.224613 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:19:40.224613 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:19:40.224613 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:19:40.224613 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:19:40.224613 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:19:40.224613 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:19:40.224613 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 16:19:40.224613 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 16:19:40.224613 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 16:19:40.224613 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 16:19:40.225536 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 16:19:40.225536 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 16:19:40.225536 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 16:19:40.225536 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 16:19:40.225536 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:19:40.225536 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:19:40.225536 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:19:40.225536 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:19:40.225536 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:19:40.225536 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:19:40.225536 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:19:40.225536 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 16:19:40.225536 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:19:40.225536 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:19:40.225536 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:19:40.225536 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:19:40.226416 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:19:40.226416 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:19:40.226416 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:19:40.226416 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:19:40.226416 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 16:19:40.226416 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 16:19:40.226416 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 16:19:40.226416 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 16:19:40.226416 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 16:19:40.226416 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 16:19:40.226416 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 16:19:40.226416 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 16:19:40.226416 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 528/1073] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Sep 9 16:19:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:19:40.226416 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70f2f98-788e-4e02-ba3d-7dd3f5711df3 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:40.249211 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5391d77b-deea-4111-b697-ad0657c262a7 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:40.271388 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:40.286717 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8c9f45-cd5f-4ea4-a151-ca46b2c6e598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:40.287344 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8c9f45-cd5f-4ea4-a151-ca46b2c6e598 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:40.287623 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8c9f45-cd5f-4ea4-a151-ca46b2c6e598 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:40.287892 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8c9f45-cd5f-4ea4-a151-ca46b2c6e598 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:40.297810 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8c9f45-cd5f-4ea4-a151-ca46b2c6e598 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:40.299817 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8c9f45-cd5f-4ea4-a151-ca46b2c6e598 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:40.314322 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-0a8c9f45-cd5f-4ea4-a151-ca46b2c6e598 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 16:19:40.314322 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:19:40.314322 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:19:40.314322 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:19:40.314322 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:19:40.314322 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:19:40.314322 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:19:40.314322 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:19:40.314322 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:19:40.314322 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:19:40.314322 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:19:40.314322 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:19:40.314322 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 16:19:40.314322 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 16:19:40.314322 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 16:19:40.314322 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 16:19:40.315345 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:19:40.315345 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:19:40.315345 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:19:40.315345 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:19:40.315345 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:19:40.315345 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:19:40.315345 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:19:40.315345 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Sep 09 16:19:40.315345 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:19:40.315345 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:19:40.315345 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:19:40.315345 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:19:40.315345 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:19:40.315345 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:19:40.315345 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:19:40.315345 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:19:40.315345 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 16:19:40.316231 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 16:19:40.316231 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 16:19:40.316231 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:19:40.316231 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 546/1074] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 16:19:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:19:40.316469 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8c9f45-cd5f-4ea4-a151-ca46b2c6e598 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:40.325365 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:40.331643 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70f2f98-788e-4e02-ba3d-7dd3f5711df3 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:40.365544 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0def7f-1be2-4ba1-a379-4bd8d477e89d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:40.366172 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0def7f-1be2-4ba1-a379-4bd8d477e89d None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:40.366482 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0def7f-1be2-4ba1-a379-4bd8d477e89d None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:40.366753 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0def7f-1be2-4ba1-a379-4bd8d477e89d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:40.376505 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0def7f-1be2-4ba1-a379-4bd8d477e89d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:40.377946 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0def7f-1be2-4ba1-a379-4bd8d477e89d None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:40.393124 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-2a0def7f-1be2-4ba1-a379-4bd8d477e89d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 16:19:40.393124 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:19:40.393124 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:19:40.393124 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:19:40.393124 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:19:40.393124 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:19:40.393124 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:19:40.393124 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:19:40.393124 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:19:40.393124 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:19:40.393124 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:19:40.393124 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:19:40.393124 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 16:19:40.393124 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 16:19:40.393124 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 16:19:40.393124 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 16:19:40.394043 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:19:40.394043 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:19:40.394043 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:19:40.394043 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:19:40.394043 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:19:40.394043 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:19:40.394043 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:19:40.394043 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 16:19:40.394043 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:19:40.394043 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:19:40.394043 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:19:40.394043 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:19:40.394043 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:19:40.394043 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:19:40.394043 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:19:40.394043 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:19:40.394043 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 16:19:40.394983 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 16:19:40.394983 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 16:19:40.394983 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 16:19:40.394983 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 529/1075] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 16:19:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:19:40.394983 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0def7f-1be2-4ba1-a379-4bd8d477e89d None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:40.416546 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8c9f45-cd5f-4ea4-a151-ca46b2c6e598 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:40.448863 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c50dd7-d1a6-4485-8bc7-2ecb92b97ac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:40.449455 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c50dd7-d1a6-4485-8bc7-2ecb92b97ac1 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:40.449731 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c50dd7-d1a6-4485-8bc7-2ecb92b97ac1 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:40.450007 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c50dd7-d1a6-4485-8bc7-2ecb92b97ac1 None admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:40.450675 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c50dd7-d1a6-4485-8bc7-2ecb92b97ac1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:19:40.450972 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c50dd7-d1a6-4485-8bc7-2ecb92b97ac1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:40.452320 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c50dd7-d1a6-4485-8bc7-2ecb92b97ac1 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:40.461005 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 547/1076] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Sep 9 16:19:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:19:40.461764 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c50dd7-d1a6-4485-8bc7-2ecb92b97ac1 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:40.496271 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:40.496856 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0def7f-1be2-4ba1-a379-4bd8d477e89d None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:40.529634 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96040c08-1816-4b31-a01b-c4a06c7b86b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:40.530224 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96040c08-1816-4b31-a01b-c4a06c7b86b1 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:40.530532 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96040c08-1816-4b31-a01b-c4a06c7b86b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:40.530798 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96040c08-1816-4b31-a01b-c4a06c7b86b1 None admin] PATH_INFO: `/v3/domains` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:40.531421 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96040c08-1816-4b31-a01b-c4a06c7b86b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:19:40.531712 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96040c08-1816-4b31-a01b-c4a06c7b86b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:40.533662 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96040c08-1816-4b31-a01b-c4a06c7b86b1 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:40.545439 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 530/1077] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Sep 9 16:19:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:19:40.546149 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96040c08-1816-4b31-a01b-c4a06c7b86b1 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:40.559633 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:40.561792 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c50dd7-d1a6-4485-8bc7-2ecb92b97ac1 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:40.596285 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ed1259-f99c-46cb-88b1-59160daf224d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:40.596882 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ed1259-f99c-46cb-88b1-59160daf224d None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:40.597162 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ed1259-f99c-46cb-88b1-59160daf224d None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:40.597436 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ed1259-f99c-46cb-88b1-59160daf224d None admin] PATH_INFO: `/v3/domains` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:40.598056 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ed1259-f99c-46cb-88b1-59160daf224d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:19:40.598387 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ed1259-f99c-46cb-88b1-59160daf224d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:40.599871 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ed1259-f99c-46cb-88b1-59160daf224d None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:40.610893 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 548/1078] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Sep 9 16:19:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:19:40.611671 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ed1259-f99c-46cb-88b1-59160daf224d None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:40.655413 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96040c08-1816-4b31-a01b-c4a06c7b86b1 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:40.695057 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999fbb2a-f087-414f-82c3-e75dc51f6675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:40.695614 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999fbb2a-f087-414f-82c3-e75dc51f6675 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:40.695898 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999fbb2a-f087-414f-82c3-e75dc51f6675 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:40.696187 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999fbb2a-f087-414f-82c3-e75dc51f6675 None admin] PATH_INFO: `/v3/users/899f26c4d3e8486b928668f3c9be08fa` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:40.697404 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999fbb2a-f087-414f-82c3-e75dc51f6675 None admin] RBAC: Authorizing `identity:get_user(user_id=899f26c4d3e8486b928668f3c9be08fa)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:40.698893 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999fbb2a-f087-414f-82c3-e75dc51f6675 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:40.700537 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 531/1079] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Sep 9 16:19:40 2022] GET /identity/v3/users/899f26c4d3e8486b928668f3c9be08fa => generated 285 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:19:40.707610 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999fbb2a-f087-414f-82c3-e75dc51f6675 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:40.741375 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:40.750226 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ed1259-f99c-46cb-88b1-59160daf224d None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:40.796751 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:40.801882 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47513cd-28d5-41a9-92ce-b7687229f777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:40.802566 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47513cd-28d5-41a9-92ce-b7687229f777 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:40.803014 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47513cd-28d5-41a9-92ce-b7687229f777 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:40.803295 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47513cd-28d5-41a9-92ce-b7687229f777 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:40.813327 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47513cd-28d5-41a9-92ce-b7687229f777 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:40.815302 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47513cd-28d5-41a9-92ce-b7687229f777 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:40.826380 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999fbb2a-f087-414f-82c3-e75dc51f6675 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:40.828213 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-f47513cd-28d5-41a9-92ce-b7687229f777 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 16:19:40.828213 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:19:40.828213 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:19:40.828213 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:19:40.828213 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:19:40.828213 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:19:40.828213 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:19:40.828213 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:19:40.828213 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:19:40.828213 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:19:40.828213 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:19:40.828213 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:19:40.828213 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 16:19:40.828213 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 16:19:40.828213 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 16:19:40.829087 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 16:19:40.829087 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:19:40.829087 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:19:40.829087 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:19:40.829087 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:19:40.829087 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:19:40.829087 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:19:40.829087 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:19:40.829087 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Sep 09 16:19:40.829087 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:19:40.829087 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:19:40.829087 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:19:40.829087 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:19:40.829087 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:19:40.829087 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:19:40.829087 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:19:40.829087 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:19:40.830717 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 16:19:40.830717 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 16:19:40.830717 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 16:19:40.830717 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 16:19:40.830717 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 16:19:40.830717 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 16:19:40.830717 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 16:19:40.830717 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:19:40.830717 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 549/1080] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Sep 9 16:19:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:19:40.835731 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47513cd-28d5-41a9-92ce-b7687229f777 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:40.868451 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ed166b-cf6b-44b6-8525-d9d5ed71b576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:40.869080 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ed166b-cf6b-44b6-8525-d9d5ed71b576 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:40.869358 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ed166b-cf6b-44b6-8525-d9d5ed71b576 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:40.869628 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ed166b-cf6b-44b6-8525-d9d5ed71b576 None admin] PATH_INFO: `/v3/projects/cc56bb49235c4d5292a50446bbce6672` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:40.871000 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ed166b-cf6b-44b6-8525-d9d5ed71b576 None admin] RBAC: Authorizing `identity:get_project(project_id=cc56bb49235c4d5292a50446bbce6672)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:40.872468 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ed166b-cf6b-44b6-8525-d9d5ed71b576 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:40.874477 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 532/1081] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Sep 9 16:19:40 2022] GET /identity/v3/projects/cc56bb49235c4d5292a50446bbce6672 => generated 311 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 16:19:40.880726 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ed166b-cf6b-44b6-8525-d9d5ed71b576 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:40.951415 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47513cd-28d5-41a9-92ce-b7687229f777 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:40.983333 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ed166b-cf6b-44b6-8525-d9d5ed71b576 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:40.984435 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beab9f31-f111-48da-bd6f-7b1e4b2296ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:40.985038 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beab9f31-f111-48da-bd6f-7b1e4b2296ab None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:40.985308 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beab9f31-f111-48da-bd6f-7b1e4b2296ab None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:40.985579 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beab9f31-f111-48da-bd6f-7b1e4b2296ab None admin] PATH_INFO: `/v3/projects` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:40.986273 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beab9f31-f111-48da-bd6f-7b1e4b2296ab None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:19:40.986598 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beab9f31-f111-48da-bd6f-7b1e4b2296ab None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:40.988012 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beab9f31-f111-48da-bd6f-7b1e4b2296ab None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:40.999678 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 550/1082] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Sep 9 16:19:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 16:19:41.006072 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beab9f31-f111-48da-bd6f-7b1e4b2296ab None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:41.016814 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006c77cd-c179-43ff-a010-309d9232cbb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:41.018014 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006c77cd-c179-43ff-a010-309d9232cbb7 None admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:41.018292 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006c77cd-c179-43ff-a010-309d9232cbb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:41.018589 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006c77cd-c179-43ff-a010-309d9232cbb7 None admin] PATH_INFO: `/v3/projects/cc56bb49235c4d5292a50446bbce6672/users/899f26c4d3e8486b928668f3c9be08fa/roles/0a36d1be416f4089be19be979943b731` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:41.020506 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006c77cd-c179-43ff-a010-309d9232cbb7 None admin] RBAC: Authorizing `identity:create_grant(project_id=cc56bb49235c4d5292a50446bbce6672, user_id=899f26c4d3e8486b928668f3c9be08fa, role_id=0a36d1be416f4089be19be979943b731)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:41.021938 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006c77cd-c179-43ff-a010-309d9232cbb7 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:41.023309 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:41.034908 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 533/1083] 10.222.0.27 () {58 vars in 1439 bytes} [Fri Sep 9 16:19:40 2022] PUT /identity/v3/projects/cc56bb49235c4d5292a50446bbce6672/users/899f26c4d3e8486b928668f3c9be08fa/roles/0a36d1be416f4089be19be979943b731 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 16:19:41.110072 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beab9f31-f111-48da-bd6f-7b1e4b2296ab None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:41.146808 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d707f28e-90fc-437f-9fbf-aa88032441d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:41.147486 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d707f28e-90fc-437f-9fbf-aa88032441d7 None admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:41.147766 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d707f28e-90fc-437f-9fbf-aa88032441d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:41.148050 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d707f28e-90fc-437f-9fbf-aa88032441d7 None admin] PATH_INFO: `/v3/projects/68d6aaafab824657b08ca91f3d46d5f8/users/a332b9b4980646a3b14633293f77b505/roles/e2a4c6d72b844015a5daa58530c8a567` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:41.150286 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d707f28e-90fc-437f-9fbf-aa88032441d7 None admin] RBAC: Authorizing `identity:create_grant(project_id=68d6aaafab824657b08ca91f3d46d5f8, user_id=a332b9b4980646a3b14633293f77b505, role_id=e2a4c6d72b844015a5daa58530c8a567)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:41.151765 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d707f28e-90fc-437f-9fbf-aa88032441d7 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:41.166173 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 551/1084] 10.222.0.27 () {58 vars in 1439 bytes} [Fri Sep 9 16:19:41 2022] PUT /identity/v3/projects/68d6aaafab824657b08ca91f3d46d5f8/users/a332b9b4980646a3b14633293f77b505/roles/e2a4c6d72b844015a5daa58530c8a567 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 16:19:43.168458 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758fcf51-ae63-49f6-a09b-13808507f8b3 None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:43.169046 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758fcf51-ae63-49f6-a09b-13808507f8b3 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:43.169046 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758fcf51-ae63-49f6-a09b-13808507f8b3 None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:43.170368 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 534/1085] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:19:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:19:43.177009 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1114941-d3c8-4523-9c9a-e0a06c5c47e4 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:43.177542 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1114941-d3c8-4523-9c9a-e0a06c5c47e4 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:43.177542 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1114941-d3c8-4523-9c9a-e0a06c5c47e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:43.196780 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-b1114941-d3c8-4523-9c9a-e0a06c5c47e4 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:19:43.197990 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-b1114941-d3c8-4523-9c9a-e0a06c5c47e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:19:43.264041 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 552/1086] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:19:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 16:19:43.289156 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840a1f3e-15c1-4189-8863-e34b9899c70f None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:43.289438 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840a1f3e-15c1-4189-8863-e34b9899c70f None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:43.289703 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840a1f3e-15c1-4189-8863-e34b9899c70f None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:43.291054 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 535/1087] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:19:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:19:43.296266 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9f5051-2f50-4a51-8c95-ced3d3e10340 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:43.296554 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9f5051-2f50-4a51-8c95-ced3d3e10340 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:43.296829 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9f5051-2f50-4a51-8c95-ced3d3e10340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:43.309473 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:43.316193 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-5c9f5051-2f50-4a51-8c95-ced3d3e10340 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:19:43.317517 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-5c9f5051-2f50-4a51-8c95-ced3d3e10340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:19:43.381977 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 553/1088] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:19:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 16:19:43.536167 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840a1f3e-15c1-4189-8863-e34b9899c70f None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:43.540645 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:43.635152 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840a1f3e-15c1-4189-8863-e34b9899c70f None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:43.662035 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9f5051-2f50-4a51-8c95-ced3d3e10340 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:43.668635 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6843660-f14f-4a39-b967-b62af1f4fd31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:43.669250 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6843660-f14f-4a39-b967-b62af1f4fd31 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:43.669521 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6843660-f14f-4a39-b967-b62af1f4fd31 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:43.669785 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6843660-f14f-4a39-b967-b62af1f4fd31 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:43.679716 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6843660-f14f-4a39-b967-b62af1f4fd31 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 16:19:43.684364 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-b6843660-f14f-4a39-b967-b62af1f4fd31 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 16:19:43.684364 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:19:43.684364 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:19:43.684364 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:19:43.684364 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:19:43.684364 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:19:43.684364 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:19:43.684364 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:19:43.684364 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:19:43.684364 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:19:43.684364 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:19:43.684364 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:19:43.684364 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 16:19:43.684364 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 16:19:43.684364 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 16:19:43.684364 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 16:19:43.686466 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 16:19:43.686466 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 16:19:43.686466 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 16:19:43.686466 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 16:19:43.686466 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:19:43.686466 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:19:43.686466 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:19:43.686466 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:19:43.686466 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:19:43.686466 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:19:43.686466 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:19:43.686466 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 16:19:43.686466 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:19:43.686466 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:19:43.686466 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:19:43.686466 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:19:43.687640 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:19:43.687640 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:19:43.687640 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:19:43.687640 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:19:43.687640 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 16:19:43.687640 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 16:19:43.687640 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 16:19:43.687640 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 16:19:43.687640 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 16:19:43.687640 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 16:19:43.687640 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 16:19:43.687640 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 16:19:43.687640 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 536/1089] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Sep 9 16:19:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:19:43.691453 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6843660-f14f-4a39-b967-b62af1f4fd31 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:43.752304 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:43.761993 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9f5051-2f50-4a51-8c95-ced3d3e10340 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:43.792973 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6843660-f14f-4a39-b967-b62af1f4fd31 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:43.797780 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b481e31b-1f08-4a16-bb08-dc91c2cca536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:43.798438 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b481e31b-1f08-4a16-bb08-dc91c2cca536 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:43.798721 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b481e31b-1f08-4a16-bb08-dc91c2cca536 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:43.798993 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b481e31b-1f08-4a16-bb08-dc91c2cca536 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:43.801925 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:43.812215 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b481e31b-1f08-4a16-bb08-dc91c2cca536 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 16:19:43.817518 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-b481e31b-1f08-4a16-bb08-dc91c2cca536 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 09 16:19:43.817518 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:19:43.817518 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:19:43.817518 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:19:43.817518 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:19:43.817518 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:19:43.817518 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:19:43.817518 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:19:43.817518 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:19:43.817518 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:19:43.817518 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:19:43.817518 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:19:43.817518 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 16:19:43.817518 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 16:19:43.817518 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 16:19:43.817518 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 16:19:43.818490 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 16:19:43.818490 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 16:19:43.818490 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 16:19:43.818490 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 16:19:43.818490 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:19:43.818490 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:19:43.818490 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:19:43.818490 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:19:43.818490 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:19:43.818490 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:19:43.818490 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:19:43.818490 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Sep 09 16:19:43.818490 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:19:43.818490 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:19:43.818490 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:19:43.818490 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:19:43.819357 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:19:43.819357 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:19:43.819357 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:19:43.819357 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:19:43.819357 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 16:19:43.819357 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 16:19:43.819357 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 16:19:43.819357 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 16:19:43.819357 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 16:19:43.819357 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 16:19:43.819357 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 09 16:19:43.819357 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:19:43.819357 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 554/1090] 10.222.0.27 () {56 vars in 1120 bytes} [Fri Sep 9 16:19:43 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 16:19:43.824492 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b481e31b-1f08-4a16-bb08-dc91c2cca536 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:43.835293 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267635d9-dae4-427c-877f-679411c31f5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:43.835904 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267635d9-dae4-427c-877f-679411c31f5e None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:43.836305 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267635d9-dae4-427c-877f-679411c31f5e None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:43.836714 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267635d9-dae4-427c-877f-679411c31f5e None admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:43.837477 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267635d9-dae4-427c-877f-679411c31f5e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:19:43.837777 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267635d9-dae4-427c-877f-679411c31f5e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:43.839478 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267635d9-dae4-427c-877f-679411c31f5e None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:43.848058 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 537/1091] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Sep 9 16:19:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 16:19:43.853859 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267635d9-dae4-427c-877f-679411c31f5e None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:43.924039 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b481e31b-1f08-4a16-bb08-dc91c2cca536 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:43.951088 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267635d9-dae4-427c-877f-679411c31f5e None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:43.957872 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5bb91b-268f-4749-be1f-863b01c5c0ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:43.958506 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5bb91b-268f-4749-be1f-863b01c5c0ff None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:43.958791 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5bb91b-268f-4749-be1f-863b01c5c0ff None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:43.959063 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5bb91b-268f-4749-be1f-863b01c5c0ff None admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:43.959717 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5bb91b-268f-4749-be1f-863b01c5c0ff None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:19:43.960019 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5bb91b-268f-4749-be1f-863b01c5c0ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:43.961389 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5bb91b-268f-4749-be1f-863b01c5c0ff None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:43.969412 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 555/1092] 10.222.0.27 () {56 vars in 1115 bytes} [Fri Sep 9 16:19:43 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 16:19:43.975182 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5bb91b-268f-4749-be1f-863b01c5c0ff None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:43.979991 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:43.989213 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a78505-41e4-434d-828c-284a3364f863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:43.989837 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a78505-41e4-434d-828c-284a3364f863 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:43.990113 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a78505-41e4-434d-828c-284a3364f863 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:43.990405 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a78505-41e4-434d-828c-284a3364f863 None admin] PATH_INFO: `/v3/users/899f26c4d3e8486b928668f3c9be08fa` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:43.991509 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a78505-41e4-434d-828c-284a3364f863 None admin] RBAC: Authorizing `identity:get_user(user_id=899f26c4d3e8486b928668f3c9be08fa)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:43.992933 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a78505-41e4-434d-828c-284a3364f863 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:43.994521 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 538/1093] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Sep 9 16:19:43 2022] GET /identity/v3/users/899f26c4d3e8486b928668f3c9be08fa => generated 285 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 16:19:44.000080 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a78505-41e4-434d-828c-284a3364f863 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:44.033069 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:44.075830 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5bb91b-268f-4749-be1f-863b01c5c0ff None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:44.097474 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a78505-41e4-434d-828c-284a3364f863 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:44.109003 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af936ddf-f749-4665-8e34-05b93604dd46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:44.109626 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af936ddf-f749-4665-8e34-05b93604dd46 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:44.109898 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af936ddf-f749-4665-8e34-05b93604dd46 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:44.110166 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af936ddf-f749-4665-8e34-05b93604dd46 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:44.120927 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af936ddf-f749-4665-8e34-05b93604dd46 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:44.122408 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af936ddf-f749-4665-8e34-05b93604dd46 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:44.135051 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27c3034-d141-484c-b2c5-b519e66447f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:44.135645 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27c3034-d141-484c-b2c5-b519e66447f0 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:44.135922 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27c3034-d141-484c-b2c5-b519e66447f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:44.136190 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27c3034-d141-484c-b2c5-b519e66447f0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:44.136876 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-af936ddf-f749-4665-8e34-05b93604dd46 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 16:19:44.136876 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:19:44.136876 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:19:44.136876 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:19:44.136876 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:19:44.136876 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:19:44.136876 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:19:44.136876 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:19:44.136876 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:19:44.136876 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:19:44.136876 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:19:44.136876 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:19:44.136876 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 16:19:44.136876 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 16:19:44.136876 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 16:19:44.136876 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 16:19:44.137767 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:19:44.137767 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:19:44.137767 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:19:44.137767 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:19:44.137767 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:19:44.137767 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:19:44.137767 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:19:44.137767 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Sep 09 16:19:44.137767 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:19:44.137767 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:19:44.137767 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:19:44.137767 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:19:44.137767 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:19:44.137767 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:19:44.137767 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:19:44.137767 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:19:44.137767 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 16:19:44.139256 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 16:19:44.139256 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 16:19:44.139256 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:19:44.139256 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 556/1094] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 16:19:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 16:19:44.144317 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af936ddf-f749-4665-8e34-05b93604dd46 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:44.198204 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:44.206825 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27c3034-d141-484c-b2c5-b519e66447f0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:44.208278 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27c3034-d141-484c-b2c5-b519e66447f0 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:44.241504 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af936ddf-f749-4665-8e34-05b93604dd46 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:44.251978 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:44.276504 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48bc65d-ebfd-40c6-b870-75a51eac5836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:44.277116 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48bc65d-ebfd-40c6-b870-75a51eac5836 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:44.277396 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48bc65d-ebfd-40c6-b870-75a51eac5836 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:44.277669 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48bc65d-ebfd-40c6-b870-75a51eac5836 None admin] PATH_INFO: `/v3/domains` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:44.278328 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48bc65d-ebfd-40c6-b870-75a51eac5836 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:19:44.278632 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48bc65d-ebfd-40c6-b870-75a51eac5836 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:44.281700 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48bc65d-ebfd-40c6-b870-75a51eac5836 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:44.292840 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 557/1095] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Sep 9 16:19:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 16:19:44.298954 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48bc65d-ebfd-40c6-b870-75a51eac5836 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:44.312713 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 539/1096] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Sep 9 16:19:43 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 09 16:19:44.313805 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27c3034-d141-484c-b2c5-b519e66447f0 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:44.395600 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48bc65d-ebfd-40c6-b870-75a51eac5836 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:44.404332 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:44.412312 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27c3034-d141-484c-b2c5-b519e66447f0 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:44.428908 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf83299-7162-40a2-ba0d-d784969e5675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:44.429526 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf83299-7162-40a2-ba0d-d784969e5675 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:44.429805 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf83299-7162-40a2-ba0d-d784969e5675 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:44.430075 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf83299-7162-40a2-ba0d-d784969e5675 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:44.437140 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf83299-7162-40a2-ba0d-d784969e5675 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:44.438613 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf83299-7162-40a2-ba0d-d784969e5675 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:44.445218 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014d8134-9a1a-4d69-a5cc-17dcf51e2a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:44.445828 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014d8134-9a1a-4d69-a5cc-17dcf51e2a1f None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:44.446102 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014d8134-9a1a-4d69-a5cc-17dcf51e2a1f None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:44.446398 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014d8134-9a1a-4d69-a5cc-17dcf51e2a1f None admin] PATH_INFO: `/v3/projects/cc56bb49235c4d5292a50446bbce6672` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:44.447481 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014d8134-9a1a-4d69-a5cc-17dcf51e2a1f None admin] RBAC: Authorizing `identity:get_project(project_id=cc56bb49235c4d5292a50446bbce6672)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:44.448920 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014d8134-9a1a-4d69-a5cc-17dcf51e2a1f None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:44.450085 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-abf83299-7162-40a2-ba0d-d784969e5675 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 09 16:19:44.450085 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:19:44.450085 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:19:44.450085 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:19:44.450085 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:19:44.450085 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:19:44.450085 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:19:44.450085 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:19:44.450085 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:19:44.450085 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:19:44.450085 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:19:44.450085 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:19:44.450085 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 16:19:44.450085 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 16:19:44.450085 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 16:19:44.450085 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 16:19:44.451070 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:19:44.451070 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:19:44.451070 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 16:19:44.451070 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 16:19:44.451070 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 16:19:44.451070 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 16:19:44.451070 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:19:44.451070 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:19:44.451070 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:19:44.451070 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:19:44.451070 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:19:44.451070 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Sep 09 16:19:44.451070 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:19:44.451070 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:19:44.451070 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:19:44.451070 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:19:44.451070 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:19:44.451070 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:19:44.452008 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:19:44.452008 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:19:44.452008 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 16:19:44.452008 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 16:19:44.452008 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 16:19:44.452008 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 16:19:44.452008 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 16:19:44.452008 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 16:19:44.452008 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 09 16:19:44.452008 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:19:44.452544 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 540/1097] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Sep 9 16:19:44 2022] GET /identity/v3/projects/cc56bb49235c4d5292a50446bbce6672 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:19:44.452622 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 558/1098] 10.222.0.27 () {56 vars in 1093 bytes} [Fri Sep 9 16:19:44 2022] GET /identity/v3/users/nova => generated 82 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 16:19:44.457110 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014d8134-9a1a-4d69-a5cc-17dcf51e2a1f None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:44.457227 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf83299-7162-40a2-ba0d-d784969e5675 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:44.488811 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:44.553594 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014d8134-9a1a-4d69-a5cc-17dcf51e2a1f None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:44.558965 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf83299-7162-40a2-ba0d-d784969e5675 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:44.587685 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d8e7a9-00d4-446f-96ff-82c87f145e35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:44.588280 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d8e7a9-00d4-446f-96ff-82c87f145e35 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:44.588553 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d8e7a9-00d4-446f-96ff-82c87f145e35 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:44.588822 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d8e7a9-00d4-446f-96ff-82c87f145e35 None admin] PATH_INFO: `/v3/users` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:44.589529 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d8e7a9-00d4-446f-96ff-82c87f145e35 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:19:44.589835 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d8e7a9-00d4-446f-96ff-82c87f145e35 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:44.591355 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d8e7a9-00d4-446f-96ff-82c87f145e35 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:44.592786 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be62448-eb14-4d8f-816a-0cd86221c6cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:44.593384 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be62448-eb14-4d8f-816a-0cd86221c6cf None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:44.593671 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be62448-eb14-4d8f-816a-0cd86221c6cf None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:44.593939 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be62448-eb14-4d8f-816a-0cd86221c6cf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:44.594679 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be62448-eb14-4d8f-816a-0cd86221c6cf None admin] RBAC: Adding query filter params (role.id=0a36d1be416f4089be19be979943b731, scope.project.id=cc56bb49235c4d5292a50446bbce6672, user.id=899f26c4d3e8486b928668f3c9be08fa) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:19:44.594984 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be62448-eb14-4d8f-816a-0cd86221c6cf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:44.596993 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be62448-eb14-4d8f-816a-0cd86221c6cf None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:44.602912 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 559/1099] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Sep 9 16:19:44 2022] GET /identity/v3/role_assignments?user.id=899f26c4d3e8486b928668f3c9be08fa&scope.project.id=cc56bb49235c4d5292a50446bbce6672&role.id=0a36d1be416f4089be19be979943b731 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 16:19:44.608709 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 541/1100] 10.222.0.27 () {56 vars in 1133 bytes} [Fri Sep 9 16:19:44 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:19:44.615257 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be62448-eb14-4d8f-816a-0cd86221c6cf None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:44.712640 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:44.720778 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be62448-eb14-4d8f-816a-0cd86221c6cf None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:44.759127 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff371f6e-eecc-46bd-9bd5-13d7f60fb87a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:44.759743 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff371f6e-eecc-46bd-9bd5-13d7f60fb87a None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:44.760045 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff371f6e-eecc-46bd-9bd5-13d7f60fb87a None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:44.760320 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff371f6e-eecc-46bd-9bd5-13d7f60fb87a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:44.828170 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff371f6e-eecc-46bd-9bd5-13d7f60fb87a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:44.829646 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff371f6e-eecc-46bd-9bd5-13d7f60fb87a None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:44.917907 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:44.925585 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 560/1101] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Sep 9 16:19:44 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 09 16:19:44.931244 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d8e7a9-00d4-446f-96ff-82c87f145e35 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:44.952385 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:45.029105 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d8e7a9-00d4-446f-96ff-82c87f145e35 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:45.062509 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee906c0-f8d6-4c29-b0a7-d0a79f0c4f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:45.063126 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee906c0-f8d6-4c29-b0a7-d0a79f0c4f4d None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:45.063400 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee906c0-f8d6-4c29-b0a7-d0a79f0c4f4d None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:45.063665 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee906c0-f8d6-4c29-b0a7-d0a79f0c4f4d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:45.073819 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee906c0-f8d6-4c29-b0a7-d0a79f0c4f4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:45.075287 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee906c0-f8d6-4c29-b0a7-d0a79f0c4f4d None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:45.089922 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-5ee906c0-f8d6-4c29-b0a7-d0a79f0c4f4d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 16:19:45.089922 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:19:45.089922 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:19:45.089922 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:19:45.089922 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:19:45.089922 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:19:45.089922 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:19:45.089922 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:19:45.089922 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:19:45.089922 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:19:45.089922 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:19:45.089922 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:19:45.089922 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 16:19:45.089922 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 16:19:45.089922 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 16:19:45.089922 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 16:19:45.096425 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:19:45.096425 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:19:45.096425 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:19:45.096425 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:19:45.096425 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:19:45.096425 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:19:45.096425 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:19:45.096425 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 16:19:45.096425 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:19:45.096425 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:19:45.096425 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:19:45.096425 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:19:45.096425 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:19:45.096425 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:19:45.096425 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:19:45.096425 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:19:45.096425 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 16:19:45.097587 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 16:19:45.097587 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 16:19:45.097587 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 16:19:45.097587 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 542/1102] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 16:19:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 16:19:45.098248 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff371f6e-eecc-46bd-9bd5-13d7f60fb87a None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:45.194997 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff371f6e-eecc-46bd-9bd5-13d7f60fb87a None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:45.228557 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7fc5a3-af5b-47f6-a266-00b33732b343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:45.229154 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7fc5a3-af5b-47f6-a266-00b33732b343 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:45.229431 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7fc5a3-af5b-47f6-a266-00b33732b343 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:45.229723 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7fc5a3-af5b-47f6-a266-00b33732b343 None admin] PATH_INFO: `/v3/domains` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:45.230437 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7fc5a3-af5b-47f6-a266-00b33732b343 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:19:45.230740 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7fc5a3-af5b-47f6-a266-00b33732b343 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:45.232100 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7fc5a3-af5b-47f6-a266-00b33732b343 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:45.243028 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 561/1103] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Sep 9 16:19:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:19:45.248626 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee906c0-f8d6-4c29-b0a7-d0a79f0c4f4d None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:45.321842 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:45.351996 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee906c0-f8d6-4c29-b0a7-d0a79f0c4f4d None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:45.384691 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8317ade4-da19-4937-a09b-93ac5b1d7075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:45.385310 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8317ade4-da19-4937-a09b-93ac5b1d7075 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:45.385589 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8317ade4-da19-4937-a09b-93ac5b1d7075 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:45.385861 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8317ade4-da19-4937-a09b-93ac5b1d7075 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:45.392822 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8317ade4-da19-4937-a09b-93ac5b1d7075 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:45.394244 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8317ade4-da19-4937-a09b-93ac5b1d7075 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:45.405145 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-8317ade4-da19-4937-a09b-93ac5b1d7075 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 16:19:45.405145 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:19:45.405145 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:19:45.405145 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:19:45.405145 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:19:45.405145 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:19:45.405145 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:19:45.405145 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:19:45.405145 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:19:45.405145 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:19:45.405145 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:19:45.405145 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:19:45.405145 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 16:19:45.405145 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 16:19:45.405145 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 16:19:45.406107 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 16:19:45.406107 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:19:45.406107 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:19:45.406107 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:19:45.406107 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:19:45.406107 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:19:45.406107 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:19:45.406107 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:19:45.406107 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 16:19:45.406107 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:19:45.406107 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:19:45.406107 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:19:45.406107 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:19:45.406107 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:19:45.406107 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:19:45.406107 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:19:45.406107 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:19:45.407373 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 16:19:45.407373 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 16:19:45.407373 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 16:19:45.407373 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 16:19:45.407373 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 16:19:45.407373 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 16:19:45.407373 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 16:19:45.407373 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 16:19:45.407373 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 543/1104] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Sep 9 16:19:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 16:19:45.412137 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7fc5a3-af5b-47f6-a266-00b33732b343 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:45.466635 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:45.518638 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7fc5a3-af5b-47f6-a266-00b33732b343 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:45.551651 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee78dba-3611-4d6c-90d9-7c4caa96e63e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:45.552164 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee78dba-3611-4d6c-90d9-7c4caa96e63e None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:45.552440 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee78dba-3611-4d6c-90d9-7c4caa96e63e None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:45.552708 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee78dba-3611-4d6c-90d9-7c4caa96e63e None admin] PATH_INFO: `/v3/projects` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:45.553380 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee78dba-3611-4d6c-90d9-7c4caa96e63e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:19:45.553680 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee78dba-3611-4d6c-90d9-7c4caa96e63e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:45.555131 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee78dba-3611-4d6c-90d9-7c4caa96e63e None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:45.567458 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 562/1105] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Sep 9 16:19:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:19:45.573452 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8317ade4-da19-4937-a09b-93ac5b1d7075 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:45.669350 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8317ade4-da19-4937-a09b-93ac5b1d7075 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:45.697814 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:45.702978 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8e8211-74eb-4070-b12e-8f52ed3d49ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:45.703568 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8e8211-74eb-4070-b12e-8f52ed3d49ec None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:45.703847 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8e8211-74eb-4070-b12e-8f52ed3d49ec None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:45.704116 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8e8211-74eb-4070-b12e-8f52ed3d49ec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:45.704847 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8e8211-74eb-4070-b12e-8f52ed3d49ec None admin] RBAC: Adding query filter params (role.id=e2a4c6d72b844015a5daa58530c8a567, scope.project.id=68d6aaafab824657b08ca91f3d46d5f8, user.id=a332b9b4980646a3b14633293f77b505) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:19:45.705149 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8e8211-74eb-4070-b12e-8f52ed3d49ec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:45.706593 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8e8211-74eb-4070-b12e-8f52ed3d49ec None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:45.712167 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 544/1106] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Sep 9 16:19:45 2022] GET /identity/v3/role_assignments?user.id=a332b9b4980646a3b14633293f77b505&scope.project.id=68d6aaafab824657b08ca91f3d46d5f8&role.id=e2a4c6d72b844015a5daa58530c8a567 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:19:46.775516 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a16a292-4b77-4d45-b70f-a0f0149e604a None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:46.776048 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a16a292-4b77-4d45-b70f-a0f0149e604a None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:46.776048 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a16a292-4b77-4d45-b70f-a0f0149e604a None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:46.777390 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 563/1107] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:19:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:19:46.782637 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6d6290-d672-43f1-9bd2-0a3c04ea03a1 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:46.783050 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6d6290-d672-43f1-9bd2-0a3c04ea03a1 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:46.783187 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6d6290-d672-43f1-9bd2-0a3c04ea03a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:46.800950 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-df6d6290-d672-43f1-9bd2-0a3c04ea03a1 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:19:46.802125 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-df6d6290-d672-43f1-9bd2-0a3c04ea03a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:19:46.869546 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 545/1108] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:19:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 16:19:47.143426 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a16a292-4b77-4d45-b70f-a0f0149e604a None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:47.248732 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a16a292-4b77-4d45-b70f-a0f0149e604a None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:47.263568 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:47.283140 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb087dc9-a153-4b35-bf9d-4b89b3e7c615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:47.283775 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb087dc9-a153-4b35-bf9d-4b89b3e7c615 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:47.284048 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb087dc9-a153-4b35-bf9d-4b89b3e7c615 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:47.284313 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb087dc9-a153-4b35-bf9d-4b89b3e7c615 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:47.285396 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb087dc9-a153-4b35-bf9d-4b89b3e7c615 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:47.286845 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb087dc9-a153-4b35-bf9d-4b89b3e7c615 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:47.288386 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 564/1109] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 16:19:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:19:47.294174 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6d6290-d672-43f1-9bd2-0a3c04ea03a1 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:47.389252 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6d6290-d672-43f1-9bd2-0a3c04ea03a1 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:47.413298 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:47.421902 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db376f74-e103-4ec3-9b31-c1fe52e37049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:47.422532 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db376f74-e103-4ec3-9b31-c1fe52e37049 None admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:47.422807 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db376f74-e103-4ec3-9b31-c1fe52e37049 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:47.423075 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db376f74-e103-4ec3-9b31-c1fe52e37049 None admin] PATH_INFO: `/v3/users` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:47.424196 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db376f74-e103-4ec3-9b31-c1fe52e37049 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:47.425607 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db376f74-e103-4ec3-9b31-c1fe52e37049 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:47.445868 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 546/1110] 10.222.0.27 () {60 vars in 1132 bytes} [Fri Sep 9 16:19:47 2022] POST /identity/v3/users => generated 286 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:19:49.624767 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0e4fb3-9eba-413e-bc15-b636d10069f0 None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:49.625263 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0e4fb3-9eba-413e-bc15-b636d10069f0 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:49.625263 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0e4fb3-9eba-413e-bc15-b636d10069f0 None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:49.626578 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 565/1111] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:19:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:19:49.631694 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6643550a-8d90-4d30-ad5c-54a05fb07c3a None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:49.632096 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6643550a-8d90-4d30-ad5c-54a05fb07c3a None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:49.632242 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6643550a-8d90-4d30-ad5c-54a05fb07c3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:49.651254 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-6643550a-8d90-4d30-ad5c-54a05fb07c3a None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:19:49.652429 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-6643550a-8d90-4d30-ad5c-54a05fb07c3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:19:49.717191 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 547/1112] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:19:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 16:19:49.984848 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0e4fb3-9eba-413e-bc15-b636d10069f0 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:50.081634 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0e4fb3-9eba-413e-bc15-b636d10069f0 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:50.113179 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee5d18e-f5c0-4f6c-b7be-1ad8aecee194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:50.113776 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee5d18e-f5c0-4f6c-b7be-1ad8aecee194 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:50.114050 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee5d18e-f5c0-4f6c-b7be-1ad8aecee194 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:50.114330 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee5d18e-f5c0-4f6c-b7be-1ad8aecee194 None admin] PATH_INFO: `/v3/roles/9452afb4ffe54eb7b7b5b0aff7dd00ed` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:50.115694 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee5d18e-f5c0-4f6c-b7be-1ad8aecee194 None admin] RBAC: Authorizing `identity:get_role(role_id=9452afb4ffe54eb7b7b5b0aff7dd00ed)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:50.117045 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee5d18e-f5c0-4f6c-b7be-1ad8aecee194 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:50.118323 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 566/1113] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Sep 9 16:19:49 2022] GET /identity/v3/roles/9452afb4ffe54eb7b7b5b0aff7dd00ed => generated 223 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:19:50.123870 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6643550a-8d90-4d30-ad5c-54a05fb07c3a None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:50.218451 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6643550a-8d90-4d30-ad5c-54a05fb07c3a None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:50.230958 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:50.253168 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5424ba3-df6c-4175-82f6-46e67530a237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:50.253730 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5424ba3-df6c-4175-82f6-46e67530a237 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:50.254007 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5424ba3-df6c-4175-82f6-46e67530a237 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:50.254275 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5424ba3-df6c-4175-82f6-46e67530a237 None admin] PATH_INFO: `/v3/users/887d3b1fe68f4d68bcb8ba54cf444639` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:50.266871 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5424ba3-df6c-4175-82f6-46e67530a237 None admin] RBAC: Authorizing `identity:get_user(user_id=887d3b1fe68f4d68bcb8ba54cf444639)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:50.268371 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5424ba3-df6c-4175-82f6-46e67530a237 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:50.269928 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 548/1114] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Sep 9 16:19:50 2022] GET /identity/v3/users/887d3b1fe68f4d68bcb8ba54cf444639 => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:19:50.275634 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee5d18e-f5c0-4f6c-b7be-1ad8aecee194 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:50.325453 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:50.372173 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee5d18e-f5c0-4f6c-b7be-1ad8aecee194 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:50.404609 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563d7078-49f4-4664-a1c4-3c4ba0c52fcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:50.405198 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563d7078-49f4-4664-a1c4-3c4ba0c52fcb None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:50.405474 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563d7078-49f4-4664-a1c4-3c4ba0c52fcb None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:50.405741 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563d7078-49f4-4664-a1c4-3c4ba0c52fcb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:50.469605 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563d7078-49f4-4664-a1c4-3c4ba0c52fcb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:50.471061 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563d7078-49f4-4664-a1c4-3c4ba0c52fcb None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:50.516715 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:50.565302 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 567/1115] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Sep 9 16:19:50 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 09 16:19:50.571212 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5424ba3-df6c-4175-82f6-46e67530a237 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:50.666048 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5424ba3-df6c-4175-82f6-46e67530a237 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:50.698972 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6c120d-e00a-4c1b-a828-db7b4283d7ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:50.699587 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6c120d-e00a-4c1b-a828-db7b4283d7ed None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:50.699867 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6c120d-e00a-4c1b-a828-db7b4283d7ed None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:50.700137 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6c120d-e00a-4c1b-a828-db7b4283d7ed None admin] PATH_INFO: `/v3/projects/cc56bb49235c4d5292a50446bbce6672` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:50.701228 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6c120d-e00a-4c1b-a828-db7b4283d7ed None admin] RBAC: Authorizing `identity:get_project(project_id=cc56bb49235c4d5292a50446bbce6672)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:50.702685 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6c120d-e00a-4c1b-a828-db7b4283d7ed None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:50.704269 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 549/1116] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Sep 9 16:19:50 2022] GET /identity/v3/projects/cc56bb49235c4d5292a50446bbce6672 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:19:50.710261 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563d7078-49f4-4664-a1c4-3c4ba0c52fcb None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:50.807456 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563d7078-49f4-4664-a1c4-3c4ba0c52fcb None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:50.839243 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3ee10d-62b6-483a-89bb-f97e5bfbfa4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:50.839835 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3ee10d-62b6-483a-89bb-f97e5bfbfa4c None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:50.840108 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3ee10d-62b6-483a-89bb-f97e5bfbfa4c None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:50.840372 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3ee10d-62b6-483a-89bb-f97e5bfbfa4c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:50.841068 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3ee10d-62b6-483a-89bb-f97e5bfbfa4c None admin] RBAC: Adding query filter params (role.id=9452afb4ffe54eb7b7b5b0aff7dd00ed, scope.project.id=cc56bb49235c4d5292a50446bbce6672, user.id=887d3b1fe68f4d68bcb8ba54cf444639) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:19:50.841368 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3ee10d-62b6-483a-89bb-f97e5bfbfa4c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:50.842810 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3ee10d-62b6-483a-89bb-f97e5bfbfa4c None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:50.848429 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 568/1117] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Sep 9 16:19:50 2022] GET /identity/v3/role_assignments?user.id=887d3b1fe68f4d68bcb8ba54cf444639&scope.project.id=cc56bb49235c4d5292a50446bbce6672&role.id=9452afb4ffe54eb7b7b5b0aff7dd00ed => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:19:52.956882 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d2a9f3-f3d6-4a1e-9470-591d2f613aa9 None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:52.957409 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d2a9f3-f3d6-4a1e-9470-591d2f613aa9 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:52.957409 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d2a9f3-f3d6-4a1e-9470-591d2f613aa9 None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:52.958774 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 550/1118] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:19:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:19:52.963761 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072088f4-d564-483f-94fa-3f706881a738 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:52.964161 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072088f4-d564-483f-94fa-3f706881a738 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:52.964304 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072088f4-d564-483f-94fa-3f706881a738 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:52.982529 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-072088f4-d564-483f-94fa-3f706881a738 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:19:52.983690 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-072088f4-d564-483f-94fa-3f706881a738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:19:52.993122 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:53.047707 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 569/1119] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:19:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 16:19:53.322035 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d2a9f3-f3d6-4a1e-9470-591d2f613aa9 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:53.362608 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:53.420701 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d2a9f3-f3d6-4a1e-9470-591d2f613aa9 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:53.455853 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98938c67-7db3-489e-bbcb-306ddf308b47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:53.456786 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98938c67-7db3-489e-bbcb-306ddf308b47 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:53.457070 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98938c67-7db3-489e-bbcb-306ddf308b47 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:53.457340 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98938c67-7db3-489e-bbcb-306ddf308b47 None admin] PATH_INFO: `/v3/roles/9452afb4ffe54eb7b7b5b0aff7dd00ed` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:53.458756 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98938c67-7db3-489e-bbcb-306ddf308b47 None admin] RBAC: Authorizing `identity:get_role(role_id=9452afb4ffe54eb7b7b5b0aff7dd00ed)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:53.460140 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98938c67-7db3-489e-bbcb-306ddf308b47 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:53.461455 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 551/1120] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Sep 9 16:19:53 2022] GET /identity/v3/roles/9452afb4ffe54eb7b7b5b0aff7dd00ed => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:19:53.467267 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072088f4-d564-483f-94fa-3f706881a738 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:53.561971 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072088f4-d564-483f-94fa-3f706881a738 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:53.595158 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a0dad7-8d86-4e72-a94d-63f7cd82d177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:53.595768 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a0dad7-8d86-4e72-a94d-63f7cd82d177 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:53.596045 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a0dad7-8d86-4e72-a94d-63f7cd82d177 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:53.596315 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a0dad7-8d86-4e72-a94d-63f7cd82d177 None admin] PATH_INFO: `/v3/users/887d3b1fe68f4d68bcb8ba54cf444639` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:53.597418 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a0dad7-8d86-4e72-a94d-63f7cd82d177 None admin] RBAC: Authorizing `identity:get_user(user_id=887d3b1fe68f4d68bcb8ba54cf444639)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:53.598890 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a0dad7-8d86-4e72-a94d-63f7cd82d177 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:53.600447 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 570/1121] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Sep 9 16:19:53 2022] GET /identity/v3/users/887d3b1fe68f4d68bcb8ba54cf444639 => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:19:53.606191 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98938c67-7db3-489e-bbcb-306ddf308b47 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:53.701928 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98938c67-7db3-489e-bbcb-306ddf308b47 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:53.709443 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:53.735791 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9191a4-3c5d-4a06-8d05-29e03d1a5b32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:53.736449 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9191a4-3c5d-4a06-8d05-29e03d1a5b32 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:53.736732 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9191a4-3c5d-4a06-8d05-29e03d1a5b32 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:53.737007 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9191a4-3c5d-4a06-8d05-29e03d1a5b32 None admin] PATH_INFO: `/v3/projects/cc56bb49235c4d5292a50446bbce6672` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:53.738140 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9191a4-3c5d-4a06-8d05-29e03d1a5b32 None admin] RBAC: Authorizing `identity:get_project(project_id=cc56bb49235c4d5292a50446bbce6672)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:53.739614 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9191a4-3c5d-4a06-8d05-29e03d1a5b32 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:53.741231 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 552/1122] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Sep 9 16:19:53 2022] GET /identity/v3/projects/cc56bb49235c4d5292a50446bbce6672 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:19:53.747255 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a0dad7-8d86-4e72-a94d-63f7cd82d177 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:53.762229 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:53.846058 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a0dad7-8d86-4e72-a94d-63f7cd82d177 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:53.878447 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdbed83-c44f-4e8b-a1ff-422850b1220e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:53.879085 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdbed83-c44f-4e8b-a1ff-422850b1220e None admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:53.879363 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdbed83-c44f-4e8b-a1ff-422850b1220e None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:53.879635 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdbed83-c44f-4e8b-a1ff-422850b1220e None admin] PATH_INFO: `/v3/projects/cc56bb49235c4d5292a50446bbce6672/users/887d3b1fe68f4d68bcb8ba54cf444639/roles/9452afb4ffe54eb7b7b5b0aff7dd00ed` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:53.881741 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdbed83-c44f-4e8b-a1ff-422850b1220e None admin] RBAC: Authorizing `identity:create_grant(project_id=cc56bb49235c4d5292a50446bbce6672, user_id=887d3b1fe68f4d68bcb8ba54cf444639, role_id=9452afb4ffe54eb7b7b5b0aff7dd00ed)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:53.883191 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdbed83-c44f-4e8b-a1ff-422850b1220e None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:53.895905 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 571/1123] 10.222.0.27 () {58 vars in 1439 bytes} [Fri Sep 9 16:19:53 2022] PUT /identity/v3/projects/cc56bb49235c4d5292a50446bbce6672/users/887d3b1fe68f4d68bcb8ba54cf444639/roles/9452afb4ffe54eb7b7b5b0aff7dd00ed => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:19:56.026869 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9101df-ef6c-4ed3-a891-f501231689a3 None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:56.027422 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9101df-ef6c-4ed3-a891-f501231689a3 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:56.027422 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9101df-ef6c-4ed3-a891-f501231689a3 None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:56.028719 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 553/1124] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:19:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:19:56.034403 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59b6d81-d153-4edd-9275-473785c9abf3 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:56.034812 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59b6d81-d153-4edd-9275-473785c9abf3 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:56.034922 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59b6d81-d153-4edd-9275-473785c9abf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:56.053126 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-f59b6d81-d153-4edd-9275-473785c9abf3 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:19:56.054349 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-f59b6d81-d153-4edd-9275-473785c9abf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:19:56.117584 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 572/1125] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:19:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 16:19:56.385707 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9101df-ef6c-4ed3-a891-f501231689a3 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:56.483200 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9101df-ef6c-4ed3-a891-f501231689a3 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:56.516399 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1368c36a-aec6-4edd-aeb4-735f7f11d8b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:56.517035 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1368c36a-aec6-4edd-aeb4-735f7f11d8b0 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:56.517310 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1368c36a-aec6-4edd-aeb4-735f7f11d8b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:56.517579 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1368c36a-aec6-4edd-aeb4-735f7f11d8b0 None admin] PATH_INFO: `/v3/roles/9452afb4ffe54eb7b7b5b0aff7dd00ed` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:56.518982 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1368c36a-aec6-4edd-aeb4-735f7f11d8b0 None admin] RBAC: Authorizing `identity:get_role(role_id=9452afb4ffe54eb7b7b5b0aff7dd00ed)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:56.520347 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1368c36a-aec6-4edd-aeb4-735f7f11d8b0 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:56.521616 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 554/1126] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Sep 9 16:19:56 2022] GET /identity/v3/roles/9452afb4ffe54eb7b7b5b0aff7dd00ed => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:19:56.527659 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59b6d81-d153-4edd-9275-473785c9abf3 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:56.529988 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:56.625156 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59b6d81-d153-4edd-9275-473785c9abf3 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:56.656824 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37664220-dff8-4dc2-9bd7-21761d3f7625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:56.657952 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37664220-dff8-4dc2-9bd7-21761d3f7625 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:56.658230 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37664220-dff8-4dc2-9bd7-21761d3f7625 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:56.658526 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37664220-dff8-4dc2-9bd7-21761d3f7625 None admin] PATH_INFO: `/v3/users/887d3b1fe68f4d68bcb8ba54cf444639` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:56.659627 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37664220-dff8-4dc2-9bd7-21761d3f7625 None admin] RBAC: Authorizing `identity:get_user(user_id=887d3b1fe68f4d68bcb8ba54cf444639)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:56.661077 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37664220-dff8-4dc2-9bd7-21761d3f7625 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:56.662657 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 573/1127] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Sep 9 16:19:56 2022] GET /identity/v3/users/887d3b1fe68f4d68bcb8ba54cf444639 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:19:56.668247 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1368c36a-aec6-4edd-aeb4-735f7f11d8b0 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:56.709981 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:56.766143 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1368c36a-aec6-4edd-aeb4-735f7f11d8b0 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:56.801216 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3b480f-7600-45e4-b875-e20e3489f892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:56.801803 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3b480f-7600-45e4-b875-e20e3489f892 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:56.802107 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3b480f-7600-45e4-b875-e20e3489f892 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:56.802405 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3b480f-7600-45e4-b875-e20e3489f892 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:56.866766 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3b480f-7600-45e4-b875-e20e3489f892 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:56.868206 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3b480f-7600-45e4-b875-e20e3489f892 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:56.908134 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:56.962784 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 555/1128] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Sep 9 16:19:56 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 09 16:19:56.968655 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37664220-dff8-4dc2-9bd7-21761d3f7625 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:57.035603 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:57.065184 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37664220-dff8-4dc2-9bd7-21761d3f7625 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:57.097974 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abcac28-6f5f-42e7-9efc-99538ac9c4a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:57.098608 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abcac28-6f5f-42e7-9efc-99538ac9c4a1 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:57.098885 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abcac28-6f5f-42e7-9efc-99538ac9c4a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:57.099154 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abcac28-6f5f-42e7-9efc-99538ac9c4a1 None admin] PATH_INFO: `/v3/projects/cc56bb49235c4d5292a50446bbce6672` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:57.100248 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abcac28-6f5f-42e7-9efc-99538ac9c4a1 None admin] RBAC: Authorizing `identity:get_project(project_id=cc56bb49235c4d5292a50446bbce6672)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:57.101699 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abcac28-6f5f-42e7-9efc-99538ac9c4a1 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:57.103310 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 574/1129] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Sep 9 16:19:56 2022] GET /identity/v3/projects/cc56bb49235c4d5292a50446bbce6672 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:19:57.109234 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3b480f-7600-45e4-b875-e20e3489f892 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:57.202573 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3b480f-7600-45e4-b875-e20e3489f892 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:57.235448 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df367b21-686e-47c5-b4d6-ada897b49a4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:57.236050 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df367b21-686e-47c5-b4d6-ada897b49a4b None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:57.236325 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df367b21-686e-47c5-b4d6-ada897b49a4b None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:57.236592 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df367b21-686e-47c5-b4d6-ada897b49a4b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:57.237285 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df367b21-686e-47c5-b4d6-ada897b49a4b None admin] RBAC: Adding query filter params (role.id=9452afb4ffe54eb7b7b5b0aff7dd00ed, scope.project.id=cc56bb49235c4d5292a50446bbce6672, user.id=887d3b1fe68f4d68bcb8ba54cf444639) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:19:57.237584 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df367b21-686e-47c5-b4d6-ada897b49a4b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:57.239018 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df367b21-686e-47c5-b4d6-ada897b49a4b None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:57.244482 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 556/1130] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Sep 9 16:19:57 2022] GET /identity/v3/role_assignments?user.id=887d3b1fe68f4d68bcb8ba54cf444639&scope.project.id=cc56bb49235c4d5292a50446bbce6672&role.id=9452afb4ffe54eb7b7b5b0aff7dd00ed => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:19:59.418973 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e74ee2-56b5-4358-a239-8709d9e66b5f None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:59.419487 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e74ee2-56b5-4358-a239-8709d9e66b5f None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:59.419576 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e74ee2-56b5-4358-a239-8709d9e66b5f None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:59.420896 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 575/1131] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:19:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:19:59.426072 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1dde7a-ccdd-4d7d-b08d-25dab049bb8e None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:59.426521 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1dde7a-ccdd-4d7d-b08d-25dab049bb8e None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:59.426636 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1dde7a-ccdd-4d7d-b08d-25dab049bb8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:59.439487 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:19:59.444935 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-0c1dde7a-ccdd-4d7d-b08d-25dab049bb8e None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:19:59.446109 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-0c1dde7a-ccdd-4d7d-b08d-25dab049bb8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:19:59.509699 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 557/1132] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:19:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 16:19:59.781643 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e74ee2-56b5-4358-a239-8709d9e66b5f None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:19:59.881181 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e74ee2-56b5-4358-a239-8709d9e66b5f None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:19:59.914214 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66652d1-6919-4753-8966-c0a80187d989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:19:59.914851 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66652d1-6919-4753-8966-c0a80187d989 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:19:59.915129 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66652d1-6919-4753-8966-c0a80187d989 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:19:59.915402 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66652d1-6919-4753-8966-c0a80187d989 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:19:59.916502 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66652d1-6919-4753-8966-c0a80187d989 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:19:59.917923 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66652d1-6919-4753-8966-c0a80187d989 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:19:59.919506 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 576/1133] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 16:19:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:19:59.925380 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1dde7a-ccdd-4d7d-b08d-25dab049bb8e None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:20:00.019109 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1dde7a-ccdd-4d7d-b08d-25dab049bb8e None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:20:00.051413 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845cad97-3b27-4a3c-b411-b59d84220e8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:20:00.051939 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845cad97-3b27-4a3c-b411-b59d84220e8e None admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:20:00.052213 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845cad97-3b27-4a3c-b411-b59d84220e8e None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:20:00.052479 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845cad97-3b27-4a3c-b411-b59d84220e8e None admin] PATH_INFO: `/v3/projects` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:20:00.053112 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845cad97-3b27-4a3c-b411-b59d84220e8e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:20:00.054546 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845cad97-3b27-4a3c-b411-b59d84220e8e None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:20:00.059660 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:20:00.080419 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 558/1134] 10.222.0.27 () {60 vars in 1141 bytes} [Fri Sep 9 16:19:59 2022] POST /identity/v3/projects => generated 311 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:20:02.234063 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3381546-c61f-4ac1-9ccd-e2f630a9b709 None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:20:02.234669 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3381546-c61f-4ac1-9ccd-e2f630a9b709 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:20:02.234762 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3381546-c61f-4ac1-9ccd-e2f630a9b709 None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:20:02.236579 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 577/1135] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:20:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:20:02.241661 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaf8f23-f772-4f0f-bc3a-0dde0761501f None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:20:02.242071 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaf8f23-f772-4f0f-bc3a-0dde0761501f None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:20:02.242204 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaf8f23-f772-4f0f-bc3a-0dde0761501f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:20:02.261329 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-eeaf8f23-f772-4f0f-bc3a-0dde0761501f None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:20:02.262592 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-eeaf8f23-f772-4f0f-bc3a-0dde0761501f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:20:02.332835 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 559/1136] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:20:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 16:20:02.600972 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3381546-c61f-4ac1-9ccd-e2f630a9b709 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:20:02.609765 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:20:02.708652 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3381546-c61f-4ac1-9ccd-e2f630a9b709 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:20:02.742407 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cee400e-4aad-4316-8453-863b8a41c9b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:20:02.743032 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cee400e-4aad-4316-8453-863b8a41c9b6 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:20:02.743312 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cee400e-4aad-4316-8453-863b8a41c9b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:20:02.743581 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cee400e-4aad-4316-8453-863b8a41c9b6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:20:02.744681 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cee400e-4aad-4316-8453-863b8a41c9b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:20:02.746145 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cee400e-4aad-4316-8453-863b8a41c9b6 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:20:02.747740 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 578/1137] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 16:20:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:20:02.753518 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaf8f23-f772-4f0f-bc3a-0dde0761501f None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:20:02.852294 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaf8f23-f772-4f0f-bc3a-0dde0761501f None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:20:02.869061 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:20:02.886050 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3f0e65-2b5f-4f74-80a4-bd89a2a7c99a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:20:02.886685 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3f0e65-2b5f-4f74-80a4-bd89a2a7c99a None admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:20:02.886961 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3f0e65-2b5f-4f74-80a4-bd89a2a7c99a None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:20:02.887226 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3f0e65-2b5f-4f74-80a4-bd89a2a7c99a None admin] PATH_INFO: `/v3/users` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:20:02.887860 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3f0e65-2b5f-4f74-80a4-bd89a2a7c99a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:20:02.889283 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3f0e65-2b5f-4f74-80a4-bd89a2a7c99a None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:20:02.910249 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 560/1138] 10.222.0.27 () {60 vars in 1132 bytes} [Fri Sep 9 16:20:02 2022] POST /identity/v3/users => generated 286 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:20:05.075054 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bba9a7-c979-4b75-9134-8a71445bcbf2 None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:20:05.075575 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bba9a7-c979-4b75-9134-8a71445bcbf2 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:20:05.075575 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bba9a7-c979-4b75-9134-8a71445bcbf2 None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:20:05.076920 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 579/1139] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:20:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:20:05.082171 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cffd6a6-473f-40d7-845e-204feb7bdb70 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:20:05.082549 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cffd6a6-473f-40d7-845e-204feb7bdb70 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:20:05.082744 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cffd6a6-473f-40d7-845e-204feb7bdb70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:20:05.100875 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-9cffd6a6-473f-40d7-845e-204feb7bdb70 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:20:05.102043 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-9cffd6a6-473f-40d7-845e-204feb7bdb70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:20:05.165900 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 561/1140] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:20:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 16:20:05.438186 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bba9a7-c979-4b75-9134-8a71445bcbf2 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:20:05.511293 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:20:05.536398 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bba9a7-c979-4b75-9134-8a71445bcbf2 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:20:05.568747 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd92cf02-833b-4a9b-9ac6-3e9e391d9056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:20:05.569347 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd92cf02-833b-4a9b-9ac6-3e9e391d9056 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:20:05.569621 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd92cf02-833b-4a9b-9ac6-3e9e391d9056 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:20:05.569885 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd92cf02-833b-4a9b-9ac6-3e9e391d9056 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:20:05.579896 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd92cf02-833b-4a9b-9ac6-3e9e391d9056 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 16:20:05.584655 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-cd92cf02-833b-4a9b-9ac6-3e9e391d9056 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 16:20:05.584655 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:20:05.584655 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:20:05.584655 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:20:05.584655 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:20:05.584655 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:20:05.584655 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:20:05.584655 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:20:05.584655 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:20:05.584655 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:20:05.584655 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:20:05.584655 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:20:05.584655 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 16:20:05.584655 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 16:20:05.584655 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 16:20:05.584655 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 16:20:05.585726 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 16:20:05.585726 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 16:20:05.585726 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 16:20:05.585726 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 16:20:05.585726 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:20:05.585726 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:20:05.585726 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:20:05.585726 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:20:05.585726 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:20:05.585726 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:20:05.585726 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:20:05.585726 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Sep 09 16:20:05.585726 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:20:05.585726 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:20:05.585726 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:20:05.585726 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:20:05.586788 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:20:05.586788 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:20:05.586788 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:20:05.586788 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:20:05.586788 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 16:20:05.586788 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 16:20:05.586788 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 16:20:05.586788 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 16:20:05.586788 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 16:20:05.586788 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 16:20:05.586788 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 16:20:05.586788 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:20:05.586788 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 580/1141] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Sep 9 16:20:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:20:05.591737 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cffd6a6-473f-40d7-845e-204feb7bdb70 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:20:05.685325 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cffd6a6-473f-40d7-845e-204feb7bdb70 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:20:05.687845 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:20:05.718388 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb1002f-04c1-4934-93a6-ccf0b77bbb11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:20:05.718897 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb1002f-04c1-4934-93a6-ccf0b77bbb11 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:20:05.719179 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb1002f-04c1-4934-93a6-ccf0b77bbb11 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:20:05.719495 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb1002f-04c1-4934-93a6-ccf0b77bbb11 None admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:20:05.720736 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb1002f-04c1-4934-93a6-ccf0b77bbb11 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:20:05.721049 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb1002f-04c1-4934-93a6-ccf0b77bbb11 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:20:05.722646 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb1002f-04c1-4934-93a6-ccf0b77bbb11 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:20:05.730358 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 562/1142] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Sep 9 16:20:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:20:05.736766 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd92cf02-833b-4a9b-9ac6-3e9e391d9056 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:20:05.832151 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd92cf02-833b-4a9b-9ac6-3e9e391d9056 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:20:05.865074 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abad5e10-9de2-4600-a3c6-c81e26ec8411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:20:05.865674 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abad5e10-9de2-4600-a3c6-c81e26ec8411 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:20:05.865953 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abad5e10-9de2-4600-a3c6-c81e26ec8411 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:20:05.866222 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abad5e10-9de2-4600-a3c6-c81e26ec8411 None admin] PATH_INFO: `/v3/users/730e32008d864ff9a0bbf4cec861bd1f` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:20:05.868070 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:20:05.879967 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abad5e10-9de2-4600-a3c6-c81e26ec8411 None admin] RBAC: Authorizing `identity:get_user(user_id=730e32008d864ff9a0bbf4cec861bd1f)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:20:05.881389 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abad5e10-9de2-4600-a3c6-c81e26ec8411 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:20:05.882983 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 581/1143] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Sep 9 16:20:05 2022] GET /identity/v3/users/730e32008d864ff9a0bbf4cec861bd1f => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:20:05.888489 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb1002f-04c1-4934-93a6-ccf0b77bbb11 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:20:05.986978 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb1002f-04c1-4934-93a6-ccf0b77bbb11 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:20:06.018638 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6050ca-dabd-4854-8ac1-022a4c2e5488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:20:06.019230 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6050ca-dabd-4854-8ac1-022a4c2e5488 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:20:06.019504 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6050ca-dabd-4854-8ac1-022a4c2e5488 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:20:06.019771 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6050ca-dabd-4854-8ac1-022a4c2e5488 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:20:06.051151 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:20:06.084560 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6050ca-dabd-4854-8ac1-022a4c2e5488 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:20:06.086007 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6050ca-dabd-4854-8ac1-022a4c2e5488 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:20:06.178798 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 563/1144] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Sep 9 16:20:05 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 09 16:20:06.184826 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abad5e10-9de2-4600-a3c6-c81e26ec8411 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:20:06.281766 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abad5e10-9de2-4600-a3c6-c81e26ec8411 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:20:06.314353 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efaeb60-f00d-45df-965c-6568a4b7a847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:20:06.314988 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efaeb60-f00d-45df-965c-6568a4b7a847 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:20:06.315263 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efaeb60-f00d-45df-965c-6568a4b7a847 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:20:06.315531 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efaeb60-f00d-45df-965c-6568a4b7a847 None admin] PATH_INFO: `/v3/projects/ff7ec7f54dd1494da135f08ade405da7` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:20:06.316620 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efaeb60-f00d-45df-965c-6568a4b7a847 None admin] RBAC: Authorizing `identity:get_project(project_id=ff7ec7f54dd1494da135f08ade405da7)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:20:06.318039 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efaeb60-f00d-45df-965c-6568a4b7a847 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:20:06.319681 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 582/1145] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Sep 9 16:20:06 2022] GET /identity/v3/projects/ff7ec7f54dd1494da135f08ade405da7 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:20:06.325692 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6050ca-dabd-4854-8ac1-022a4c2e5488 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:20:06.387673 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:20:06.420540 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6050ca-dabd-4854-8ac1-022a4c2e5488 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:20:06.452850 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aa984d-a128-4aa2-96a0-69ba0957c5d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:20:06.453429 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aa984d-a128-4aa2-96a0-69ba0957c5d2 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:20:06.453703 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aa984d-a128-4aa2-96a0-69ba0957c5d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:20:06.453969 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aa984d-a128-4aa2-96a0-69ba0957c5d2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:20:06.455300 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58aa984d-a128-4aa2-96a0-69ba0957c5d2 None admin] RBAC: Adding query filter params (role.id=0a36d1be416f4089be19be979943b731, scope.project.id=ff7ec7f54dd1494da135f08ade405da7, user.id=730e32008d864ff9a0bbf4cec861bd1f) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:20:06.455599 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58aa984d-a128-4aa2-96a0-69ba0957c5d2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:20:06.457003 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58aa984d-a128-4aa2-96a0-69ba0957c5d2 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:20:06.462110 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 564/1146] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Sep 9 16:20:06 2022] GET /identity/v3/role_assignments?user.id=730e32008d864ff9a0bbf4cec861bd1f&scope.project.id=ff7ec7f54dd1494da135f08ade405da7&role.id=0a36d1be416f4089be19be979943b731 => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:20:08.558995 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83263ba7-b5f1-4327-badb-816a2c811d63 None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:20:08.559493 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83263ba7-b5f1-4327-badb-816a2c811d63 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:20:08.559493 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83263ba7-b5f1-4327-badb-816a2c811d63 None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:20:08.560799 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 583/1147] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:20:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:20:08.566332 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2828040-7f99-44dd-be26-0b6c9dac4585 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:20:08.566743 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2828040-7f99-44dd-be26-0b6c9dac4585 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:20:08.566863 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2828040-7f99-44dd-be26-0b6c9dac4585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:20:08.584442 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-d2828040-7f99-44dd-be26-0b6c9dac4585 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:20:08.585616 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-d2828040-7f99-44dd-be26-0b6c9dac4585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:20:08.649701 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 565/1148] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:20:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 16:20:08.924796 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83263ba7-b5f1-4327-badb-816a2c811d63 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:20:08.983017 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:20:09.024073 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83263ba7-b5f1-4327-badb-816a2c811d63 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:20:09.056361 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bdc8b8-4066-4b56-a6c3-6d1f33bfa7c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:20:09.056965 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bdc8b8-4066-4b56-a6c3-6d1f33bfa7c5 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:20:09.057238 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bdc8b8-4066-4b56-a6c3-6d1f33bfa7c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:20:09.057505 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bdc8b8-4066-4b56-a6c3-6d1f33bfa7c5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:20:09.068265 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bdc8b8-4066-4b56-a6c3-6d1f33bfa7c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 16:20:09.072944 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-78bdc8b8-4066-4b56-a6c3-6d1f33bfa7c5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 16:20:09.072944 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:20:09.072944 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:20:09.072944 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:20:09.072944 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:20:09.072944 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:20:09.072944 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:20:09.072944 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:20:09.072944 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:20:09.072944 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:20:09.072944 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:20:09.072944 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:20:09.072944 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 16:20:09.072944 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 16:20:09.072944 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 16:20:09.072944 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 16:20:09.074054 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 16:20:09.074054 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 16:20:09.074054 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 16:20:09.074054 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 16:20:09.074054 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:20:09.074054 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:20:09.074054 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:20:09.074054 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:20:09.074054 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:20:09.074054 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:20:09.074054 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:20:09.074054 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Sep 09 16:20:09.074054 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:20:09.074054 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:20:09.074054 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:20:09.074054 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:20:09.075133 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:20:09.075133 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:20:09.075133 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:20:09.075133 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:20:09.075133 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 16:20:09.075133 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 16:20:09.075133 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 16:20:09.075133 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 16:20:09.075133 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 16:20:09.075133 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 16:20:09.075133 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 16:20:09.075133 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:20:09.075133 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 584/1149] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Sep 9 16:20:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:20:09.080207 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2828040-7f99-44dd-be26-0b6c9dac4585 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:20:09.136647 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:20:09.175748 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2828040-7f99-44dd-be26-0b6c9dac4585 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:20:09.208496 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05631d7b-a404-4fa0-b177-5cba634c1e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:20:09.209086 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05631d7b-a404-4fa0-b177-5cba634c1e11 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:20:09.209363 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05631d7b-a404-4fa0-b177-5cba634c1e11 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:20:09.209632 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05631d7b-a404-4fa0-b177-5cba634c1e11 None admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:20:09.210272 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05631d7b-a404-4fa0-b177-5cba634c1e11 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:20:09.210601 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05631d7b-a404-4fa0-b177-5cba634c1e11 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:20:09.211974 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05631d7b-a404-4fa0-b177-5cba634c1e11 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:20:09.219841 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 566/1150] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Sep 9 16:20:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 16:20:09.225663 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bdc8b8-4066-4b56-a6c3-6d1f33bfa7c5 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:20:09.324779 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bdc8b8-4066-4b56-a6c3-6d1f33bfa7c5 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:20:09.343447 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:20:09.357603 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0017ebee-e619-4863-882e-45619eb79380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:20:09.358221 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0017ebee-e619-4863-882e-45619eb79380 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:20:09.358529 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0017ebee-e619-4863-882e-45619eb79380 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:20:09.358802 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0017ebee-e619-4863-882e-45619eb79380 None admin] PATH_INFO: `/v3/users/730e32008d864ff9a0bbf4cec861bd1f` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:20:09.359912 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0017ebee-e619-4863-882e-45619eb79380 None admin] RBAC: Authorizing `identity:get_user(user_id=730e32008d864ff9a0bbf4cec861bd1f)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:20:09.361941 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0017ebee-e619-4863-882e-45619eb79380 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:20:09.363549 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 585/1151] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Sep 9 16:20:09 2022] GET /identity/v3/users/730e32008d864ff9a0bbf4cec861bd1f => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:20:09.369313 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05631d7b-a404-4fa0-b177-5cba634c1e11 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:20:09.465705 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05631d7b-a404-4fa0-b177-5cba634c1e11 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:20:09.488070 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:20:09.499439 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e1bced-243d-4b8e-b78c-9bf70c2844fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:20:09.500050 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e1bced-243d-4b8e-b78c-9bf70c2844fa None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:20:09.500326 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e1bced-243d-4b8e-b78c-9bf70c2844fa None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:20:09.500595 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e1bced-243d-4b8e-b78c-9bf70c2844fa None admin] PATH_INFO: `/v3/projects/ff7ec7f54dd1494da135f08ade405da7` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:20:09.501710 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e1bced-243d-4b8e-b78c-9bf70c2844fa None admin] RBAC: Authorizing `identity:get_project(project_id=ff7ec7f54dd1494da135f08ade405da7)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:20:09.503173 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e1bced-243d-4b8e-b78c-9bf70c2844fa None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:20:09.504759 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 567/1152] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Sep 9 16:20:09 2022] GET /identity/v3/projects/ff7ec7f54dd1494da135f08ade405da7 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:20:09.510681 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0017ebee-e619-4863-882e-45619eb79380 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:20:09.607449 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0017ebee-e619-4863-882e-45619eb79380 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:20:09.639774 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0de9954-5a6b-4681-8201-88ad48c99627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:20:09.640409 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0de9954-5a6b-4681-8201-88ad48c99627 None admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:20:09.640687 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0de9954-5a6b-4681-8201-88ad48c99627 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:20:09.640957 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0de9954-5a6b-4681-8201-88ad48c99627 None admin] PATH_INFO: `/v3/projects/ff7ec7f54dd1494da135f08ade405da7/users/730e32008d864ff9a0bbf4cec861bd1f/roles/0a36d1be416f4089be19be979943b731` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:20:09.643317 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0de9954-5a6b-4681-8201-88ad48c99627 None admin] RBAC: Authorizing `identity:create_grant(project_id=ff7ec7f54dd1494da135f08ade405da7, user_id=730e32008d864ff9a0bbf4cec861bd1f, role_id=0a36d1be416f4089be19be979943b731)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:20:09.644729 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0de9954-5a6b-4681-8201-88ad48c99627 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:20:09.659125 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 586/1153] 10.222.0.27 () {58 vars in 1439 bytes} [Fri Sep 9 16:20:09 2022] PUT /identity/v3/projects/ff7ec7f54dd1494da135f08ade405da7/users/730e32008d864ff9a0bbf4cec861bd1f/roles/0a36d1be416f4089be19be979943b731 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:20:11.756889 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf079878-3a23-468f-a28c-44c48c2cdd1f None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:20:11.757435 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf079878-3a23-468f-a28c-44c48c2cdd1f None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:20:11.757435 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf079878-3a23-468f-a28c-44c48c2cdd1f None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:20:11.758791 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 568/1154] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:20:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:20:11.763831 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dfe31c-6cff-42a3-930e-893939218314 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:20:11.764235 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dfe31c-6cff-42a3-930e-893939218314 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:20:11.764370 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dfe31c-6cff-42a3-930e-893939218314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:20:11.781910 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-86dfe31c-6cff-42a3-930e-893939218314 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:20:11.783618 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-86dfe31c-6cff-42a3-930e-893939218314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:20:11.824925 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:20:11.848472 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 587/1155] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:20:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 16:20:12.121274 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf079878-3a23-468f-a28c-44c48c2cdd1f None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:20:12.218049 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf079878-3a23-468f-a28c-44c48c2cdd1f None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:20:12.250099 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e16d7b-841f-408b-998e-0f23759f0b1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:20:12.250723 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e16d7b-841f-408b-998e-0f23759f0b1e None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:20:12.251013 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e16d7b-841f-408b-998e-0f23759f0b1e None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:20:12.251809 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e16d7b-841f-408b-998e-0f23759f0b1e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:20:12.261388 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e16d7b-841f-408b-998e-0f23759f0b1e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 16:20:12.266060 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-c1e16d7b-841f-408b-998e-0f23759f0b1e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 16:20:12.266060 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:20:12.266060 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:20:12.266060 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:20:12.266060 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:20:12.266060 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:20:12.266060 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:20:12.266060 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:20:12.266060 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:20:12.266060 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:20:12.266060 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:20:12.266060 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:20:12.266060 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 16:20:12.266060 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 16:20:12.266060 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 16:20:12.266060 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 16:20:12.267229 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 16:20:12.267229 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 16:20:12.267229 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 16:20:12.267229 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 16:20:12.267229 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:20:12.267229 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:20:12.267229 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:20:12.267229 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:20:12.267229 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:20:12.267229 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:20:12.267229 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:20:12.267229 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 16:20:12.267229 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:20:12.267229 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:20:12.267229 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:20:12.267229 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:20:12.268136 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:20:12.268136 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:20:12.268136 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:20:12.268136 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:20:12.268136 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 16:20:12.268136 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 16:20:12.268136 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 16:20:12.268136 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 16:20:12.268136 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 16:20:12.268136 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 16:20:12.268136 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 16:20:12.268136 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 16:20:12.268136 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 569/1156] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Sep 9 16:20:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:20:12.273166 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dfe31c-6cff-42a3-930e-893939218314 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:20:12.369432 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dfe31c-6cff-42a3-930e-893939218314 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:20:12.401003 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a920c9b4-e436-4e3b-9229-681f78f5b780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:20:12.401542 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a920c9b4-e436-4e3b-9229-681f78f5b780 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:20:12.401816 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a920c9b4-e436-4e3b-9229-681f78f5b780 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:20:12.402082 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a920c9b4-e436-4e3b-9229-681f78f5b780 None admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:20:12.402752 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a920c9b4-e436-4e3b-9229-681f78f5b780 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:20:12.403048 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a920c9b4-e436-4e3b-9229-681f78f5b780 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:20:12.404402 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a920c9b4-e436-4e3b-9229-681f78f5b780 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:20:12.412534 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 588/1157] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Sep 9 16:20:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:20:12.418451 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e16d7b-841f-408b-998e-0f23759f0b1e None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:20:12.467830 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:20:12.516099 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e16d7b-841f-408b-998e-0f23759f0b1e None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:20:12.548915 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f05f69-9b8f-4295-8b2f-9bcf50a5416b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:20:12.549520 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f05f69-9b8f-4295-8b2f-9bcf50a5416b None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:20:12.549794 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f05f69-9b8f-4295-8b2f-9bcf50a5416b None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:20:12.550059 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f05f69-9b8f-4295-8b2f-9bcf50a5416b None admin] PATH_INFO: `/v3/users/730e32008d864ff9a0bbf4cec861bd1f` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:20:12.551183 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f05f69-9b8f-4295-8b2f-9bcf50a5416b None admin] RBAC: Authorizing `identity:get_user(user_id=730e32008d864ff9a0bbf4cec861bd1f)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:20:12.552597 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f05f69-9b8f-4295-8b2f-9bcf50a5416b None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:20:12.554121 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 570/1158] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Sep 9 16:20:12 2022] GET /identity/v3/users/730e32008d864ff9a0bbf4cec861bd1f => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:20:12.559695 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a920c9b4-e436-4e3b-9229-681f78f5b780 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:20:12.599900 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:20:12.655535 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a920c9b4-e436-4e3b-9229-681f78f5b780 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:20:12.687382 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2363a567-0f9b-4bf2-a2f4-841616039f79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:20:12.687965 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2363a567-0f9b-4bf2-a2f4-841616039f79 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:20:12.688237 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2363a567-0f9b-4bf2-a2f4-841616039f79 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:20:12.688520 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2363a567-0f9b-4bf2-a2f4-841616039f79 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:20:12.751983 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2363a567-0f9b-4bf2-a2f4-841616039f79 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:20:12.753420 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2363a567-0f9b-4bf2-a2f4-841616039f79 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:20:12.791976 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:20:12.851341 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 589/1159] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Sep 9 16:20:12 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 09 16:20:12.857397 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f05f69-9b8f-4295-8b2f-9bcf50a5416b None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:20:12.952749 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f05f69-9b8f-4295-8b2f-9bcf50a5416b None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:20:12.969768 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:20:12.987703 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d8be85-02a4-4556-a916-f51901a4c763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:20:12.988310 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d8be85-02a4-4556-a916-f51901a4c763 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:20:12.988585 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d8be85-02a4-4556-a916-f51901a4c763 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:20:12.988850 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d8be85-02a4-4556-a916-f51901a4c763 None admin] PATH_INFO: `/v3/projects/ff7ec7f54dd1494da135f08ade405da7` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:20:12.989930 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d8be85-02a4-4556-a916-f51901a4c763 None admin] RBAC: Authorizing `identity:get_project(project_id=ff7ec7f54dd1494da135f08ade405da7)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:20:12.991397 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d8be85-02a4-4556-a916-f51901a4c763 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:20:12.992973 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 571/1160] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Sep 9 16:20:12 2022] GET /identity/v3/projects/ff7ec7f54dd1494da135f08ade405da7 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:20:12.999021 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2363a567-0f9b-4bf2-a2f4-841616039f79 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:20:13.093569 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2363a567-0f9b-4bf2-a2f4-841616039f79 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:20:13.125064 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df25bb46-fdd7-4c0d-bb53-a15ebe4f2233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:20:13.125640 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df25bb46-fdd7-4c0d-bb53-a15ebe4f2233 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:20:13.125914 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df25bb46-fdd7-4c0d-bb53-a15ebe4f2233 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:20:13.126720 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df25bb46-fdd7-4c0d-bb53-a15ebe4f2233 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:20:13.127418 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df25bb46-fdd7-4c0d-bb53-a15ebe4f2233 None admin] RBAC: Adding query filter params (role.id=0a36d1be416f4089be19be979943b731, scope.project.id=ff7ec7f54dd1494da135f08ade405da7, user.id=730e32008d864ff9a0bbf4cec861bd1f) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:20:13.127715 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df25bb46-fdd7-4c0d-bb53-a15ebe4f2233 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:20:13.129117 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df25bb46-fdd7-4c0d-bb53-a15ebe4f2233 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:20:13.134621 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 590/1161] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Sep 9 16:20:12 2022] GET /identity/v3/role_assignments?user.id=730e32008d864ff9a0bbf4cec861bd1f&scope.project.id=ff7ec7f54dd1494da135f08ade405da7&role.id=0a36d1be416f4089be19be979943b731 => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:20:15.303077 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5a18f1-3417-4b8c-bdf5-621a23e6dd77 None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:20:15.303530 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5a18f1-3417-4b8c-bdf5-621a23e6dd77 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:20:15.303628 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5a18f1-3417-4b8c-bdf5-621a23e6dd77 None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:20:15.304935 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 572/1162] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:20:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:20:15.310173 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8118b2f-7685-4c52-a464-268ddcafaff1 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:20:15.310615 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8118b2f-7685-4c52-a464-268ddcafaff1 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:20:15.310817 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8118b2f-7685-4c52-a464-268ddcafaff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:20:15.318187 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:20:15.328904 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-c8118b2f-7685-4c52-a464-268ddcafaff1 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:20:15.330089 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-c8118b2f-7685-4c52-a464-268ddcafaff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:20:15.394372 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 591/1163] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:20:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 16:20:15.665892 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5a18f1-3417-4b8c-bdf5-621a23e6dd77 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:20:15.763070 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5a18f1-3417-4b8c-bdf5-621a23e6dd77 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:20:15.796104 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0fe738-52d7-4512-99a4-cbdaf0cb1fd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:20:15.796691 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0fe738-52d7-4512-99a4-cbdaf0cb1fd9 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:20:15.796969 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0fe738-52d7-4512-99a4-cbdaf0cb1fd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:20:15.797239 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0fe738-52d7-4512-99a4-cbdaf0cb1fd9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:20:15.849175 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:20:15.862648 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0fe738-52d7-4512-99a4-cbdaf0cb1fd9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:20:15.864084 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0fe738-52d7-4512-99a4-cbdaf0cb1fd9 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:20:15.957074 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 573/1164] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Sep 9 16:20:15 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 09 16:20:15.963013 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8118b2f-7685-4c52-a464-268ddcafaff1 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:20:16.064760 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8118b2f-7685-4c52-a464-268ddcafaff1 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:20:16.097420 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a8fc67-59b5-4de5-bba5-ceffdd3ea702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:20:16.098033 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a8fc67-59b5-4de5-bba5-ceffdd3ea702 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:20:16.098333 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a8fc67-59b5-4de5-bba5-ceffdd3ea702 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:20:16.098605 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a8fc67-59b5-4de5-bba5-ceffdd3ea702 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:20:16.100451 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:20:16.105835 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a8fc67-59b5-4de5-bba5-ceffdd3ea702 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:20:16.107482 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a8fc67-59b5-4de5-bba5-ceffdd3ea702 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:20:16.118595 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-c7a8fc67-59b5-4de5-bba5-ceffdd3ea702 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 09 16:20:16.118595 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:20:16.118595 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 09 16:20:16.118595 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 09 16:20:16.118595 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 16:20:16.118595 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 16:20:16.118595 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 16:20:16.118595 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 16:20:16.118595 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Sep 09 16:20:16.118595 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:20:16.118595 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 16:20:16.118595 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:20:16.118595 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:20:16.118595 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:20:16.118595 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:20:16.118595 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:20:16.118595 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:20:16.119845 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:20:16.119845 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:20:16.119845 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:20:16.119845 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:20:16.119845 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:20:16.119845 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:20:16.119845 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 16:20:16.119845 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 16:20:16.119845 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 16:20:16.119845 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 16:20:16.119845 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:20:16.119845 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:20:16.119845 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:20:16.119845 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:20:16.119845 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:20:16.119845 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:20:16.120910 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:20:16.120910 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Sep 09 16:20:16.120910 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:20:16.120910 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:20:16.120910 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:20:16.120910 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:20:16.120910 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:20:16.120910 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:20:16.120910 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:20:16.120910 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:20:16.120910 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 09 16:20:16.120910 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 16:20:16.120910 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 09 16:20:16.120910 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:20:16.120910 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 592/1165] 10.222.0.27 () {56 vars in 1117 bytes} [Fri Sep 9 16:20:15 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:20:16.125843 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0fe738-52d7-4512-99a4-cbdaf0cb1fd9 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:20:16.207232 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:20:16.221573 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0fe738-52d7-4512-99a4-cbdaf0cb1fd9 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:20:16.253975 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd2d62e-6acf-44d7-914f-2abababa2362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:20:16.254584 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd2d62e-6acf-44d7-914f-2abababa2362 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:20:16.254862 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd2d62e-6acf-44d7-914f-2abababa2362 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:20:16.255129 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd2d62e-6acf-44d7-914f-2abababa2362 None admin] PATH_INFO: `/v3/domains` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:20:16.255748 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd2d62e-6acf-44d7-914f-2abababa2362 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:20:16.256071 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd2d62e-6acf-44d7-914f-2abababa2362 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:20:16.257428 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd2d62e-6acf-44d7-914f-2abababa2362 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:20:16.264260 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 574/1166] 10.222.0.27 () {56 vars in 1115 bytes} [Fri Sep 9 16:20:16 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:20:18.394652 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b628dc3-ae71-443e-98dc-a1e349e280c0 None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:20:18.395175 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b628dc3-ae71-443e-98dc-a1e349e280c0 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:20:18.395175 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b628dc3-ae71-443e-98dc-a1e349e280c0 None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:20:18.396505 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 593/1167] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:20:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:20:18.401727 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218428ac-27aa-414a-87a6-34ff7ecd3805 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:20:18.402135 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218428ac-27aa-414a-87a6-34ff7ecd3805 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:20:18.402282 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218428ac-27aa-414a-87a6-34ff7ecd3805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:20:18.421452 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-218428ac-27aa-414a-87a6-34ff7ecd3805 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:20:18.422672 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-218428ac-27aa-414a-87a6-34ff7ecd3805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:20:18.486632 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 575/1168] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:20:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 16:20:18.752185 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b628dc3-ae71-443e-98dc-a1e349e280c0 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:20:18.849742 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b628dc3-ae71-443e-98dc-a1e349e280c0 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:20:18.883105 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4f4549-266a-4101-a22b-8097add445b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:20:18.883689 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4f4549-266a-4101-a22b-8097add445b2 None admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:20:18.883964 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4f4549-266a-4101-a22b-8097add445b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:20:18.884230 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4f4549-266a-4101-a22b-8097add445b2 None admin] PATH_INFO: `/v3/domains` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:20:18.884883 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4f4549-266a-4101-a22b-8097add445b2 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:20:18.886230 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4f4549-266a-4101-a22b-8097add445b2 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:20:18.901736 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 594/1169] 10.222.0.27 () {60 vars in 1138 bytes} [Fri Sep 9 16:20:18 2022] POST /identity/v3/domains => generated 267 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:20:21.078367 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876c7e3b-2cc2-487a-84ec-af978923889d None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:20:21.078924 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876c7e3b-2cc2-487a-84ec-af978923889d None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:20:21.078924 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876c7e3b-2cc2-487a-84ec-af978923889d None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:20:21.080265 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 576/1170] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:20:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:20:21.085389 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5a6d24-bdf3-4563-91fc-98548ce39d0a None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:20:21.085804 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5a6d24-bdf3-4563-91fc-98548ce39d0a None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:20:21.085912 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5a6d24-bdf3-4563-91fc-98548ce39d0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:20:21.103608 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-bf5a6d24-bdf3-4563-91fc-98548ce39d0a None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:20:21.104765 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-bf5a6d24-bdf3-4563-91fc-98548ce39d0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:20:21.152167 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:20:21.169422 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 595/1171] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:20:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 16:20:21.441343 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876c7e3b-2cc2-487a-84ec-af978923889d None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:20:21.519462 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:20:21.539435 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876c7e3b-2cc2-487a-84ec-af978923889d None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:20:21.572413 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc294d7-3897-4f24-bae6-b6bcd0608194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:20:21.573024 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc294d7-3897-4f24-bae6-b6bcd0608194 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:20:21.573303 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc294d7-3897-4f24-bae6-b6bcd0608194 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:20:21.573572 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc294d7-3897-4f24-bae6-b6bcd0608194 None admin] PATH_INFO: `/v3/domains/1591803e9ca44cf693e55b98a0717807` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:20:21.583698 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc294d7-3897-4f24-bae6-b6bcd0608194 None admin] RBAC: Authorizing `identity:get_domain(domain_id=1591803e9ca44cf693e55b98a0717807)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:20:21.585141 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc294d7-3897-4f24-bae6-b6bcd0608194 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:20:21.586742 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 577/1172] 10.222.0.27 () {56 vars in 1183 bytes} [Fri Sep 9 16:20:21 2022] GET /identity/v3/domains/1591803e9ca44cf693e55b98a0717807 => generated 267 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:20:21.592369 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5a6d24-bdf3-4563-91fc-98548ce39d0a None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:20:21.688224 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5a6d24-bdf3-4563-91fc-98548ce39d0a None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:20:21.721833 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae90aed9-f9b5-4c1f-be37-dbc76b970c3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:20:21.722400 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae90aed9-f9b5-4c1f-be37-dbc76b970c3d None admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:20:21.722681 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae90aed9-f9b5-4c1f-be37-dbc76b970c3d None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:20:21.722948 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae90aed9-f9b5-4c1f-be37-dbc76b970c3d None admin] PATH_INFO: `/v3/projects` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:20:21.723595 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae90aed9-f9b5-4c1f-be37-dbc76b970c3d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:20:21.725019 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae90aed9-f9b5-4c1f-be37-dbc76b970c3d None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:20:21.749891 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 596/1173] 10.222.0.27 () {60 vars in 1141 bytes} [Fri Sep 9 16:20:21 2022] POST /identity/v3/projects => generated 361 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:20:23.910376 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b324c5e9-c0f4-4655-8290-4f02babb5c54 None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:20:23.910948 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b324c5e9-c0f4-4655-8290-4f02babb5c54 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:20:23.910948 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b324c5e9-c0f4-4655-8290-4f02babb5c54 None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:20:23.912245 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 578/1174] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:20:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:20:23.917560 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890a1d41-eb4b-4b28-9de1-2ea4c7e5cd15 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:20:23.917992 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890a1d41-eb4b-4b28-9de1-2ea4c7e5cd15 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:20:23.918927 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890a1d41-eb4b-4b28-9de1-2ea4c7e5cd15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:20:23.936396 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-890a1d41-eb4b-4b28-9de1-2ea4c7e5cd15 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:20:23.937826 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-890a1d41-eb4b-4b28-9de1-2ea4c7e5cd15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:20:23.965954 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:20:24.004935 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 597/1175] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:20:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 16:20:24.270638 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b324c5e9-c0f4-4655-8290-4f02babb5c54 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:20:24.374914 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b324c5e9-c0f4-4655-8290-4f02babb5c54 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:20:24.406744 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49f28c3-6b49-4c90-b09c-9f53854bf16a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:20:24.407898 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49f28c3-6b49-4c90-b09c-9f53854bf16a None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:20:24.408173 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49f28c3-6b49-4c90-b09c-9f53854bf16a None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:20:24.408438 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49f28c3-6b49-4c90-b09c-9f53854bf16a None admin] PATH_INFO: `/v3/domains/1591803e9ca44cf693e55b98a0717807` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:20:24.409534 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49f28c3-6b49-4c90-b09c-9f53854bf16a None admin] RBAC: Authorizing `identity:get_domain(domain_id=1591803e9ca44cf693e55b98a0717807)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:20:24.410999 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49f28c3-6b49-4c90-b09c-9f53854bf16a None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:20:24.412536 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 579/1176] 10.222.0.27 () {56 vars in 1183 bytes} [Fri Sep 9 16:20:24 2022] GET /identity/v3/domains/1591803e9ca44cf693e55b98a0717807 => generated 267 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:20:24.418293 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890a1d41-eb4b-4b28-9de1-2ea4c7e5cd15 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:20:24.513329 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890a1d41-eb4b-4b28-9de1-2ea4c7e5cd15 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:20:24.545229 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3dd197-c99f-4f52-babd-600c4ee01437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:20:24.545758 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3dd197-c99f-4f52-babd-600c4ee01437 None admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:20:24.546033 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3dd197-c99f-4f52-babd-600c4ee01437 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:20:24.546326 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3dd197-c99f-4f52-babd-600c4ee01437 None admin] PATH_INFO: `/v3/users` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:20:24.546971 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3dd197-c99f-4f52-babd-600c4ee01437 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:20:24.548973 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3dd197-c99f-4f52-babd-600c4ee01437 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:20:24.568996 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 598/1177] 10.222.0.27 () {60 vars in 1132 bytes} [Fri Sep 9 16:20:24 2022] POST /identity/v3/users => generated 311 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:20:26.738107 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a100bc0-a246-455e-b6f0-be14aeccee73 None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:20:26.738755 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a100bc0-a246-455e-b6f0-be14aeccee73 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:20:26.738755 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a100bc0-a246-455e-b6f0-be14aeccee73 None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:20:26.739992 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 580/1178] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:20:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:20:26.745101 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122e1f0b-5d6e-4080-88bd-1b5d73d94b5b None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:20:26.745541 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122e1f0b-5d6e-4080-88bd-1b5d73d94b5b None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:20:26.745673 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122e1f0b-5d6e-4080-88bd-1b5d73d94b5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:20:26.763801 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-122e1f0b-5d6e-4080-88bd-1b5d73d94b5b None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:20:26.764983 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-122e1f0b-5d6e-4080-88bd-1b5d73d94b5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:20:26.781214 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:20:26.829727 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 599/1179] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:20:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 16:20:27.096927 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a100bc0-a246-455e-b6f0-be14aeccee73 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:20:27.107625 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:20:27.195086 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a100bc0-a246-455e-b6f0-be14aeccee73 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:20:27.226637 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2721ae45-99a8-4bdc-b5ba-372c361c4276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:20:27.227243 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2721ae45-99a8-4bdc-b5ba-372c361c4276 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:20:27.227519 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2721ae45-99a8-4bdc-b5ba-372c361c4276 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:20:27.227786 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2721ae45-99a8-4bdc-b5ba-372c361c4276 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:20:27.237919 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2721ae45-99a8-4bdc-b5ba-372c361c4276 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 16:20:27.242648 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-2721ae45-99a8-4bdc-b5ba-372c361c4276 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 16:20:27.242648 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:20:27.242648 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:20:27.242648 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:20:27.242648 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:20:27.242648 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:20:27.242648 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:20:27.242648 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:20:27.242648 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:20:27.242648 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:20:27.242648 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:20:27.242648 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:20:27.242648 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 16:20:27.242648 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 16:20:27.242648 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 16:20:27.242648 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 16:20:27.243757 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 16:20:27.243757 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 16:20:27.243757 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 16:20:27.243757 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 16:20:27.243757 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:20:27.243757 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:20:27.243757 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:20:27.243757 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:20:27.243757 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:20:27.243757 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:20:27.243757 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:20:27.243757 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 16:20:27.243757 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:20:27.243757 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:20:27.243757 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:20:27.243757 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:20:27.244940 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:20:27.244940 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:20:27.244940 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:20:27.244940 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:20:27.244940 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 16:20:27.244940 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 16:20:27.244940 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 16:20:27.244940 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 16:20:27.244940 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 16:20:27.244940 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 16:20:27.244940 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 16:20:27.244940 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 16:20:27.244940 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 581/1180] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Sep 9 16:20:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:20:27.249725 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122e1f0b-5d6e-4080-88bd-1b5d73d94b5b None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:20:27.346466 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122e1f0b-5d6e-4080-88bd-1b5d73d94b5b None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:20:27.378902 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a70086-2267-47f6-9454-4cc3879ddbfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:20:27.379443 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a70086-2267-47f6-9454-4cc3879ddbfa None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:20:27.379721 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a70086-2267-47f6-9454-4cc3879ddbfa None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:20:27.379989 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a70086-2267-47f6-9454-4cc3879ddbfa None admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:20:27.380634 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a70086-2267-47f6-9454-4cc3879ddbfa None admin] RBAC: Adding query filter params (name=admin) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:20:27.380931 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a70086-2267-47f6-9454-4cc3879ddbfa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:20:27.382290 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a70086-2267-47f6-9454-4cc3879ddbfa None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:20:27.389963 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 600/1181] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Sep 9 16:20:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:20:27.395906 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2721ae45-99a8-4bdc-b5ba-372c361c4276 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:20:27.460057 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:20:27.492997 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2721ae45-99a8-4bdc-b5ba-372c361c4276 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:20:27.525640 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e5b679-8744-44d8-b334-66d7e602a502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:20:27.526242 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e5b679-8744-44d8-b334-66d7e602a502 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:20:27.526543 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e5b679-8744-44d8-b334-66d7e602a502 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:20:27.526811 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e5b679-8744-44d8-b334-66d7e602a502 None admin] PATH_INFO: `/v3/users/f86ae7d1d9d3421d9ac05cdd34126126` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:20:27.539995 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e5b679-8744-44d8-b334-66d7e602a502 None admin] RBAC: Authorizing `identity:get_user(user_id=f86ae7d1d9d3421d9ac05cdd34126126)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:20:27.541419 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e5b679-8744-44d8-b334-66d7e602a502 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:20:27.542986 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 582/1182] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Sep 9 16:20:27 2022] GET /identity/v3/users/f86ae7d1d9d3421d9ac05cdd34126126 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:20:27.548542 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a70086-2267-47f6-9454-4cc3879ddbfa None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:20:27.564722 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:20:27.646053 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a70086-2267-47f6-9454-4cc3879ddbfa None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:20:27.678002 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a9a581-072b-451f-aad6-73b6ce7deeaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:20:27.678617 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a9a581-072b-451f-aad6-73b6ce7deeaf None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:20:27.678895 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a9a581-072b-451f-aad6-73b6ce7deeaf None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:20:27.679166 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a9a581-072b-451f-aad6-73b6ce7deeaf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:20:27.743706 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a9a581-072b-451f-aad6-73b6ce7deeaf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:20:27.745133 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a9a581-072b-451f-aad6-73b6ce7deeaf None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:20:27.759272 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:20:27.839410 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 601/1183] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Sep 9 16:20:27 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 09 16:20:27.845358 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e5b679-8744-44d8-b334-66d7e602a502 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:20:27.941674 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e5b679-8744-44d8-b334-66d7e602a502 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:20:27.966038 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:20:27.974777 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f34032-8242-4b00-891e-c86a8921a4c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:20:27.975391 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f34032-8242-4b00-891e-c86a8921a4c2 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:20:27.975669 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f34032-8242-4b00-891e-c86a8921a4c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:20:27.975939 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f34032-8242-4b00-891e-c86a8921a4c2 None admin] PATH_INFO: `/v3/projects/45d08abef0e847d89b28592219365aa8` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:20:27.977030 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f34032-8242-4b00-891e-c86a8921a4c2 None admin] RBAC: Authorizing `identity:get_project(project_id=45d08abef0e847d89b28592219365aa8)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:20:27.978489 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f34032-8242-4b00-891e-c86a8921a4c2 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:20:27.980083 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 583/1184] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Sep 9 16:20:27 2022] GET /identity/v3/projects/45d08abef0e847d89b28592219365aa8 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:20:27.986528 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a9a581-072b-451f-aad6-73b6ce7deeaf None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:20:28.082199 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a9a581-072b-451f-aad6-73b6ce7deeaf None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:20:28.096081 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:20:28.116307 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8bd10c-73b3-413d-bb5a-b65f55a821ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:20:28.116930 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8bd10c-73b3-413d-bb5a-b65f55a821ee None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:20:28.117205 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8bd10c-73b3-413d-bb5a-b65f55a821ee None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:20:28.117472 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8bd10c-73b3-413d-bb5a-b65f55a821ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:20:28.118181 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8bd10c-73b3-413d-bb5a-b65f55a821ee None admin] RBAC: Adding query filter params (role.id=0a36d1be416f4089be19be979943b731, scope.project.id=45d08abef0e847d89b28592219365aa8, user.id=f86ae7d1d9d3421d9ac05cdd34126126) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:20:28.118522 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8bd10c-73b3-413d-bb5a-b65f55a821ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:20:28.119933 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8bd10c-73b3-413d-bb5a-b65f55a821ee None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:20:28.125096 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 602/1185] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Sep 9 16:20:27 2022] GET /identity/v3/role_assignments?user.id=f86ae7d1d9d3421d9ac05cdd34126126&scope.project.id=45d08abef0e847d89b28592219365aa8&role.id=0a36d1be416f4089be19be979943b731 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:20:30.239193 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f000aba-037c-4994-86dd-45fdfa346d61 None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:20:30.239751 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f000aba-037c-4994-86dd-45fdfa346d61 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:20:30.239751 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f000aba-037c-4994-86dd-45fdfa346d61 None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:20:30.241047 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 584/1186] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:20:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:20:30.246416 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebbd221-4e6c-4dfe-b48d-30a5d444d954 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:20:30.246844 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebbd221-4e6c-4dfe-b48d-30a5d444d954 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:20:30.246950 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebbd221-4e6c-4dfe-b48d-30a5d444d954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:20:30.265122 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-aebbd221-4e6c-4dfe-b48d-30a5d444d954 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:20:30.266295 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-aebbd221-4e6c-4dfe-b48d-30a5d444d954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:20:30.332464 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 603/1187] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:20:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 16:20:30.601402 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f000aba-037c-4994-86dd-45fdfa346d61 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:20:30.698284 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f000aba-037c-4994-86dd-45fdfa346d61 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:20:30.731110 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b31a12-f9af-42cd-8823-d4856815a673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:20:30.731714 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b31a12-f9af-42cd-8823-d4856815a673 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:20:30.731990 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b31a12-f9af-42cd-8823-d4856815a673 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:20:30.732256 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b31a12-f9af-42cd-8823-d4856815a673 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:20:30.741915 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b31a12-f9af-42cd-8823-d4856815a673 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 16:20:30.746629 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-b8b31a12-f9af-42cd-8823-d4856815a673 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 16:20:30.746629 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:20:30.746629 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:20:30.746629 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:20:30.746629 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:20:30.746629 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:20:30.746629 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:20:30.746629 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:20:30.746629 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:20:30.746629 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:20:30.746629 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:20:30.746629 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:20:30.746629 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 16:20:30.746629 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 16:20:30.746629 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 16:20:30.746629 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 16:20:30.747725 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 16:20:30.747725 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 16:20:30.747725 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 16:20:30.747725 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 16:20:30.747725 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:20:30.747725 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:20:30.747725 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:20:30.747725 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:20:30.747725 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:20:30.747725 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:20:30.747725 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:20:30.747725 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 16:20:30.747725 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:20:30.747725 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:20:30.747725 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:20:30.747725 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:20:30.748598 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:20:30.748598 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:20:30.748598 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:20:30.748598 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:20:30.748598 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 16:20:30.748598 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 16:20:30.748598 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 16:20:30.748598 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 16:20:30.748598 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 16:20:30.748598 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 16:20:30.748598 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 16:20:30.748598 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 16:20:30.748598 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 585/1188] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Sep 9 16:20:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:20:30.753520 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebbd221-4e6c-4dfe-b48d-30a5d444d954 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:20:30.848740 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebbd221-4e6c-4dfe-b48d-30a5d444d954 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:20:30.857535 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:20:30.881112 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffcf949-a136-4b93-bb44-189326fe6414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:20:30.881699 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffcf949-a136-4b93-bb44-189326fe6414 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:20:30.881975 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffcf949-a136-4b93-bb44-189326fe6414 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:20:30.882243 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffcf949-a136-4b93-bb44-189326fe6414 None admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:20:30.882916 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffcf949-a136-4b93-bb44-189326fe6414 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:20:30.883214 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffcf949-a136-4b93-bb44-189326fe6414 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:20:30.884569 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffcf949-a136-4b93-bb44-189326fe6414 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:20:30.892752 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 604/1189] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Sep 9 16:20:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:20:30.898596 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b31a12-f9af-42cd-8823-d4856815a673 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:20:30.952482 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:20:30.995698 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b31a12-f9af-42cd-8823-d4856815a673 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:20:31.028415 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b246728a-31d7-4aad-bb9d-90669357d1a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:20:31.029027 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b246728a-31d7-4aad-bb9d-90669357d1a8 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:20:31.029298 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b246728a-31d7-4aad-bb9d-90669357d1a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:20:31.029563 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b246728a-31d7-4aad-bb9d-90669357d1a8 None admin] PATH_INFO: `/v3/users/f86ae7d1d9d3421d9ac05cdd34126126` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:20:31.030667 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b246728a-31d7-4aad-bb9d-90669357d1a8 None admin] RBAC: Authorizing `identity:get_user(user_id=f86ae7d1d9d3421d9ac05cdd34126126)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:20:31.032092 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b246728a-31d7-4aad-bb9d-90669357d1a8 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:20:31.033635 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 586/1190] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Sep 9 16:20:30 2022] GET /identity/v3/users/f86ae7d1d9d3421d9ac05cdd34126126 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:20:31.039399 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffcf949-a136-4b93-bb44-189326fe6414 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:20:31.135275 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffcf949-a136-4b93-bb44-189326fe6414 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:20:31.167427 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7667427-523c-4560-87c3-812911d36ac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:20:31.168034 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7667427-523c-4560-87c3-812911d36ac4 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:20:31.168310 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7667427-523c-4560-87c3-812911d36ac4 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:20:31.168584 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7667427-523c-4560-87c3-812911d36ac4 None admin] PATH_INFO: `/v3/projects/45d08abef0e847d89b28592219365aa8` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:20:31.169772 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7667427-523c-4560-87c3-812911d36ac4 None admin] RBAC: Authorizing `identity:get_project(project_id=45d08abef0e847d89b28592219365aa8)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:20:31.171236 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7667427-523c-4560-87c3-812911d36ac4 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:20:31.172849 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 605/1191] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Sep 9 16:20:31 2022] GET /identity/v3/projects/45d08abef0e847d89b28592219365aa8 => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:20:31.178565 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b246728a-31d7-4aad-bb9d-90669357d1a8 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:20:31.273377 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b246728a-31d7-4aad-bb9d-90669357d1a8 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:20:31.294976 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:20:31.306723 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd922fa0-8537-4966-9674-909c0cef08d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:20:31.307369 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd922fa0-8537-4966-9674-909c0cef08d0 None admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:20:31.307647 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd922fa0-8537-4966-9674-909c0cef08d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:20:31.307917 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd922fa0-8537-4966-9674-909c0cef08d0 None admin] PATH_INFO: `/v3/projects/45d08abef0e847d89b28592219365aa8/users/f86ae7d1d9d3421d9ac05cdd34126126/roles/0a36d1be416f4089be19be979943b731` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:20:31.309769 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd922fa0-8537-4966-9674-909c0cef08d0 None admin] RBAC: Authorizing `identity:create_grant(project_id=45d08abef0e847d89b28592219365aa8, user_id=f86ae7d1d9d3421d9ac05cdd34126126, role_id=0a36d1be416f4089be19be979943b731)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:20:31.311225 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd922fa0-8537-4966-9674-909c0cef08d0 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:20:31.324106 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 587/1192] 10.222.0.27 () {58 vars in 1439 bytes} [Fri Sep 9 16:20:31 2022] PUT /identity/v3/projects/45d08abef0e847d89b28592219365aa8/users/f86ae7d1d9d3421d9ac05cdd34126126/roles/0a36d1be416f4089be19be979943b731 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:20:33.470936 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae479d6-87ff-47ea-a8ae-aa2df792a2c9 None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:20:33.471457 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae479d6-87ff-47ea-a8ae-aa2df792a2c9 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:20:33.471457 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae479d6-87ff-47ea-a8ae-aa2df792a2c9 None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:20:33.472791 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 606/1193] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:20:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:20:33.477960 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41219ed8-d2f6-4979-bf07-fd16bd3c7acc None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:20:33.478345 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41219ed8-d2f6-4979-bf07-fd16bd3c7acc None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:20:33.478547 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41219ed8-d2f6-4979-bf07-fd16bd3c7acc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:20:33.496861 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-41219ed8-d2f6-4979-bf07-fd16bd3c7acc None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:20:33.498043 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-41219ed8-d2f6-4979-bf07-fd16bd3c7acc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:20:33.562461 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 588/1194] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:20:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 16:20:33.836638 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae479d6-87ff-47ea-a8ae-aa2df792a2c9 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:20:33.876766 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:20:33.936752 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae479d6-87ff-47ea-a8ae-aa2df792a2c9 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:20:33.968945 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eab27c2-9e49-449d-b08c-4940b12bdab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:20:33.969550 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eab27c2-9e49-449d-b08c-4940b12bdab2 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:20:33.970436 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eab27c2-9e49-449d-b08c-4940b12bdab2 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:20:33.970710 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eab27c2-9e49-449d-b08c-4940b12bdab2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:20:33.981317 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eab27c2-9e49-449d-b08c-4940b12bdab2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 16:20:33.987347 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-7eab27c2-9e49-449d-b08c-4940b12bdab2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 16:20:33.987347 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:20:33.987347 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:20:33.987347 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:20:33.987347 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:20:33.987347 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:20:33.987347 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:20:33.987347 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:20:33.987347 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:20:33.987347 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:20:33.987347 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:20:33.987347 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:20:33.987347 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 16:20:33.987347 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 16:20:33.987347 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 16:20:33.987347 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 16:20:33.988452 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 16:20:33.988452 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 16:20:33.988452 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 16:20:33.988452 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 16:20:33.988452 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:20:33.988452 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:20:33.988452 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:20:33.988452 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:20:33.988452 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:20:33.988452 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:20:33.988452 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:20:33.988452 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Sep 09 16:20:33.988452 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:20:33.988452 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:20:33.988452 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:20:33.988452 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:20:33.989413 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:20:33.989413 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:20:33.989413 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:20:33.989413 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:20:33.989413 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 16:20:33.989413 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 16:20:33.989413 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 16:20:33.989413 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 16:20:33.989413 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 16:20:33.989413 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 16:20:33.989413 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 16:20:33.989413 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:20:33.989413 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 607/1195] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Sep 9 16:20:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:20:33.994652 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41219ed8-d2f6-4979-bf07-fd16bd3c7acc None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:20:34.093246 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41219ed8-d2f6-4979-bf07-fd16bd3c7acc None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:20:34.105878 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:20:34.129151 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129ffc91-f51b-48ed-a129-87765aa6cff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:20:34.129742 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129ffc91-f51b-48ed-a129-87765aa6cff3 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:20:34.130013 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129ffc91-f51b-48ed-a129-87765aa6cff3 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:20:34.130277 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129ffc91-f51b-48ed-a129-87765aa6cff3 None admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:20:34.131060 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129ffc91-f51b-48ed-a129-87765aa6cff3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:20:34.131358 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129ffc91-f51b-48ed-a129-87765aa6cff3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:20:34.132717 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129ffc91-f51b-48ed-a129-87765aa6cff3 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:20:34.140397 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 589/1196] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Sep 9 16:20:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:20:34.147143 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eab27c2-9e49-449d-b08c-4940b12bdab2 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:20:34.240038 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:20:34.243998 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eab27c2-9e49-449d-b08c-4940b12bdab2 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:20:34.278076 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cb5c9c-1687-4b23-8d8f-27e6916ec32c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:20:34.278780 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cb5c9c-1687-4b23-8d8f-27e6916ec32c None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:20:34.279054 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cb5c9c-1687-4b23-8d8f-27e6916ec32c None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:20:34.279325 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cb5c9c-1687-4b23-8d8f-27e6916ec32c None admin] PATH_INFO: `/v3/users/f86ae7d1d9d3421d9ac05cdd34126126` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:20:34.280444 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cb5c9c-1687-4b23-8d8f-27e6916ec32c None admin] RBAC: Authorizing `identity:get_user(user_id=f86ae7d1d9d3421d9ac05cdd34126126)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:20:34.281863 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cb5c9c-1687-4b23-8d8f-27e6916ec32c None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:20:34.283760 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 608/1197] 10.222.0.27 () {56 vars in 1177 bytes} [Fri Sep 9 16:20:34 2022] GET /identity/v3/users/f86ae7d1d9d3421d9ac05cdd34126126 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:20:34.289204 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129ffc91-f51b-48ed-a129-87765aa6cff3 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:20:34.388040 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129ffc91-f51b-48ed-a129-87765aa6cff3 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:20:34.420160 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dbd8d0-c7a5-4d9c-b104-2ab8374415c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:20:34.420752 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dbd8d0-c7a5-4d9c-b104-2ab8374415c3 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:20:34.421027 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dbd8d0-c7a5-4d9c-b104-2ab8374415c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:20:34.421294 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dbd8d0-c7a5-4d9c-b104-2ab8374415c3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:20:34.462163 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:20:34.491155 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dbd8d0-c7a5-4d9c-b104-2ab8374415c3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:20:34.493270 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dbd8d0-c7a5-4d9c-b104-2ab8374415c3 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:20:34.588997 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 590/1198] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Sep 9 16:20:34 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 09 16:20:34.595155 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cb5c9c-1687-4b23-8d8f-27e6916ec32c None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:20:34.697490 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cb5c9c-1687-4b23-8d8f-27e6916ec32c None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:20:34.730242 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0a9eda-92fb-47c5-b45c-3263ce1efb72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:20:34.730885 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0a9eda-92fb-47c5-b45c-3263ce1efb72 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:20:34.731162 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0a9eda-92fb-47c5-b45c-3263ce1efb72 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:20:34.731431 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0a9eda-92fb-47c5-b45c-3263ce1efb72 None admin] PATH_INFO: `/v3/projects/45d08abef0e847d89b28592219365aa8` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:20:34.732533 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0a9eda-92fb-47c5-b45c-3263ce1efb72 None admin] RBAC: Authorizing `identity:get_project(project_id=45d08abef0e847d89b28592219365aa8)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:20:34.733958 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0a9eda-92fb-47c5-b45c-3263ce1efb72 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:20:34.737220 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 609/1199] 10.222.0.27 () {56 vars in 1186 bytes} [Fri Sep 9 16:20:34 2022] GET /identity/v3/projects/45d08abef0e847d89b28592219365aa8 => generated 361 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:20:34.743498 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dbd8d0-c7a5-4d9c-b104-2ab8374415c3 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:20:34.827076 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:20:34.852339 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dbd8d0-c7a5-4d9c-b104-2ab8374415c3 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:20:34.885413 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c04d4d-c54c-4371-ac18-450a66d1b6c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:20:34.886001 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c04d4d-c54c-4371-ac18-450a66d1b6c1 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:20:34.886277 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c04d4d-c54c-4371-ac18-450a66d1b6c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:20:34.886579 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c04d4d-c54c-4371-ac18-450a66d1b6c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:20:34.887312 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c04d4d-c54c-4371-ac18-450a66d1b6c1 None admin] RBAC: Adding query filter params (role.id=0a36d1be416f4089be19be979943b731, scope.project.id=45d08abef0e847d89b28592219365aa8, user.id=f86ae7d1d9d3421d9ac05cdd34126126) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:20:34.887612 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c04d4d-c54c-4371-ac18-450a66d1b6c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:20:34.889039 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c04d4d-c54c-4371-ac18-450a66d1b6c1 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:20:34.894699 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 591/1200] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Sep 9 16:20:34 2022] GET /identity/v3/role_assignments?user.id=f86ae7d1d9d3421d9ac05cdd34126126&scope.project.id=45d08abef0e847d89b28592219365aa8&role.id=0a36d1be416f4089be19be979943b731 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:20:44.726129 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=83 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:20:44.892263 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=31 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:21:30.407137 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a02dd5-281a-4a73-a47e-00741cc56e34 None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:21:30.407720 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a02dd5-281a-4a73-a47e-00741cc56e34 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:21:30.407823 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a02dd5-281a-4a73-a47e-00741cc56e34 None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:21:30.410046 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 610/1201] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:21:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:21:30.418512 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02bdf51-5b13-4028-ab02-263dce74d349 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:21:30.418512 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02bdf51-5b13-4028-ab02-263dce74d349 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:21:30.418512 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02bdf51-5b13-4028-ab02-263dce74d349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:21:30.441400 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-b02bdf51-5b13-4028-ab02-263dce74d349 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:21:30.442683 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-b02bdf51-5b13-4028-ab02-263dce74d349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:21:30.541260 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 592/1202] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:21:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 16:21:30.875444 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a02dd5-281a-4a73-a47e-00741cc56e34 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:21:31.001600 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a02dd5-281a-4a73-a47e-00741cc56e34 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:21:31.054206 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8995ccbd-0fd3-45ef-a123-ec180d89efb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:21:31.054884 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8995ccbd-0fd3-45ef-a123-ec180d89efb3 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:21:31.055162 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8995ccbd-0fd3-45ef-a123-ec180d89efb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:21:31.055469 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8995ccbd-0fd3-45ef-a123-ec180d89efb3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:21:31.068303 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8995ccbd-0fd3-45ef-a123-ec180d89efb3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:21:31.069915 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8995ccbd-0fd3-45ef-a123-ec180d89efb3 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:21:31.086131 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-8995ccbd-0fd3-45ef-a123-ec180d89efb3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 16:21:31.086131 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:21:31.086131 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:21:31.086131 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:21:31.086131 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:21:31.086131 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:21:31.086131 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:21:31.086131 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:21:31.086131 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:21:31.086131 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:21:31.086131 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:21:31.086131 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:21:31.086131 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 16:21:31.086131 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 16:21:31.086131 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 16:21:31.086131 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 16:21:31.087334 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:21:31.087334 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:21:31.087334 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:21:31.087334 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:21:31.087334 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:21:31.087334 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:21:31.087334 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:21:31.087334 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Sep 09 16:21:31.087334 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:21:31.087334 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:21:31.087334 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:21:31.087334 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:21:31.087334 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:21:31.087334 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:21:31.087334 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:21:31.087334 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:21:31.087334 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 16:21:31.088352 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 16:21:31.088352 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 16:21:31.088352 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:21:31.092117 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 611/1203] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 16:21:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:21:31.094345 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02bdf51-5b13-4028-ab02-263dce74d349 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:21:31.216944 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02bdf51-5b13-4028-ab02-263dce74d349 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:21:31.249931 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:21:31.258577 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c3deb1-6896-4fac-b57c-3a7cb211c3e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:21:31.259211 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c3deb1-6896-4fac-b57c-3a7cb211c3e7 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:21:31.259485 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c3deb1-6896-4fac-b57c-3a7cb211c3e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:21:31.259759 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c3deb1-6896-4fac-b57c-3a7cb211c3e7 None admin] PATH_INFO: `/v3/domains` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:21:31.260471 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c3deb1-6896-4fac-b57c-3a7cb211c3e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:21:31.260768 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c3deb1-6896-4fac-b57c-3a7cb211c3e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:21:31.262207 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c3deb1-6896-4fac-b57c-3a7cb211c3e7 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:21:31.286432 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 593/1204] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Sep 9 16:21:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:21:31.292290 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8995ccbd-0fd3-45ef-a123-ec180d89efb3 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:21:31.372075 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:21:31.444655 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8995ccbd-0fd3-45ef-a123-ec180d89efb3 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:21:31.496384 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0548fc1b-2e29-4007-b8dd-ae6c8441c445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:21:31.496908 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0548fc1b-2e29-4007-b8dd-ae6c8441c445 None admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:21:31.497187 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0548fc1b-2e29-4007-b8dd-ae6c8441c445 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:21:31.497448 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0548fc1b-2e29-4007-b8dd-ae6c8441c445 None admin] PATH_INFO: `/v3/users` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:21:31.498128 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0548fc1b-2e29-4007-b8dd-ae6c8441c445 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:21:31.499538 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0548fc1b-2e29-4007-b8dd-ae6c8441c445 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:21:31.525860 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 612/1205] 10.222.0.27 () {60 vars in 1132 bytes} [Fri Sep 9 16:21:31 2022] POST /identity/v3/users => generated 251 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:21:34.055235 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70737249-f24c-4ed6-864a-717441e06d5f None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:21:34.055851 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70737249-f24c-4ed6-864a-717441e06d5f None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:21:34.055851 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70737249-f24c-4ed6-864a-717441e06d5f None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:21:34.057082 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 594/1206] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:21:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:21:34.063257 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742dc71a-6d6f-4bd2-a3cc-307b4482ecde None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:21:34.064925 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742dc71a-6d6f-4bd2-a3cc-307b4482ecde None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:21:34.064925 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742dc71a-6d6f-4bd2-a3cc-307b4482ecde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:21:34.084539 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-742dc71a-6d6f-4bd2-a3cc-307b4482ecde None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:21:34.085893 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-742dc71a-6d6f-4bd2-a3cc-307b4482ecde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:21:34.171836 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 613/1207] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:21:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 16:21:34.464773 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70737249-f24c-4ed6-864a-717441e06d5f None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:21:34.578259 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70737249-f24c-4ed6-864a-717441e06d5f None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:21:34.625621 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c3ac0d-7801-48ad-94ee-bc91aa6c4a46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:21:34.626443 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c3ac0d-7801-48ad-94ee-bc91aa6c4a46 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:21:34.627232 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c3ac0d-7801-48ad-94ee-bc91aa6c4a46 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:21:34.627635 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c3ac0d-7801-48ad-94ee-bc91aa6c4a46 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:21:34.640992 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c3ac0d-7801-48ad-94ee-bc91aa6c4a46 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 16:21:34.649286 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-59c3ac0d-7801-48ad-94ee-bc91aa6c4a46 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 16:21:34.649286 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:21:34.649286 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:21:34.649286 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:21:34.649286 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:21:34.649286 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:21:34.649286 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:21:34.649286 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:21:34.649286 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:21:34.649286 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:21:34.649286 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:21:34.649286 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:21:34.649286 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 16:21:34.649286 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 16:21:34.649286 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 16:21:34.649286 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 16:21:34.650380 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 16:21:34.650380 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 16:21:34.650380 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 16:21:34.650380 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 16:21:34.650380 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:21:34.650380 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:21:34.650380 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:21:34.650380 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:21:34.650380 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:21:34.650380 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:21:34.650380 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:21:34.650380 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 16:21:34.650380 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:21:34.650380 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:21:34.650380 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:21:34.650380 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:21:34.651259 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:21:34.651259 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:21:34.651259 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:21:34.651259 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:21:34.651259 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 16:21:34.651259 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 16:21:34.651259 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 16:21:34.651259 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 16:21:34.651259 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 16:21:34.651259 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 16:21:34.651259 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 16:21:34.651259 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 16:21:34.651259 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 595/1208] 10.222.0.27 () {56 vars in 1102 bytes} [Fri Sep 9 16:21:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:21:34.658690 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742dc71a-6d6f-4bd2-a3cc-307b4482ecde None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:21:34.703452 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:21:34.779730 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742dc71a-6d6f-4bd2-a3cc-307b4482ecde None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:21:34.818785 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8c4a56-4b11-4128-92bd-ec50ff7e1850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:21:34.819494 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8c4a56-4b11-4128-92bd-ec50ff7e1850 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:21:34.819809 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8c4a56-4b11-4128-92bd-ec50ff7e1850 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:21:34.820139 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8c4a56-4b11-4128-92bd-ec50ff7e1850 None admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:21:34.820872 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8c4a56-4b11-4128-92bd-ec50ff7e1850 None admin] RBAC: Adding query filter params (name=service) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:21:34.821237 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8c4a56-4b11-4128-92bd-ec50ff7e1850 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:21:34.822701 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8c4a56-4b11-4128-92bd-ec50ff7e1850 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:21:34.831544 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 614/1209] 10.222.0.27 () {56 vars in 1103 bytes} [Fri Sep 9 16:21:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:21:34.837271 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c3ac0d-7801-48ad-94ee-bc91aa6c4a46 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:21:34.902160 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:21:34.956335 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c3ac0d-7801-48ad-94ee-bc91aa6c4a46 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:21:35.005996 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c92615-7849-4f88-ac9a-52f548a2eb03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:21:35.006713 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c92615-7849-4f88-ac9a-52f548a2eb03 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:21:35.007062 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c92615-7849-4f88-ac9a-52f548a2eb03 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:21:35.007358 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c92615-7849-4f88-ac9a-52f548a2eb03 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:21:35.019926 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c92615-7849-4f88-ac9a-52f548a2eb03 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:21:35.021546 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c92615-7849-4f88-ac9a-52f548a2eb03 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:21:35.037895 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-b6c92615-7849-4f88-ac9a-52f548a2eb03 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 16:21:35.037895 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:21:35.037895 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:21:35.037895 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:21:35.037895 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:21:35.037895 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:21:35.037895 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:21:35.037895 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:21:35.037895 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:21:35.037895 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:21:35.037895 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:21:35.037895 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:21:35.037895 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 16:21:35.037895 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 16:21:35.037895 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 16:21:35.037895 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 16:21:35.038932 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:21:35.038932 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:21:35.038932 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:21:35.038932 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:21:35.038932 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:21:35.038932 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:21:35.038932 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:21:35.038932 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 16:21:35.038932 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:21:35.038932 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:21:35.038932 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:21:35.038932 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:21:35.038932 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:21:35.038932 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:21:35.038932 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:21:35.038932 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:21:35.038932 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 16:21:35.045033 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 16:21:35.045033 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 16:21:35.045033 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 16:21:35.045033 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 596/1210] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 16:21:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 16:21:35.045285 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8c4a56-4b11-4128-92bd-ec50ff7e1850 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:21:35.169961 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:21:35.175149 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8c4a56-4b11-4128-92bd-ec50ff7e1850 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:21:35.225683 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b1cd32-d7ab-44c3-92a4-c45ef6c1d51a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:21:35.226343 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b1cd32-d7ab-44c3-92a4-c45ef6c1d51a None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:21:35.226674 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b1cd32-d7ab-44c3-92a4-c45ef6c1d51a None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:21:35.226983 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b1cd32-d7ab-44c3-92a4-c45ef6c1d51a None admin] PATH_INFO: `/v3/domains` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:21:35.227716 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b1cd32-d7ab-44c3-92a4-c45ef6c1d51a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:21:35.227990 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b1cd32-d7ab-44c3-92a4-c45ef6c1d51a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:21:35.229588 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b1cd32-d7ab-44c3-92a4-c45ef6c1d51a None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:21:35.244109 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 615/1211] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Sep 9 16:21:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 16:21:35.250703 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c92615-7849-4f88-ac9a-52f548a2eb03 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:21:35.374160 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c92615-7849-4f88-ac9a-52f548a2eb03 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:21:35.375825 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:21:35.413476 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5820ea-a097-4249-ac77-2f96eb27fe37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:21:35.414603 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5820ea-a097-4249-ac77-2f96eb27fe37 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:21:35.414603 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5820ea-a097-4249-ac77-2f96eb27fe37 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:21:35.414603 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5820ea-a097-4249-ac77-2f96eb27fe37 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:21:35.423627 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5820ea-a097-4249-ac77-2f96eb27fe37 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:21:35.425869 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5820ea-a097-4249-ac77-2f96eb27fe37 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:21:35.438788 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-2a5820ea-a097-4249-ac77-2f96eb27fe37 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 09 16:21:35.438788 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:21:35.438788 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:21:35.438788 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:21:35.438788 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:21:35.438788 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:21:35.438788 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:21:35.438788 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:21:35.438788 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:21:35.438788 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:21:35.438788 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:21:35.438788 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:21:35.438788 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 16:21:35.438788 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 16:21:35.438788 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 16:21:35.438788 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 16:21:35.440176 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:21:35.440176 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:21:35.440176 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 16:21:35.440176 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 16:21:35.440176 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 16:21:35.440176 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 16:21:35.440176 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:21:35.440176 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:21:35.440176 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:21:35.440176 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:21:35.440176 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:21:35.440176 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 16:21:35.440176 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:21:35.440176 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:21:35.440176 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:21:35.440176 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:21:35.440176 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:21:35.440176 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:21:35.441364 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:21:35.441364 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:21:35.441364 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 16:21:35.441364 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 16:21:35.441364 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 16:21:35.441364 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 16:21:35.441364 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 16:21:35.441364 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 16:21:35.441364 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 09 16:21:35.441364 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 16:21:35.441364 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 597/1212] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 16:21:35 2022] GET /identity/v3/users/placement => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:21:35.447035 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b1cd32-d7ab-44c3-92a4-c45ef6c1d51a None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:21:35.575339 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b1cd32-d7ab-44c3-92a4-c45ef6c1d51a None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:21:35.615932 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6e403e-8f3a-4135-a118-37997f7a21df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:21:35.616569 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6e403e-8f3a-4135-a118-37997f7a21df None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:21:35.616865 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6e403e-8f3a-4135-a118-37997f7a21df None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:21:35.617490 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6e403e-8f3a-4135-a118-37997f7a21df None admin] PATH_INFO: `/v3/users` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:21:35.618236 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6e403e-8f3a-4135-a118-37997f7a21df None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:21:35.618625 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6e403e-8f3a-4135-a118-37997f7a21df None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:21:35.620313 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6e403e-8f3a-4135-a118-37997f7a21df None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:21:35.647872 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 616/1213] 10.222.0.27 () {56 vars in 1143 bytes} [Fri Sep 9 16:21:35 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 16:21:35.650472 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5820ea-a097-4249-ac77-2f96eb27fe37 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:21:35.767962 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5820ea-a097-4249-ac77-2f96eb27fe37 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:21:35.811313 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbe1b2c-4eed-466a-ab60-43074335015d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:21:35.811928 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbe1b2c-4eed-466a-ab60-43074335015d None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:21:35.812204 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbe1b2c-4eed-466a-ab60-43074335015d None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:21:35.812473 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbe1b2c-4eed-466a-ab60-43074335015d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:21:35.846354 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:21:35.887491 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbe1b2c-4eed-466a-ab60-43074335015d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:21:35.889054 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbe1b2c-4eed-466a-ab60-43074335015d None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:21:36.002365 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 598/1214] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Sep 9 16:21:35 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 09 16:21:36.004146 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6e403e-8f3a-4135-a118-37997f7a21df None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:21:36.025360 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:21:36.116795 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6e403e-8f3a-4135-a118-37997f7a21df None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:21:36.157538 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518e8fa4-2156-4382-8025-27a70ea3392a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:21:36.158894 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518e8fa4-2156-4382-8025-27a70ea3392a None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:21:36.159363 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518e8fa4-2156-4382-8025-27a70ea3392a None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:21:36.159733 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518e8fa4-2156-4382-8025-27a70ea3392a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:21:36.171087 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518e8fa4-2156-4382-8025-27a70ea3392a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:21:36.172818 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518e8fa4-2156-4382-8025-27a70ea3392a None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:21:36.189718 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-518e8fa4-2156-4382-8025-27a70ea3392a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 16:21:36.189718 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:21:36.189718 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:21:36.189718 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:21:36.189718 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:21:36.189718 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:21:36.189718 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:21:36.189718 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:21:36.189718 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:21:36.189718 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:21:36.189718 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:21:36.189718 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:21:36.189718 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 16:21:36.189718 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 16:21:36.189718 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 16:21:36.189718 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 16:21:36.191032 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:21:36.191032 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:21:36.191032 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:21:36.191032 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:21:36.191032 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:21:36.191032 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:21:36.191032 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:21:36.191032 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Sep 09 16:21:36.191032 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:21:36.191032 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:21:36.191032 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:21:36.191032 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:21:36.191032 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:21:36.191032 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:21:36.191032 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:21:36.191032 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:21:36.191032 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 16:21:36.192163 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 16:21:36.192163 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 16:21:36.192163 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:21:36.197723 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 617/1215] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 16:21:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:21:36.198996 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbe1b2c-4eed-466a-ab60-43074335015d None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:21:36.271656 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:21:36.321981 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbe1b2c-4eed-466a-ab60-43074335015d None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:21:36.361049 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17f5ac4-a6c6-482b-a0b8-a34d9178ca7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:21:36.361853 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17f5ac4-a6c6-482b-a0b8-a34d9178ca7b None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:21:36.362285 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17f5ac4-a6c6-482b-a0b8-a34d9178ca7b None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:21:36.362676 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17f5ac4-a6c6-482b-a0b8-a34d9178ca7b None admin] PATH_INFO: `/v3/domains` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:21:36.363472 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17f5ac4-a6c6-482b-a0b8-a34d9178ca7b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:21:36.363867 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17f5ac4-a6c6-482b-a0b8-a34d9178ca7b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:21:36.365429 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17f5ac4-a6c6-482b-a0b8-a34d9178ca7b None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:21:36.378936 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 599/1216] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Sep 9 16:21:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:21:36.385317 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518e8fa4-2156-4382-8025-27a70ea3392a None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:21:36.477000 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:21:36.511896 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518e8fa4-2156-4382-8025-27a70ea3392a None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:21:36.558892 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815af5e2-f169-4375-a701-dbd1ca2b0ae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:21:36.559494 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815af5e2-f169-4375-a701-dbd1ca2b0ae1 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:21:36.559769 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815af5e2-f169-4375-a701-dbd1ca2b0ae1 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:21:36.560056 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815af5e2-f169-4375-a701-dbd1ca2b0ae1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:21:36.568810 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815af5e2-f169-4375-a701-dbd1ca2b0ae1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:21:36.570342 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815af5e2-f169-4375-a701-dbd1ca2b0ae1 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:21:36.583517 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-815af5e2-f169-4375-a701-dbd1ca2b0ae1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 16:21:36.583517 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:21:36.583517 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:21:36.583517 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:21:36.583517 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:21:36.583517 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:21:36.583517 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:21:36.583517 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:21:36.583517 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:21:36.583517 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:21:36.583517 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:21:36.583517 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:21:36.583517 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 16:21:36.583517 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 16:21:36.583517 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 16:21:36.584613 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 16:21:36.584613 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:21:36.584613 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:21:36.584613 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:21:36.584613 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:21:36.584613 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:21:36.584613 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:21:36.584613 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:21:36.584613 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Sep 09 16:21:36.584613 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:21:36.584613 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:21:36.584613 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:21:36.584613 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:21:36.584613 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:21:36.584613 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:21:36.584613 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:21:36.584613 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:21:36.585507 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 16:21:36.585507 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 16:21:36.585507 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 16:21:36.585507 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 16:21:36.585507 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 16:21:36.585507 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 16:21:36.585507 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 16:21:36.585507 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:21:36.585507 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 618/1217] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Sep 9 16:21:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:21:36.591628 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17f5ac4-a6c6-482b-a0b8-a34d9178ca7b None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:21:36.725506 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17f5ac4-a6c6-482b-a0b8-a34d9178ca7b None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:21:36.752725 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:21:36.768823 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4f67b0-2084-47f3-b771-a665ea77aff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:21:36.769490 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4f67b0-2084-47f3-b771-a665ea77aff0 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:21:36.769803 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4f67b0-2084-47f3-b771-a665ea77aff0 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:21:36.770146 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4f67b0-2084-47f3-b771-a665ea77aff0 None admin] PATH_INFO: `/v3/projects` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:21:36.770964 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4f67b0-2084-47f3-b771-a665ea77aff0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:21:36.771334 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4f67b0-2084-47f3-b771-a665ea77aff0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:21:36.772900 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4f67b0-2084-47f3-b771-a665ea77aff0 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:21:36.788608 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 600/1218] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Sep 9 16:21:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 16:21:36.795099 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815af5e2-f169-4375-a701-dbd1ca2b0ae1 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:21:36.907416 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815af5e2-f169-4375-a701-dbd1ca2b0ae1 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:21:36.940087 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:21:36.946163 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7247730-e97e-456a-9523-4f295981f2bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:21:36.946771 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7247730-e97e-456a-9523-4f295981f2bd None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:21:36.947048 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7247730-e97e-456a-9523-4f295981f2bd None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:21:36.947315 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7247730-e97e-456a-9523-4f295981f2bd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:21:36.948020 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7247730-e97e-456a-9523-4f295981f2bd None admin] RBAC: Adding query filter params (role.id=1966594501e743aebf757851d9cd82a5, scope.project.id=68d6aaafab824657b08ca91f3d46d5f8, user.id=2d73df92393c43b2b5ccc32a2d43d952) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:21:36.948318 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7247730-e97e-456a-9523-4f295981f2bd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:21:36.949733 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7247730-e97e-456a-9523-4f295981f2bd None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:21:36.955835 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 619/1219] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Sep 9 16:21:36 2022] GET /identity/v3/role_assignments?user.id=2d73df92393c43b2b5ccc32a2d43d952&scope.project.id=68d6aaafab824657b08ca91f3d46d5f8&role.id=1966594501e743aebf757851d9cd82a5 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:21:39.299652 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80e541f-28dc-4638-8ed4-d6b34d9dc6df None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:21:39.300169 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80e541f-28dc-4638-8ed4-d6b34d9dc6df None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:21:39.300262 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80e541f-28dc-4638-8ed4-d6b34d9dc6df None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:21:39.301528 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 601/1220] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:21:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:21:39.307442 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c529f3-a5f8-4902-842d-1e1f793e5db0 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:21:39.307891 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c529f3-a5f8-4902-842d-1e1f793e5db0 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:21:39.307995 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c529f3-a5f8-4902-842d-1e1f793e5db0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:21:39.328480 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-c2c529f3-a5f8-4902-842d-1e1f793e5db0 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:21:39.329671 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-c2c529f3-a5f8-4902-842d-1e1f793e5db0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:21:39.405241 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 620/1221] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:21:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 16:21:39.693755 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80e541f-28dc-4638-8ed4-d6b34d9dc6df None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:21:39.812021 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80e541f-28dc-4638-8ed4-d6b34d9dc6df None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:21:39.850442 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670b8bb0-7f89-4ff3-8ca5-bf3bb30bc910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:21:39.851221 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670b8bb0-7f89-4ff3-8ca5-bf3bb30bc910 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:21:39.851504 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670b8bb0-7f89-4ff3-8ca5-bf3bb30bc910 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:21:39.851807 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670b8bb0-7f89-4ff3-8ca5-bf3bb30bc910 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:21:39.863012 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670b8bb0-7f89-4ff3-8ca5-bf3bb30bc910 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 16:21:39.868254 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-670b8bb0-7f89-4ff3-8ca5-bf3bb30bc910 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 16:21:39.868254 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:21:39.868254 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:21:39.868254 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:21:39.868254 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:21:39.868254 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:21:39.868254 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:21:39.868254 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:21:39.868254 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:21:39.868254 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:21:39.868254 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:21:39.868254 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:21:39.868254 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 16:21:39.868254 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 16:21:39.868254 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 16:21:39.868254 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 16:21:39.869501 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 16:21:39.869501 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 16:21:39.869501 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 16:21:39.869501 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 16:21:39.869501 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:21:39.869501 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:21:39.869501 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:21:39.869501 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:21:39.869501 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:21:39.869501 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:21:39.869501 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:21:39.869501 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 16:21:39.869501 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:21:39.869501 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:21:39.869501 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:21:39.869501 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:21:39.870409 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:21:39.870409 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:21:39.870409 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:21:39.870409 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:21:39.870409 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 16:21:39.870409 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 16:21:39.870409 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 16:21:39.870409 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 16:21:39.870409 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 16:21:39.870409 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 16:21:39.870409 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 16:21:39.870409 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 16:21:39.870409 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 602/1222] 10.222.0.27 () {56 vars in 1102 bytes} [Fri Sep 9 16:21:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:21:39.876019 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c529f3-a5f8-4902-842d-1e1f793e5db0 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:21:39.984821 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c529f3-a5f8-4902-842d-1e1f793e5db0 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:21:40.010666 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:21:40.021937 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70630c88-bbd7-447a-bb14-a22d0e0ed0bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:21:40.022580 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70630c88-bbd7-447a-bb14-a22d0e0ed0bb None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:21:40.022860 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70630c88-bbd7-447a-bb14-a22d0e0ed0bb None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:21:40.023134 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70630c88-bbd7-447a-bb14-a22d0e0ed0bb None admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:21:40.023785 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70630c88-bbd7-447a-bb14-a22d0e0ed0bb None admin] RBAC: Adding query filter params (name=service) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:21:40.024084 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70630c88-bbd7-447a-bb14-a22d0e0ed0bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:21:40.025448 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70630c88-bbd7-447a-bb14-a22d0e0ed0bb None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:21:40.033576 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 621/1223] 10.222.0.27 () {56 vars in 1103 bytes} [Fri Sep 9 16:21:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:21:40.039127 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670b8bb0-7f89-4ff3-8ca5-bf3bb30bc910 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:21:40.088565 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:21:40.147800 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670b8bb0-7f89-4ff3-8ca5-bf3bb30bc910 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:21:40.183010 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5543f550-7886-40eb-8676-072526d6c5b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:21:40.183627 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5543f550-7886-40eb-8676-072526d6c5b3 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:21:40.183900 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5543f550-7886-40eb-8676-072526d6c5b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:21:40.184161 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5543f550-7886-40eb-8676-072526d6c5b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:21:40.195625 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5543f550-7886-40eb-8676-072526d6c5b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:21:40.197070 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5543f550-7886-40eb-8676-072526d6c5b3 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:21:40.210754 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-5543f550-7886-40eb-8676-072526d6c5b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 16:21:40.210754 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:21:40.210754 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:21:40.210754 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:21:40.210754 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:21:40.210754 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:21:40.210754 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:21:40.210754 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:21:40.210754 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:21:40.210754 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:21:40.210754 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:21:40.210754 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:21:40.210754 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 16:21:40.210754 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 16:21:40.210754 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 16:21:40.210754 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 16:21:40.211912 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:21:40.211912 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:21:40.211912 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:21:40.211912 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:21:40.211912 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:21:40.211912 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:21:40.211912 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:21:40.211912 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 16:21:40.211912 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:21:40.211912 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:21:40.211912 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:21:40.211912 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:21:40.211912 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:21:40.211912 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:21:40.211912 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:21:40.211912 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:21:40.211912 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 16:21:40.212843 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 16:21:40.212843 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 16:21:40.212843 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 16:21:40.212843 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 603/1224] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 16:21:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:21:40.217841 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70630c88-bbd7-447a-bb14-a22d0e0ed0bb None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:21:40.334031 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70630c88-bbd7-447a-bb14-a22d0e0ed0bb None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:21:40.376513 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc9720f-8215-4487-97c9-4127d245e1c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:21:40.377721 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc9720f-8215-4487-97c9-4127d245e1c2 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:21:40.378035 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc9720f-8215-4487-97c9-4127d245e1c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:21:40.378326 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc9720f-8215-4487-97c9-4127d245e1c2 None admin] PATH_INFO: `/v3/domains` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:21:40.378975 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc9720f-8215-4487-97c9-4127d245e1c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:21:40.379269 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc9720f-8215-4487-97c9-4127d245e1c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:21:40.381332 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc9720f-8215-4487-97c9-4127d245e1c2 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:21:40.396451 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 622/1225] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Sep 9 16:21:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:21:40.401452 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5543f550-7886-40eb-8676-072526d6c5b3 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:21:40.506778 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:21:40.517344 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5543f550-7886-40eb-8676-072526d6c5b3 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:21:40.554905 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f44b44-8251-4b65-baca-fd0ca7bddc26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:21:40.555541 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f44b44-8251-4b65-baca-fd0ca7bddc26 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:21:40.555826 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f44b44-8251-4b65-baca-fd0ca7bddc26 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:21:40.556169 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f44b44-8251-4b65-baca-fd0ca7bddc26 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:21:40.564477 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f44b44-8251-4b65-baca-fd0ca7bddc26 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:21:40.565917 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f44b44-8251-4b65-baca-fd0ca7bddc26 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:21:40.577646 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-e5f44b44-8251-4b65-baca-fd0ca7bddc26 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 09 16:21:40.577646 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:21:40.577646 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:21:40.577646 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:21:40.577646 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:21:40.577646 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:21:40.577646 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:21:40.577646 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:21:40.577646 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:21:40.577646 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:21:40.577646 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:21:40.577646 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:21:40.577646 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 16:21:40.577646 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 16:21:40.577646 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 16:21:40.577646 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 16:21:40.578760 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:21:40.578760 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:21:40.578760 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 16:21:40.578760 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 16:21:40.578760 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 16:21:40.578760 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 16:21:40.578760 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:21:40.578760 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:21:40.578760 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:21:40.578760 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:21:40.578760 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:21:40.578760 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 16:21:40.578760 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:21:40.578760 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:21:40.578760 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:21:40.578760 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:21:40.578760 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:21:40.578760 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:21:40.580035 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:21:40.580035 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:21:40.580035 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 16:21:40.580035 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 16:21:40.580035 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 16:21:40.580035 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 16:21:40.580035 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 16:21:40.580035 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 16:21:40.580035 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 09 16:21:40.580035 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 16:21:40.580035 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 604/1226] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 16:21:40 2022] GET /identity/v3/users/placement => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:21:40.584750 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc9720f-8215-4487-97c9-4127d245e1c2 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:21:40.639859 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:21:40.696764 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc9720f-8215-4487-97c9-4127d245e1c2 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:21:40.730668 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5449fbdb-0c04-4493-88ae-bf36adefc41e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:21:40.731274 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5449fbdb-0c04-4493-88ae-bf36adefc41e None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:21:40.731550 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5449fbdb-0c04-4493-88ae-bf36adefc41e None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:21:40.731816 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5449fbdb-0c04-4493-88ae-bf36adefc41e None admin] PATH_INFO: `/v3/users` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:21:40.732568 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5449fbdb-0c04-4493-88ae-bf36adefc41e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:21:40.732868 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5449fbdb-0c04-4493-88ae-bf36adefc41e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:21:40.734285 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5449fbdb-0c04-4493-88ae-bf36adefc41e None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:21:40.753714 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 623/1227] 10.222.0.27 () {56 vars in 1143 bytes} [Fri Sep 9 16:21:40 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:21:40.760783 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f44b44-8251-4b65-baca-fd0ca7bddc26 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:21:40.872053 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f44b44-8251-4b65-baca-fd0ca7bddc26 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:21:40.907827 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671ad582-da51-4731-97fb-a264dea4906e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:21:40.908992 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671ad582-da51-4731-97fb-a264dea4906e None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:21:40.909265 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671ad582-da51-4731-97fb-a264dea4906e None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:21:40.909531 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671ad582-da51-4731-97fb-a264dea4906e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:21:40.921421 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671ad582-da51-4731-97fb-a264dea4906e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:21:40.922907 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671ad582-da51-4731-97fb-a264dea4906e None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:21:40.938580 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-671ad582-da51-4731-97fb-a264dea4906e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 16:21:40.938580 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:21:40.938580 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:21:40.938580 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:21:40.938580 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:21:40.938580 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:21:40.938580 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:21:40.938580 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:21:40.938580 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:21:40.938580 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:21:40.938580 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:21:40.938580 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:21:40.938580 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 16:21:40.938580 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 16:21:40.938580 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 16:21:40.938580 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 16:21:40.940799 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:21:40.940799 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:21:40.940799 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:21:40.940799 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:21:40.940799 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:21:40.940799 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:21:40.940799 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:21:40.940799 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 16:21:40.940799 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:21:40.940799 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:21:40.940799 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:21:40.940799 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:21:40.940799 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:21:40.940799 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:21:40.940799 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:21:40.940799 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:21:40.940799 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 16:21:40.942103 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 16:21:40.942103 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 16:21:40.942103 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 16:21:40.942103 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 605/1228] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 16:21:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:21:40.946683 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5449fbdb-0c04-4493-88ae-bf36adefc41e None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:21:41.067074 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5449fbdb-0c04-4493-88ae-bf36adefc41e None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:21:41.070087 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:21:41.108241 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e47b1c-f474-432d-bd48-b2996afa68c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:21:41.108896 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e47b1c-f474-432d-bd48-b2996afa68c7 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:21:41.109212 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e47b1c-f474-432d-bd48-b2996afa68c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:21:41.109517 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e47b1c-f474-432d-bd48-b2996afa68c7 None admin] PATH_INFO: `/v3/domains` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:21:41.110322 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e47b1c-f474-432d-bd48-b2996afa68c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:21:41.110839 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e47b1c-f474-432d-bd48-b2996afa68c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:21:41.112381 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e47b1c-f474-432d-bd48-b2996afa68c7 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:21:41.123497 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 624/1229] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Sep 9 16:21:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:21:41.130262 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671ad582-da51-4731-97fb-a264dea4906e None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:21:41.140808 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:21:41.240434 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671ad582-da51-4731-97fb-a264dea4906e None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:21:41.276159 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3a6f9b-6e3f-4540-a4e0-3604dccd4272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:21:41.276799 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3a6f9b-6e3f-4540-a4e0-3604dccd4272 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:21:41.277115 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3a6f9b-6e3f-4540-a4e0-3604dccd4272 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:21:41.282186 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3a6f9b-6e3f-4540-a4e0-3604dccd4272 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:21:41.284634 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3a6f9b-6e3f-4540-a4e0-3604dccd4272 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:21:41.286239 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3a6f9b-6e3f-4540-a4e0-3604dccd4272 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:21:41.298703 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-3c3a6f9b-6e3f-4540-a4e0-3604dccd4272 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 16:21:41.298703 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:21:41.298703 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:21:41.298703 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:21:41.298703 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:21:41.298703 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:21:41.298703 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:21:41.298703 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:21:41.298703 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:21:41.298703 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:21:41.298703 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:21:41.298703 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:21:41.298703 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 16:21:41.298703 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 16:21:41.298703 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 16:21:41.299636 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 16:21:41.299636 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:21:41.299636 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:21:41.299636 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:21:41.299636 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:21:41.299636 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:21:41.299636 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:21:41.299636 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:21:41.299636 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 16:21:41.299636 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:21:41.299636 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:21:41.299636 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:21:41.299636 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:21:41.299636 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:21:41.299636 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:21:41.299636 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:21:41.299636 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:21:41.300780 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 16:21:41.300780 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 16:21:41.300780 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 16:21:41.300780 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 16:21:41.300780 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 16:21:41.300780 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 16:21:41.300780 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 16:21:41.300780 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 16:21:41.300780 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 606/1230] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Sep 9 16:21:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 16:21:41.306433 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e47b1c-f474-432d-bd48-b2996afa68c7 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:21:41.420625 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e47b1c-f474-432d-bd48-b2996afa68c7 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:21:41.471641 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ec0f6f-30c5-48b4-b27d-12ba75b29a90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:21:41.472275 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ec0f6f-30c5-48b4-b27d-12ba75b29a90 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:21:41.472689 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ec0f6f-30c5-48b4-b27d-12ba75b29a90 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:21:41.472966 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ec0f6f-30c5-48b4-b27d-12ba75b29a90 None admin] PATH_INFO: `/v3/projects` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:21:41.473743 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ec0f6f-30c5-48b4-b27d-12ba75b29a90 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:21:41.474047 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ec0f6f-30c5-48b4-b27d-12ba75b29a90 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:21:41.475677 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ec0f6f-30c5-48b4-b27d-12ba75b29a90 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:21:41.490175 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 625/1231] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Sep 9 16:21:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:21:41.496530 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3a6f9b-6e3f-4540-a4e0-3604dccd4272 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:21:41.574348 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:21:41.613731 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3a6f9b-6e3f-4540-a4e0-3604dccd4272 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:21:41.648600 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a927f4-cbfe-48c9-933b-4145f8019166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:21:41.649243 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a927f4-cbfe-48c9-933b-4145f8019166 None admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:21:41.649516 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a927f4-cbfe-48c9-933b-4145f8019166 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:21:41.649787 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a927f4-cbfe-48c9-933b-4145f8019166 None admin] PATH_INFO: `/v3/projects/68d6aaafab824657b08ca91f3d46d5f8/users/2d73df92393c43b2b5ccc32a2d43d952/roles/1966594501e743aebf757851d9cd82a5` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:21:41.664767 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a927f4-cbfe-48c9-933b-4145f8019166 None admin] RBAC: Authorizing `identity:create_grant(project_id=68d6aaafab824657b08ca91f3d46d5f8, user_id=2d73df92393c43b2b5ccc32a2d43d952, role_id=1966594501e743aebf757851d9cd82a5)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:21:41.666202 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a927f4-cbfe-48c9-933b-4145f8019166 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:21:41.678821 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 607/1232] 10.222.0.27 () {58 vars in 1439 bytes} [Fri Sep 9 16:21:41 2022] PUT /identity/v3/projects/68d6aaafab824657b08ca91f3d46d5f8/users/2d73df92393c43b2b5ccc32a2d43d952/roles/1966594501e743aebf757851d9cd82a5 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 16:21:43.906882 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d402c0-dbb5-45df-8916-5f8b618e8986 None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:21:43.907660 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d402c0-dbb5-45df-8916-5f8b618e8986 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:21:43.907660 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d402c0-dbb5-45df-8916-5f8b618e8986 None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:21:43.909379 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 626/1233] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:21:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:21:43.914950 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaaa9b7-25d8-4596-97a5-9e2cffeb346b None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:21:43.915399 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaaa9b7-25d8-4596-97a5-9e2cffeb346b None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:21:43.915527 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaaa9b7-25d8-4596-97a5-9e2cffeb346b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:21:43.933531 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-faaaa9b7-25d8-4596-97a5-9e2cffeb346b None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:21:43.934770 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-faaaa9b7-25d8-4596-97a5-9e2cffeb346b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:21:44.002417 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 608/1234] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:21:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 16:21:44.324413 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d402c0-dbb5-45df-8916-5f8b618e8986 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:21:44.350672 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:21:44.432147 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d402c0-dbb5-45df-8916-5f8b618e8986 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:21:44.470542 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29f9499-5bec-4936-8a86-4cda9de33ff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:21:44.471201 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29f9499-5bec-4936-8a86-4cda9de33ff7 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:21:44.471477 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29f9499-5bec-4936-8a86-4cda9de33ff7 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:21:44.471743 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29f9499-5bec-4936-8a86-4cda9de33ff7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:21:44.482442 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29f9499-5bec-4936-8a86-4cda9de33ff7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 16:21:44.487671 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-e29f9499-5bec-4936-8a86-4cda9de33ff7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 16:21:44.487671 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:21:44.487671 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:21:44.487671 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:21:44.487671 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:21:44.487671 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:21:44.487671 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:21:44.487671 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:21:44.487671 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:21:44.487671 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:21:44.487671 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:21:44.487671 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:21:44.487671 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 16:21:44.487671 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 16:21:44.487671 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 16:21:44.487671 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 16:21:44.488697 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 16:21:44.488697 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 16:21:44.488697 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 16:21:44.488697 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 16:21:44.488697 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:21:44.488697 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:21:44.488697 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:21:44.488697 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:21:44.488697 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:21:44.488697 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:21:44.488697 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:21:44.488697 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Sep 09 16:21:44.488697 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:21:44.488697 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:21:44.488697 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:21:44.488697 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:21:44.489609 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:21:44.489609 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:21:44.489609 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:21:44.489609 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:21:44.489609 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 16:21:44.489609 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 16:21:44.489609 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 16:21:44.489609 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 16:21:44.489609 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 16:21:44.489609 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 16:21:44.489609 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 16:21:44.489609 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:21:44.489609 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 627/1235] 10.222.0.27 () {56 vars in 1102 bytes} [Fri Sep 9 16:21:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:21:44.495476 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaaa9b7-25d8-4596-97a5-9e2cffeb346b None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:21:44.548016 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:21:44.608314 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaaa9b7-25d8-4596-97a5-9e2cffeb346b None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:21:44.642949 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d8ba3a-46c9-4224-9622-af6115a9d361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:21:44.643567 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d8ba3a-46c9-4224-9622-af6115a9d361 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:21:44.643835 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d8ba3a-46c9-4224-9622-af6115a9d361 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:21:44.644096 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d8ba3a-46c9-4224-9622-af6115a9d361 None admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:21:44.644760 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d8ba3a-46c9-4224-9622-af6115a9d361 None admin] RBAC: Adding query filter params (name=service) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:21:44.645067 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d8ba3a-46c9-4224-9622-af6115a9d361 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:21:44.646425 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d8ba3a-46c9-4224-9622-af6115a9d361 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:21:44.654507 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 609/1236] 10.222.0.27 () {56 vars in 1103 bytes} [Fri Sep 9 16:21:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:21:44.661278 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29f9499-5bec-4936-8a86-4cda9de33ff7 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:21:44.753871 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:21:44.771545 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29f9499-5bec-4936-8a86-4cda9de33ff7 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:21:44.807801 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a192fbb-9f71-48b1-beb3-806ef5ae48f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:21:44.808368 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a192fbb-9f71-48b1-beb3-806ef5ae48f2 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:21:44.808647 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a192fbb-9f71-48b1-beb3-806ef5ae48f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:21:44.808912 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a192fbb-9f71-48b1-beb3-806ef5ae48f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:21:44.819731 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a192fbb-9f71-48b1-beb3-806ef5ae48f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:21:44.821172 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a192fbb-9f71-48b1-beb3-806ef5ae48f2 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:21:44.837620 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-3a192fbb-9f71-48b1-beb3-806ef5ae48f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 16:21:44.837620 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:21:44.837620 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:21:44.837620 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:21:44.837620 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:21:44.837620 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:21:44.837620 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:21:44.837620 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:21:44.837620 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:21:44.837620 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:21:44.837620 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:21:44.837620 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:21:44.837620 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 16:21:44.837620 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 16:21:44.837620 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 16:21:44.837620 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 16:21:44.838821 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:21:44.838821 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:21:44.838821 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:21:44.838821 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:21:44.838821 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:21:44.838821 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:21:44.838821 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:21:44.838821 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Sep 09 16:21:44.838821 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:21:44.838821 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:21:44.838821 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:21:44.838821 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:21:44.838821 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:21:44.838821 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:21:44.838821 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:21:44.838821 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:21:44.838821 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 16:21:44.839880 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 16:21:44.839880 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 16:21:44.839880 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:21:44.839880 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 628/1237] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 16:21:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 16:21:44.845558 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d8ba3a-46c9-4224-9622-af6115a9d361 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:21:44.953331 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d8ba3a-46c9-4224-9622-af6115a9d361 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:21:44.963027 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:21:44.991148 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d156cfa-552b-4efd-b9f1-df4ce3623056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:21:44.991750 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d156cfa-552b-4efd-b9f1-df4ce3623056 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:21:44.992029 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d156cfa-552b-4efd-b9f1-df4ce3623056 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:21:44.992301 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d156cfa-552b-4efd-b9f1-df4ce3623056 None admin] PATH_INFO: `/v3/domains` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:21:44.992927 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d156cfa-552b-4efd-b9f1-df4ce3623056 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:21:44.993225 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d156cfa-552b-4efd-b9f1-df4ce3623056 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:21:44.994669 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d156cfa-552b-4efd-b9f1-df4ce3623056 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:21:45.006985 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 610/1238] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Sep 9 16:21:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:21:45.012668 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a192fbb-9f71-48b1-beb3-806ef5ae48f2 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:21:45.126921 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a192fbb-9f71-48b1-beb3-806ef5ae48f2 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:21:45.160208 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0c39c4-2750-4717-b430-f059fa262c77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:21:45.160831 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0c39c4-2750-4717-b430-f059fa262c77 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:21:45.161192 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0c39c4-2750-4717-b430-f059fa262c77 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:21:45.161368 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0c39c4-2750-4717-b430-f059fa262c77 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:21:45.164245 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:21:45.169830 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0c39c4-2750-4717-b430-f059fa262c77 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:21:45.171729 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0c39c4-2750-4717-b430-f059fa262c77 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:21:45.183858 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-0e0c39c4-2750-4717-b430-f059fa262c77 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 09 16:21:45.183858 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:21:45.183858 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:21:45.183858 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:21:45.183858 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:21:45.183858 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:21:45.183858 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:21:45.183858 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:21:45.183858 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:21:45.183858 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:21:45.183858 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:21:45.183858 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:21:45.183858 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 16:21:45.183858 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 16:21:45.183858 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 16:21:45.183858 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 16:21:45.185031 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:21:45.185031 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:21:45.185031 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 16:21:45.185031 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 16:21:45.185031 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 16:21:45.185031 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 16:21:45.185031 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:21:45.185031 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:21:45.185031 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:21:45.185031 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:21:45.185031 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:21:45.185031 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Sep 09 16:21:45.185031 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:21:45.185031 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:21:45.185031 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:21:45.185031 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:21:45.185031 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:21:45.185031 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:21:45.186009 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:21:45.186009 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:21:45.186009 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 16:21:45.186009 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 16:21:45.186009 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 16:21:45.186009 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 16:21:45.186009 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 16:21:45.186009 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 16:21:45.186009 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 09 16:21:45.186009 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:21:45.186009 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 629/1239] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 16:21:45 2022] GET /identity/v3/users/placement => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:21:45.191169 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d156cfa-552b-4efd-b9f1-df4ce3623056 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:21:45.304192 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d156cfa-552b-4efd-b9f1-df4ce3623056 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:21:45.341427 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d09013-6411-4601-89f2-d684079520cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:21:45.342060 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d09013-6411-4601-89f2-d684079520cc None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:21:45.342375 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d09013-6411-4601-89f2-d684079520cc None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:21:45.342774 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d09013-6411-4601-89f2-d684079520cc None admin] PATH_INFO: `/v3/users` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:21:45.343507 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d09013-6411-4601-89f2-d684079520cc None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:21:45.343825 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d09013-6411-4601-89f2-d684079520cc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:21:45.345253 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d09013-6411-4601-89f2-d684079520cc None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:21:45.366843 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 611/1240] 10.222.0.27 () {56 vars in 1143 bytes} [Fri Sep 9 16:21:45 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 16:21:45.372960 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0c39c4-2750-4717-b430-f059fa262c77 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:21:45.484754 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0c39c4-2750-4717-b430-f059fa262c77 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:21:45.519869 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ccf5d8-e706-4e08-b3bf-2fe2ef95ed5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:21:45.520532 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ccf5d8-e706-4e08-b3bf-2fe2ef95ed5e None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:21:45.520854 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ccf5d8-e706-4e08-b3bf-2fe2ef95ed5e None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:21:45.521223 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ccf5d8-e706-4e08-b3bf-2fe2ef95ed5e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:21:45.587777 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:21:45.595146 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ccf5d8-e706-4e08-b3bf-2fe2ef95ed5e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:21:45.597247 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ccf5d8-e706-4e08-b3bf-2fe2ef95ed5e None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:21:45.705806 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 630/1241] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Sep 9 16:21:45 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 09 16:21:45.711947 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d09013-6411-4601-89f2-d684079520cc None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:21:45.742440 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:21:45.829213 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d09013-6411-4601-89f2-d684079520cc None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:21:45.868277 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c57efe-9fc0-40a9-b915-a0d886d076e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:21:45.870099 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c57efe-9fc0-40a9-b915-a0d886d076e9 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:21:45.870099 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c57efe-9fc0-40a9-b915-a0d886d076e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:21:45.870099 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c57efe-9fc0-40a9-b915-a0d886d076e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:21:45.883524 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c57efe-9fc0-40a9-b915-a0d886d076e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:21:45.885252 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c57efe-9fc0-40a9-b915-a0d886d076e9 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:21:45.902865 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-40c57efe-9fc0-40a9-b915-a0d886d076e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 16:21:45.902865 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:21:45.902865 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:21:45.902865 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:21:45.902865 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:21:45.902865 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:21:45.902865 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:21:45.902865 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:21:45.902865 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:21:45.902865 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:21:45.902865 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:21:45.902865 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:21:45.902865 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 16:21:45.902865 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 16:21:45.902865 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 16:21:45.902865 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 16:21:45.904060 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:21:45.904060 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:21:45.904060 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:21:45.904060 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:21:45.904060 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:21:45.904060 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:21:45.904060 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:21:45.904060 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 16:21:45.904060 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:21:45.904060 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:21:45.904060 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:21:45.904060 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:21:45.904060 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:21:45.904060 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:21:45.904060 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:21:45.904060 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:21:45.904060 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 16:21:45.905169 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 16:21:45.905169 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 16:21:45.905169 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 16:21:45.905169 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 612/1242] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 16:21:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:21:45.910397 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ccf5d8-e706-4e08-b3bf-2fe2ef95ed5e None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:21:46.012824 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:21:46.018943 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ccf5d8-e706-4e08-b3bf-2fe2ef95ed5e None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:21:46.053539 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d57ce56-eb4e-481f-b625-de83f0491545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:21:46.054143 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d57ce56-eb4e-481f-b625-de83f0491545 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:21:46.054444 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d57ce56-eb4e-481f-b625-de83f0491545 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:21:46.054800 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d57ce56-eb4e-481f-b625-de83f0491545 None admin] PATH_INFO: `/v3/domains` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:21:46.055343 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d57ce56-eb4e-481f-b625-de83f0491545 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:21:46.055640 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d57ce56-eb4e-481f-b625-de83f0491545 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:21:46.057048 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d57ce56-eb4e-481f-b625-de83f0491545 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:21:46.069653 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 631/1243] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Sep 9 16:21:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:21:46.075814 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c57efe-9fc0-40a9-b915-a0d886d076e9 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:21:46.160506 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:21:46.186283 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c57efe-9fc0-40a9-b915-a0d886d076e9 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:21:46.223719 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbefc912-c726-42cf-9a75-c1995763187d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:21:46.224987 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbefc912-c726-42cf-9a75-c1995763187d None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:21:46.225098 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbefc912-c726-42cf-9a75-c1995763187d None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:21:46.225343 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbefc912-c726-42cf-9a75-c1995763187d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:21:46.234059 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbefc912-c726-42cf-9a75-c1995763187d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:21:46.235782 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbefc912-c726-42cf-9a75-c1995763187d None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:21:46.249624 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-bbefc912-c726-42cf-9a75-c1995763187d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 16:21:46.249624 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:21:46.249624 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:21:46.249624 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:21:46.249624 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:21:46.249624 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:21:46.249624 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:21:46.249624 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:21:46.249624 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:21:46.249624 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:21:46.249624 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:21:46.249624 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:21:46.249624 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 16:21:46.249624 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 16:21:46.249624 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 16:21:46.250700 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 16:21:46.250700 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:21:46.250700 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:21:46.250700 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:21:46.250700 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:21:46.250700 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:21:46.250700 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:21:46.250700 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:21:46.250700 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 16:21:46.250700 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:21:46.250700 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:21:46.250700 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:21:46.250700 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:21:46.250700 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:21:46.250700 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:21:46.250700 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:21:46.250700 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:21:46.251597 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 16:21:46.251597 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 16:21:46.251597 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 16:21:46.251597 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 16:21:46.251597 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 16:21:46.251597 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 16:21:46.251597 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 16:21:46.251597 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 16:21:46.251597 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 613/1244] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Sep 9 16:21:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 16:21:46.257603 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d57ce56-eb4e-481f-b625-de83f0491545 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:21:46.365416 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d57ce56-eb4e-481f-b625-de83f0491545 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:21:46.400298 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263f9a32-f010-4cfb-9de0-9a629ed21f78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:21:46.400994 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263f9a32-f010-4cfb-9de0-9a629ed21f78 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:21:46.401338 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263f9a32-f010-4cfb-9de0-9a629ed21f78 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:21:46.401675 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263f9a32-f010-4cfb-9de0-9a629ed21f78 None admin] PATH_INFO: `/v3/projects` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:21:46.402459 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263f9a32-f010-4cfb-9de0-9a629ed21f78 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:21:46.402732 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263f9a32-f010-4cfb-9de0-9a629ed21f78 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:21:46.404161 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263f9a32-f010-4cfb-9de0-9a629ed21f78 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:21:46.417346 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 632/1245] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Sep 9 16:21:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:21:46.423767 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbefc912-c726-42cf-9a75-c1995763187d None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:21:46.537768 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbefc912-c726-42cf-9a75-c1995763187d None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:21:46.578195 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389be40c-ac22-4b11-ba8e-c52e4a3ea49b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:21:46.578958 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389be40c-ac22-4b11-ba8e-c52e4a3ea49b None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:21:46.579246 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389be40c-ac22-4b11-ba8e-c52e4a3ea49b None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:21:46.579517 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389be40c-ac22-4b11-ba8e-c52e4a3ea49b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:21:46.581232 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389be40c-ac22-4b11-ba8e-c52e4a3ea49b None admin] RBAC: Adding query filter params (role.id=1966594501e743aebf757851d9cd82a5, scope.project.id=68d6aaafab824657b08ca91f3d46d5f8, user.id=2d73df92393c43b2b5ccc32a2d43d952) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:21:46.581746 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389be40c-ac22-4b11-ba8e-c52e4a3ea49b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:21:46.584073 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389be40c-ac22-4b11-ba8e-c52e4a3ea49b None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:21:46.591939 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 614/1246] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Sep 9 16:21:46 2022] GET /identity/v3/role_assignments?user.id=2d73df92393c43b2b5ccc32a2d43d952&scope.project.id=68d6aaafab824657b08ca91f3d46d5f8&role.id=1966594501e743aebf757851d9cd82a5 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:21:48.818033 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818d5c9e-18e6-4458-a8b1-a1096065bd41 None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:21:48.818677 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818d5c9e-18e6-4458-a8b1-a1096065bd41 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:21:48.818759 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818d5c9e-18e6-4458-a8b1-a1096065bd41 None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:21:48.820507 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 633/1247] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:21:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:21:48.825593 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bff553-26d3-4ecd-8a4b-a1fe012989ad None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:21:48.826098 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bff553-26d3-4ecd-8a4b-a1fe012989ad None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:21:48.826098 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bff553-26d3-4ecd-8a4b-a1fe012989ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:21:48.832456 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:21:48.845099 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-83bff553-26d3-4ecd-8a4b-a1fe012989ad None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:21:48.846900 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-83bff553-26d3-4ecd-8a4b-a1fe012989ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:21:48.924715 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 615/1248] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:21:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 16:21:49.221200 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818d5c9e-18e6-4458-a8b1-a1096065bd41 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:21:49.242168 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:21:49.346326 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818d5c9e-18e6-4458-a8b1-a1096065bd41 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:21:49.386774 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5365238e-dcb1-410d-8860-c1da7f269aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:21:49.387376 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5365238e-dcb1-410d-8860-c1da7f269aec None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:21:49.387652 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5365238e-dcb1-410d-8860-c1da7f269aec None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:21:49.387921 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5365238e-dcb1-410d-8860-c1da7f269aec None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:21:49.398376 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5365238e-dcb1-410d-8860-c1da7f269aec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 16:21:49.403181 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-5365238e-dcb1-410d-8860-c1da7f269aec None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 16:21:49.403181 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:21:49.403181 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:21:49.403181 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:21:49.403181 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:21:49.403181 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:21:49.403181 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:21:49.403181 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:21:49.403181 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:21:49.403181 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:21:49.403181 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:21:49.403181 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:21:49.403181 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 16:21:49.403181 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 16:21:49.403181 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 16:21:49.403181 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 16:21:49.404632 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 16:21:49.404632 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 16:21:49.404632 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 16:21:49.404632 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 16:21:49.404632 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:21:49.404632 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:21:49.404632 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:21:49.404632 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:21:49.404632 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:21:49.404632 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:21:49.404632 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:21:49.404632 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Sep 09 16:21:49.404632 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:21:49.404632 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:21:49.404632 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:21:49.404632 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:21:49.405835 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:21:49.405835 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:21:49.405835 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:21:49.405835 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:21:49.405835 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 16:21:49.405835 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 16:21:49.405835 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 16:21:49.405835 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 16:21:49.405835 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 16:21:49.405835 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 16:21:49.405835 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 16:21:49.405835 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:21:49.405835 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 634/1249] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Sep 9 16:21:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:21:49.410972 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bff553-26d3-4ecd-8a4b-a1fe012989ad None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:21:49.523128 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bff553-26d3-4ecd-8a4b-a1fe012989ad None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:21:49.562479 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:21:49.568860 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13896a0d-bb19-40f8-b886-f92df296a3d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:21:49.569752 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13896a0d-bb19-40f8-b886-f92df296a3d9 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:21:49.570034 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13896a0d-bb19-40f8-b886-f92df296a3d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:21:49.570319 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13896a0d-bb19-40f8-b886-f92df296a3d9 None admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:21:49.571148 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13896a0d-bb19-40f8-b886-f92df296a3d9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:21:49.571499 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13896a0d-bb19-40f8-b886-f92df296a3d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:21:49.573080 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13896a0d-bb19-40f8-b886-f92df296a3d9 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:21:49.583188 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 616/1250] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Sep 9 16:21:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:21:49.589111 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5365238e-dcb1-410d-8860-c1da7f269aec None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:21:49.674474 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:21:49.700147 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5365238e-dcb1-410d-8860-c1da7f269aec None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:21:49.736999 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df382ed2-4cfa-442a-badb-cdde6fb54fd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:21:49.737646 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df382ed2-4cfa-442a-badb-cdde6fb54fd9 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:21:49.737905 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df382ed2-4cfa-442a-badb-cdde6fb54fd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:21:49.738169 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df382ed2-4cfa-442a-badb-cdde6fb54fd9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:21:49.749262 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df382ed2-4cfa-442a-badb-cdde6fb54fd9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:21:49.750729 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df382ed2-4cfa-442a-badb-cdde6fb54fd9 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:21:49.769600 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-df382ed2-4cfa-442a-badb-cdde6fb54fd9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 16:21:49.769600 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:21:49.769600 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:21:49.769600 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:21:49.769600 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:21:49.769600 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:21:49.769600 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:21:49.769600 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:21:49.769600 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:21:49.769600 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:21:49.769600 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:21:49.769600 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:21:49.769600 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 16:21:49.769600 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 16:21:49.769600 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 16:21:49.769600 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 16:21:49.770628 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:21:49.770628 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:21:49.770628 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:21:49.770628 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:21:49.770628 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:21:49.770628 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:21:49.770628 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:21:49.770628 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Sep 09 16:21:49.770628 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:21:49.770628 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:21:49.770628 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:21:49.770628 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:21:49.770628 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:21:49.770628 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:21:49.770628 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:21:49.770628 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:21:49.770628 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 16:21:49.771761 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 16:21:49.771761 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 16:21:49.771761 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:21:49.771761 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 635/1251] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 16:21:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 16:21:49.776930 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13896a0d-bb19-40f8-b886-f92df296a3d9 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:21:49.885468 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13896a0d-bb19-40f8-b886-f92df296a3d9 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:21:49.924304 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64d2941-5004-42ae-9075-bc46000d6820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:21:49.925455 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64d2941-5004-42ae-9075-bc46000d6820 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:21:49.925979 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64d2941-5004-42ae-9075-bc46000d6820 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:21:49.926500 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64d2941-5004-42ae-9075-bc46000d6820 None admin] PATH_INFO: `/v3/domains` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:21:49.927749 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64d2941-5004-42ae-9075-bc46000d6820 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:21:49.928384 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64d2941-5004-42ae-9075-bc46000d6820 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:21:49.930989 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64d2941-5004-42ae-9075-bc46000d6820 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:21:49.951213 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 617/1252] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Sep 9 16:21:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:21:49.952613 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df382ed2-4cfa-442a-badb-cdde6fb54fd9 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:21:50.064197 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df382ed2-4cfa-442a-badb-cdde6fb54fd9 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:21:50.092463 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:21:50.100650 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d58de51-a0f9-4245-a8aa-77dd9e1c42ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:21:50.101294 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d58de51-a0f9-4245-a8aa-77dd9e1c42ab None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:21:50.101570 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d58de51-a0f9-4245-a8aa-77dd9e1c42ab None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:21:50.101842 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d58de51-a0f9-4245-a8aa-77dd9e1c42ab None admin] PATH_INFO: `/v3/users/placement` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:21:50.110042 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d58de51-a0f9-4245-a8aa-77dd9e1c42ab None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:21:50.112067 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d58de51-a0f9-4245-a8aa-77dd9e1c42ab None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:21:50.124155 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-0d58de51-a0f9-4245-a8aa-77dd9e1c42ab None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 09 16:21:50.124155 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:21:50.124155 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:21:50.124155 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:21:50.124155 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:21:50.124155 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:21:50.124155 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:21:50.124155 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:21:50.124155 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:21:50.124155 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:21:50.124155 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:21:50.124155 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:21:50.124155 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 16:21:50.124155 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 16:21:50.124155 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 16:21:50.124155 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 16:21:50.125384 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:21:50.125384 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:21:50.125384 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 16:21:50.125384 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 16:21:50.125384 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 16:21:50.125384 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 16:21:50.125384 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:21:50.125384 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:21:50.125384 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:21:50.125384 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:21:50.125384 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:21:50.125384 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Sep 09 16:21:50.125384 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:21:50.125384 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:21:50.125384 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:21:50.125384 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:21:50.125384 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:21:50.125384 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:21:50.127491 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:21:50.127491 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:21:50.127491 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 16:21:50.127491 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 16:21:50.127491 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 16:21:50.127491 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 16:21:50.127491 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 16:21:50.127491 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 16:21:50.127491 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 09 16:21:50.127491 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:21:50.127491 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 636/1253] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 16:21:49 2022] GET /identity/v3/users/placement => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:21:50.132016 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64d2941-5004-42ae-9075-bc46000d6820 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:21:50.190103 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:21:50.237722 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64d2941-5004-42ae-9075-bc46000d6820 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:21:50.272918 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9da5b84-6f4f-4f7e-9275-2609456e88d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:21:50.273541 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9da5b84-6f4f-4f7e-9275-2609456e88d7 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:21:50.273816 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9da5b84-6f4f-4f7e-9275-2609456e88d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:21:50.274083 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9da5b84-6f4f-4f7e-9275-2609456e88d7 None admin] PATH_INFO: `/v3/users` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:21:50.274856 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9da5b84-6f4f-4f7e-9275-2609456e88d7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:21:50.275155 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9da5b84-6f4f-4f7e-9275-2609456e88d7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:21:50.276623 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9da5b84-6f4f-4f7e-9275-2609456e88d7 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:21:50.297491 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 618/1254] 10.222.0.27 () {56 vars in 1143 bytes} [Fri Sep 9 16:21:50 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:21:50.304024 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d58de51-a0f9-4245-a8aa-77dd9e1c42ab None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:21:50.406177 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d58de51-a0f9-4245-a8aa-77dd9e1c42ab None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:21:50.440502 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ef2e7d-f204-4766-8161-7726f2d04204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:21:50.441104 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ef2e7d-f204-4766-8161-7726f2d04204 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:21:50.441381 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ef2e7d-f204-4766-8161-7726f2d04204 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:21:50.441649 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ef2e7d-f204-4766-8161-7726f2d04204 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:21:50.496147 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:21:50.508527 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ef2e7d-f204-4766-8161-7726f2d04204 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:21:50.509965 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ef2e7d-f204-4766-8161-7726f2d04204 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:21:50.621584 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 637/1255] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Sep 9 16:21:50 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 09 16:21:50.627430 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9da5b84-6f4f-4f7e-9275-2609456e88d7 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:21:50.723918 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9da5b84-6f4f-4f7e-9275-2609456e88d7 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:21:50.740245 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:21:50.771088 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc9f667-b168-4682-87e6-3daaa6648d46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:21:50.771977 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc9f667-b168-4682-87e6-3daaa6648d46 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:21:50.772110 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc9f667-b168-4682-87e6-3daaa6648d46 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:21:50.772532 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc9f667-b168-4682-87e6-3daaa6648d46 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:21:50.782948 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc9f667-b168-4682-87e6-3daaa6648d46 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:21:50.784972 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc9f667-b168-4682-87e6-3daaa6648d46 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:21:50.799058 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-7bc9f667-b168-4682-87e6-3daaa6648d46 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 16:21:50.799058 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:21:50.799058 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:21:50.799058 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:21:50.799058 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:21:50.799058 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:21:50.799058 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:21:50.799058 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:21:50.799058 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:21:50.799058 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:21:50.799058 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:21:50.799058 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:21:50.799058 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 16:21:50.799058 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 16:21:50.799058 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 16:21:50.799058 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 16:21:50.800178 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:21:50.800178 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:21:50.800178 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:21:50.800178 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:21:50.800178 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:21:50.800178 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:21:50.800178 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:21:50.800178 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 16:21:50.800178 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:21:50.800178 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:21:50.800178 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:21:50.800178 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:21:50.800178 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:21:50.800178 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:21:50.800178 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:21:50.800178 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:21:50.800178 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 16:21:50.801502 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 16:21:50.801502 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 16:21:50.801502 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 16:21:50.801502 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 619/1256] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 16:21:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:21:50.805837 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ef2e7d-f204-4766-8161-7726f2d04204 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:21:50.889601 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:21:50.905682 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ef2e7d-f204-4766-8161-7726f2d04204 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:21:50.940643 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3241f5-057d-4cb6-b8b4-6373a190dcec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:21:50.941237 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3241f5-057d-4cb6-b8b4-6373a190dcec None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:21:50.941517 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3241f5-057d-4cb6-b8b4-6373a190dcec None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:21:50.941788 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3241f5-057d-4cb6-b8b4-6373a190dcec None admin] PATH_INFO: `/v3/domains` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:21:50.942442 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3241f5-057d-4cb6-b8b4-6373a190dcec None admin] RBAC: Adding query filter params (name=Default) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:21:50.942744 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3241f5-057d-4cb6-b8b4-6373a190dcec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:21:50.944104 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3241f5-057d-4cb6-b8b4-6373a190dcec None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:21:50.955548 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 638/1257] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Sep 9 16:21:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:21:50.961194 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc9f667-b168-4682-87e6-3daaa6648d46 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:21:51.056794 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc9f667-b168-4682-87e6-3daaa6648d46 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:21:51.089489 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6d820a-a900-479e-971a-3e679f9c3bef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:21:51.090098 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6d820a-a900-479e-971a-3e679f9c3bef None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:21:51.090405 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6d820a-a900-479e-971a-3e679f9c3bef None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:21:51.090679 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6d820a-a900-479e-971a-3e679f9c3bef None admin] PATH_INFO: `/v3/projects/service` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:21:51.097136 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6d820a-a900-479e-971a-3e679f9c3bef None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:21:51.098607 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6d820a-a900-479e-971a-3e679f9c3bef None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:21:51.110342 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-fd6d820a-a900-479e-971a-3e679f9c3bef None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 16:21:51.110342 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:21:51.110342 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:21:51.110342 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:21:51.110342 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:21:51.110342 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:21:51.110342 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:21:51.110342 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:21:51.110342 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:21:51.110342 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:21:51.110342 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:21:51.110342 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:21:51.110342 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 16:21:51.110342 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 16:21:51.110342 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 16:21:51.111358 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 16:21:51.111358 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:21:51.111358 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:21:51.111358 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:21:51.111358 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:21:51.111358 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:21:51.111358 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:21:51.111358 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:21:51.111358 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 16:21:51.111358 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:21:51.111358 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:21:51.111358 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:21:51.111358 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:21:51.111358 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:21:51.111358 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:21:51.111358 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:21:51.111358 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:21:51.112437 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 16:21:51.112437 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 16:21:51.112437 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 16:21:51.112437 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 16:21:51.112437 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 16:21:51.112437 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 16:21:51.112437 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 16:21:51.112437 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 16:21:51.112437 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 620/1258] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Sep 9 16:21:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:21:51.117124 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3241f5-057d-4cb6-b8b4-6373a190dcec None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:21:51.213344 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3241f5-057d-4cb6-b8b4-6373a190dcec None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:21:51.245031 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b435e6-dbda-476d-81db-a153304e3db3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:21:51.245607 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b435e6-dbda-476d-81db-a153304e3db3 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:21:51.245878 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b435e6-dbda-476d-81db-a153304e3db3 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:21:51.246142 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b435e6-dbda-476d-81db-a153304e3db3 None admin] PATH_INFO: `/v3/projects` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:21:51.246847 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b435e6-dbda-476d-81db-a153304e3db3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:21:51.247144 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b435e6-dbda-476d-81db-a153304e3db3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:21:51.248541 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b435e6-dbda-476d-81db-a153304e3db3 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:21:51.260891 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 639/1259] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Sep 9 16:21:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:21:51.267035 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6d820a-a900-479e-971a-3e679f9c3bef None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:21:51.293433 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:21:51.366024 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6d820a-a900-479e-971a-3e679f9c3bef None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:21:51.398463 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78754fe-733a-4e47-97a8-f42c66c4e485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:21:51.399053 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78754fe-733a-4e47-97a8-f42c66c4e485 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:21:51.399333 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78754fe-733a-4e47-97a8-f42c66c4e485 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:21:51.399600 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78754fe-733a-4e47-97a8-f42c66c4e485 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:21:51.400314 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78754fe-733a-4e47-97a8-f42c66c4e485 None admin] RBAC: Adding query filter params (role.id=0a36d1be416f4089be19be979943b731, scope.project.id=68d6aaafab824657b08ca91f3d46d5f8, user.id=2d73df92393c43b2b5ccc32a2d43d952) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:21:51.400617 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78754fe-733a-4e47-97a8-f42c66c4e485 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:21:51.402042 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78754fe-733a-4e47-97a8-f42c66c4e485 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:21:51.407261 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 621/1260] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Sep 9 16:21:51 2022] GET /identity/v3/role_assignments?user.id=2d73df92393c43b2b5ccc32a2d43d952&scope.project.id=68d6aaafab824657b08ca91f3d46d5f8&role.id=0a36d1be416f4089be19be979943b731 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:21:53.516093 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aff534-d145-44e8-81d2-959268341d18 None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:21:53.516606 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aff534-d145-44e8-81d2-959268341d18 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:21:53.516693 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aff534-d145-44e8-81d2-959268341d18 None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:21:53.517991 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 640/1261] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:21:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:21:53.522998 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc082427-531b-4f93-812e-520820f458ae None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:21:53.523420 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc082427-531b-4f93-812e-520820f458ae None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:21:53.523529 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc082427-531b-4f93-812e-520820f458ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:21:53.541225 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-fc082427-531b-4f93-812e-520820f458ae None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:21:53.542350 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-fc082427-531b-4f93-812e-520820f458ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:21:53.607411 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 622/1262] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:21:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 16:21:53.872775 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aff534-d145-44e8-81d2-959268341d18 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:21:53.884163 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:21:53.972568 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aff534-d145-44e8-81d2-959268341d18 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:21:54.005368 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43436fd2-f55b-4247-876c-da56de083cbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:21:54.005977 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43436fd2-f55b-4247-876c-da56de083cbc None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:21:54.006254 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43436fd2-f55b-4247-876c-da56de083cbc None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:21:54.006551 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43436fd2-f55b-4247-876c-da56de083cbc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:21:54.016209 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43436fd2-f55b-4247-876c-da56de083cbc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 16:21:54.020988 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-43436fd2-f55b-4247-876c-da56de083cbc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 16:21:54.020988 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:21:54.020988 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:21:54.020988 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:21:54.020988 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:21:54.020988 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:21:54.020988 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:21:54.020988 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:21:54.020988 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:21:54.020988 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:21:54.020988 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:21:54.020988 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:21:54.020988 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 16:21:54.020988 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 16:21:54.020988 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 16:21:54.020988 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 16:21:54.022037 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 16:21:54.022037 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 16:21:54.022037 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 16:21:54.022037 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 16:21:54.022037 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:21:54.022037 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:21:54.022037 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:21:54.022037 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:21:54.022037 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:21:54.022037 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:21:54.022037 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:21:54.022037 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Sep 09 16:21:54.022037 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:21:54.022037 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:21:54.022037 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:21:54.022037 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:21:54.023313 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:21:54.023313 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:21:54.023313 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:21:54.023313 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:21:54.023313 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 16:21:54.023313 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 16:21:54.023313 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 16:21:54.023313 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 16:21:54.023313 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 16:21:54.023313 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 16:21:54.023313 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 16:21:54.023313 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:21:54.023313 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 641/1263] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Sep 9 16:21:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:21:54.027872 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc082427-531b-4f93-812e-520820f458ae None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:21:54.045856 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:21:54.123651 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc082427-531b-4f93-812e-520820f458ae None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:21:54.155102 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42489406-3ea2-4006-a811-49161eea1090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:21:54.155690 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42489406-3ea2-4006-a811-49161eea1090 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:21:54.155966 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42489406-3ea2-4006-a811-49161eea1090 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:21:54.156235 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42489406-3ea2-4006-a811-49161eea1090 None admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:21:54.156875 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42489406-3ea2-4006-a811-49161eea1090 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:21:54.157172 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42489406-3ea2-4006-a811-49161eea1090 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:21:54.159056 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42489406-3ea2-4006-a811-49161eea1090 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:21:54.166675 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 623/1264] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Sep 9 16:21:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:21:54.172234 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43436fd2-f55b-4247-876c-da56de083cbc None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:21:54.237688 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:21:54.274702 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43436fd2-f55b-4247-876c-da56de083cbc None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:21:54.307645 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9159e59-7d71-4326-9518-97e794207c4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:21:54.308262 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9159e59-7d71-4326-9518-97e794207c4c None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:21:54.308535 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9159e59-7d71-4326-9518-97e794207c4c None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:21:54.308799 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9159e59-7d71-4326-9518-97e794207c4c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:21:54.318995 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9159e59-7d71-4326-9518-97e794207c4c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:21:54.320415 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9159e59-7d71-4326-9518-97e794207c4c None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:21:54.334248 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-e9159e59-7d71-4326-9518-97e794207c4c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 16:21:54.334248 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:21:54.334248 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:21:54.334248 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:21:54.334248 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:21:54.334248 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:21:54.334248 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:21:54.334248 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:21:54.334248 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:21:54.334248 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:21:54.334248 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:21:54.334248 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:21:54.334248 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 16:21:54.334248 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 16:21:54.334248 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 16:21:54.334248 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 16:21:54.335451 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:21:54.335451 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:21:54.335451 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:21:54.335451 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:21:54.335451 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:21:54.335451 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:21:54.335451 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:21:54.335451 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Sep 09 16:21:54.335451 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:21:54.335451 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:21:54.335451 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:21:54.335451 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:21:54.335451 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:21:54.335451 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:21:54.335451 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:21:54.335451 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:21:54.335451 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 16:21:54.336339 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 16:21:54.336339 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 16:21:54.336339 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:21:54.336339 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 642/1265] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 16:21:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:21:54.341015 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42489406-3ea2-4006-a811-49161eea1090 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:21:54.419085 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:21:54.437667 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42489406-3ea2-4006-a811-49161eea1090 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:21:54.469910 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8b1dfe-d107-4525-a1b4-075a03601338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:21:54.471123 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8b1dfe-d107-4525-a1b4-075a03601338 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:21:54.471401 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8b1dfe-d107-4525-a1b4-075a03601338 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:21:54.471667 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8b1dfe-d107-4525-a1b4-075a03601338 None admin] PATH_INFO: `/v3/domains` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:21:54.472288 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8b1dfe-d107-4525-a1b4-075a03601338 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:21:54.472584 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8b1dfe-d107-4525-a1b4-075a03601338 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:21:54.473941 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8b1dfe-d107-4525-a1b4-075a03601338 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:21:54.485078 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 624/1266] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Sep 9 16:21:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:21:54.490803 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9159e59-7d71-4326-9518-97e794207c4c None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:21:54.594127 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9159e59-7d71-4326-9518-97e794207c4c None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:21:54.613524 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:21:54.627598 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58a943d-6ec0-4385-89f4-b8fa02bf9a07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:21:54.628208 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58a943d-6ec0-4385-89f4-b8fa02bf9a07 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:21:54.628482 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58a943d-6ec0-4385-89f4-b8fa02bf9a07 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:21:54.628744 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58a943d-6ec0-4385-89f4-b8fa02bf9a07 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:21:54.635803 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58a943d-6ec0-4385-89f4-b8fa02bf9a07 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:21:54.637226 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58a943d-6ec0-4385-89f4-b8fa02bf9a07 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:21:54.648427 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-a58a943d-6ec0-4385-89f4-b8fa02bf9a07 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 09 16:21:54.648427 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:21:54.648427 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:21:54.648427 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:21:54.648427 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:21:54.648427 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:21:54.648427 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:21:54.648427 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:21:54.648427 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:21:54.648427 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:21:54.648427 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:21:54.648427 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:21:54.648427 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 16:21:54.648427 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 16:21:54.648427 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 16:21:54.648427 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 16:21:54.649516 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:21:54.649516 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:21:54.649516 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 16:21:54.649516 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 16:21:54.649516 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 16:21:54.649516 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 16:21:54.649516 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:21:54.649516 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:21:54.649516 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:21:54.649516 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:21:54.649516 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:21:54.649516 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Sep 09 16:21:54.649516 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:21:54.649516 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:21:54.649516 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:21:54.649516 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:21:54.649516 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:21:54.649516 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:21:54.650725 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:21:54.650725 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:21:54.650725 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 16:21:54.650725 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 16:21:54.650725 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 16:21:54.650725 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 16:21:54.650725 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 16:21:54.650725 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 16:21:54.650725 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 09 16:21:54.650725 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:21:54.650725 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 643/1267] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 16:21:54 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:21:54.655478 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8b1dfe-d107-4525-a1b4-075a03601338 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:21:54.754695 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8b1dfe-d107-4525-a1b4-075a03601338 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:21:54.788567 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd64bb5f-b17d-4ad5-9333-eed434c9900a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:21:54.789158 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd64bb5f-b17d-4ad5-9333-eed434c9900a None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:21:54.789433 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd64bb5f-b17d-4ad5-9333-eed434c9900a None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:21:54.789697 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd64bb5f-b17d-4ad5-9333-eed434c9900a None admin] PATH_INFO: `/v3/users` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:21:54.790429 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd64bb5f-b17d-4ad5-9333-eed434c9900a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:21:54.790728 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd64bb5f-b17d-4ad5-9333-eed434c9900a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:21:54.792146 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd64bb5f-b17d-4ad5-9333-eed434c9900a None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:21:54.800434 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:21:54.809391 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 625/1268] 10.222.0.27 () {56 vars in 1143 bytes} [Fri Sep 9 16:21:54 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:21:54.815922 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58a943d-6ec0-4385-89f4-b8fa02bf9a07 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:21:54.913869 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58a943d-6ec0-4385-89f4-b8fa02bf9a07 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:21:54.946533 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae33cb5d-a0de-4b9e-9232-2ad62b79f0fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:21:54.947148 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae33cb5d-a0de-4b9e-9232-2ad62b79f0fe None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:21:54.947425 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae33cb5d-a0de-4b9e-9232-2ad62b79f0fe None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:21:54.947691 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae33cb5d-a0de-4b9e-9232-2ad62b79f0fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:21:54.958426 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae33cb5d-a0de-4b9e-9232-2ad62b79f0fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:21:54.959851 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae33cb5d-a0de-4b9e-9232-2ad62b79f0fe None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:21:54.973356 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-ae33cb5d-a0de-4b9e-9232-2ad62b79f0fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 16:21:54.973356 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:21:54.973356 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:21:54.973356 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:21:54.973356 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:21:54.973356 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:21:54.973356 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:21:54.973356 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:21:54.973356 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:21:54.973356 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:21:54.973356 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:21:54.973356 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:21:54.973356 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 16:21:54.973356 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 16:21:54.973356 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 16:21:54.973356 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 16:21:54.979022 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:21:54.979022 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:21:54.979022 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:21:54.979022 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:21:54.979022 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:21:54.979022 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:21:54.979022 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:21:54.979022 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Sep 09 16:21:54.979022 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:21:54.979022 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:21:54.979022 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:21:54.979022 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:21:54.979022 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:21:54.979022 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:21:54.979022 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:21:54.979022 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:21:54.979022 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 16:21:54.980034 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 16:21:54.980034 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 16:21:54.980034 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:21:54.980034 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 644/1269] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 16:21:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:21:54.980289 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd64bb5f-b17d-4ad5-9333-eed434c9900a None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:21:55.076277 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd64bb5f-b17d-4ad5-9333-eed434c9900a None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:21:55.108290 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f865eedb-0d38-467c-818a-ec23a5c6ffa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:21:55.108872 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f865eedb-0d38-467c-818a-ec23a5c6ffa7 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:21:55.109149 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f865eedb-0d38-467c-818a-ec23a5c6ffa7 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:21:55.109418 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f865eedb-0d38-467c-818a-ec23a5c6ffa7 None admin] PATH_INFO: `/v3/domains` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:21:55.110039 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f865eedb-0d38-467c-818a-ec23a5c6ffa7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:21:55.110362 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f865eedb-0d38-467c-818a-ec23a5c6ffa7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:21:55.112232 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f865eedb-0d38-467c-818a-ec23a5c6ffa7 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:21:55.122995 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 626/1270] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Sep 9 16:21:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:21:55.129071 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae33cb5d-a0de-4b9e-9232-2ad62b79f0fe None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:21:55.159232 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:21:55.224993 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae33cb5d-a0de-4b9e-9232-2ad62b79f0fe None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:21:55.257538 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63458cc-041e-4d0d-b347-6f5ffc1baa7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:21:55.258137 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63458cc-041e-4d0d-b347-6f5ffc1baa7d None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:21:55.258443 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63458cc-041e-4d0d-b347-6f5ffc1baa7d None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:21:55.258712 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63458cc-041e-4d0d-b347-6f5ffc1baa7d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:21:55.265058 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63458cc-041e-4d0d-b347-6f5ffc1baa7d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:21:55.266510 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63458cc-041e-4d0d-b347-6f5ffc1baa7d None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:21:55.279742 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-f63458cc-041e-4d0d-b347-6f5ffc1baa7d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 16:21:55.279742 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:21:55.279742 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:21:55.279742 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:21:55.279742 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:21:55.279742 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:21:55.279742 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:21:55.279742 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:21:55.279742 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:21:55.279742 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:21:55.279742 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:21:55.279742 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:21:55.279742 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 16:21:55.279742 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 16:21:55.279742 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 16:21:55.280627 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 16:21:55.280627 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:21:55.280627 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:21:55.280627 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:21:55.280627 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:21:55.280627 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:21:55.280627 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:21:55.280627 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:21:55.280627 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Sep 09 16:21:55.280627 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:21:55.280627 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:21:55.280627 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:21:55.280627 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:21:55.280627 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:21:55.280627 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:21:55.280627 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:21:55.280627 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:21:55.281524 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 16:21:55.281524 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 16:21:55.281524 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 16:21:55.281524 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 16:21:55.281524 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 16:21:55.281524 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 16:21:55.281524 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 16:21:55.281524 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:21:55.282502 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 645/1271] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Sep 9 16:21:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:21:55.287157 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f865eedb-0d38-467c-818a-ec23a5c6ffa7 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:21:55.343106 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:21:55.383900 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f865eedb-0d38-467c-818a-ec23a5c6ffa7 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:21:55.416135 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f205f8d-9e2a-4bd3-8336-221d284e42ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:21:55.416725 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f205f8d-9e2a-4bd3-8336-221d284e42ca None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:21:55.417000 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f205f8d-9e2a-4bd3-8336-221d284e42ca None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:21:55.417269 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f205f8d-9e2a-4bd3-8336-221d284e42ca None admin] PATH_INFO: `/v3/projects` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:21:55.417941 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f205f8d-9e2a-4bd3-8336-221d284e42ca None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:21:55.418240 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f205f8d-9e2a-4bd3-8336-221d284e42ca None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:21:55.419718 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f205f8d-9e2a-4bd3-8336-221d284e42ca None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:21:55.431080 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 627/1272] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Sep 9 16:21:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:21:55.436904 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63458cc-041e-4d0d-b347-6f5ffc1baa7d None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:21:55.525961 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:21:55.534869 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63458cc-041e-4d0d-b347-6f5ffc1baa7d None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:21:55.566684 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bec31ea-651e-415b-b2bd-9e6c017d3c13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:21:55.567312 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bec31ea-651e-415b-b2bd-9e6c017d3c13 None admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:21:55.567586 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bec31ea-651e-415b-b2bd-9e6c017d3c13 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:21:55.567852 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bec31ea-651e-415b-b2bd-9e6c017d3c13 None admin] PATH_INFO: `/v3/projects/68d6aaafab824657b08ca91f3d46d5f8/users/2d73df92393c43b2b5ccc32a2d43d952/roles/0a36d1be416f4089be19be979943b731` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:21:55.569756 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bec31ea-651e-415b-b2bd-9e6c017d3c13 None admin] RBAC: Authorizing `identity:create_grant(project_id=68d6aaafab824657b08ca91f3d46d5f8, user_id=2d73df92393c43b2b5ccc32a2d43d952, role_id=0a36d1be416f4089be19be979943b731)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:21:55.571191 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bec31ea-651e-415b-b2bd-9e6c017d3c13 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:21:55.584362 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 646/1273] 10.222.0.27 () {58 vars in 1439 bytes} [Fri Sep 9 16:21:55 2022] PUT /identity/v3/projects/68d6aaafab824657b08ca91f3d46d5f8/users/2d73df92393c43b2b5ccc32a2d43d952/roles/0a36d1be416f4089be19be979943b731 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:21:57.699169 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a4aca3-69df-43e8-bf0e-c9daa9d1528e None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:21:57.699779 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a4aca3-69df-43e8-bf0e-c9daa9d1528e None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:21:57.699779 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a4aca3-69df-43e8-bf0e-c9daa9d1528e None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:21:57.701034 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 628/1274] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:21:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:21:57.706356 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ca3b3d-8ea9-4d90-bcf7-a98f4b945a0d None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:21:57.706746 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ca3b3d-8ea9-4d90-bcf7-a98f4b945a0d None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:21:57.706895 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ca3b3d-8ea9-4d90-bcf7-a98f4b945a0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:21:57.724940 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-09ca3b3d-8ea9-4d90-bcf7-a98f4b945a0d None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:21:57.726111 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-09ca3b3d-8ea9-4d90-bcf7-a98f4b945a0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:21:57.796883 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 647/1275] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:21:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 16:21:58.066820 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a4aca3-69df-43e8-bf0e-c9daa9d1528e None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:21:58.163556 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a4aca3-69df-43e8-bf0e-c9daa9d1528e None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:21:58.180119 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:21:58.196542 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3455246c-12a7-4909-acd6-02ea390ba77a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:21:58.197185 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3455246c-12a7-4909-acd6-02ea390ba77a None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:21:58.197461 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3455246c-12a7-4909-acd6-02ea390ba77a None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:21:58.197729 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3455246c-12a7-4909-acd6-02ea390ba77a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:21:58.207889 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3455246c-12a7-4909-acd6-02ea390ba77a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 16:21:58.212583 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-3455246c-12a7-4909-acd6-02ea390ba77a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 16:21:58.212583 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:21:58.212583 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:21:58.212583 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:21:58.212583 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:21:58.212583 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:21:58.212583 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:21:58.212583 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:21:58.212583 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:21:58.212583 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:21:58.212583 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:21:58.212583 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:21:58.212583 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 16:21:58.212583 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 16:21:58.212583 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 16:21:58.212583 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 16:21:58.213671 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 16:21:58.213671 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 16:21:58.213671 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 16:21:58.213671 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 16:21:58.213671 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:21:58.213671 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:21:58.213671 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:21:58.213671 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:21:58.213671 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:21:58.213671 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:21:58.213671 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:21:58.213671 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 16:21:58.213671 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:21:58.213671 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:21:58.213671 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:21:58.213671 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:21:58.214854 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:21:58.214854 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:21:58.214854 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:21:58.214854 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:21:58.214854 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 16:21:58.214854 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 16:21:58.214854 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 16:21:58.214854 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 16:21:58.214854 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 16:21:58.214854 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 16:21:58.214854 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 16:21:58.214854 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 16:21:58.214854 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 629/1276] 10.222.0.27 () {56 vars in 1096 bytes} [Fri Sep 9 16:21:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:21:58.219557 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ca3b3d-8ea9-4d90-bcf7-a98f4b945a0d None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:21:58.303158 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:21:58.322156 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ca3b3d-8ea9-4d90-bcf7-a98f4b945a0d None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:21:58.355888 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7f8135-d557-4079-a75b-cda923fb3a07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:21:58.356486 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7f8135-d557-4079-a75b-cda923fb3a07 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:21:58.356766 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7f8135-d557-4079-a75b-cda923fb3a07 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:21:58.357035 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7f8135-d557-4079-a75b-cda923fb3a07 None admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:21:58.357683 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7f8135-d557-4079-a75b-cda923fb3a07 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:21:58.357983 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7f8135-d557-4079-a75b-cda923fb3a07 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:21:58.359382 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7f8135-d557-4079-a75b-cda923fb3a07 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:21:58.367181 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 648/1277] 10.222.0.27 () {56 vars in 1099 bytes} [Fri Sep 9 16:21:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:21:58.373028 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3455246c-12a7-4909-acd6-02ea390ba77a None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:21:58.470070 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3455246c-12a7-4909-acd6-02ea390ba77a None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:21:58.502578 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054a4a1e-253b-4835-8036-bbc77b21399a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:21:58.503184 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054a4a1e-253b-4835-8036-bbc77b21399a None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:21:58.503460 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054a4a1e-253b-4835-8036-bbc77b21399a None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:21:58.503729 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054a4a1e-253b-4835-8036-bbc77b21399a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:21:58.513256 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054a4a1e-253b-4835-8036-bbc77b21399a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:21:58.514718 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054a4a1e-253b-4835-8036-bbc77b21399a None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:21:58.529234 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-054a4a1e-253b-4835-8036-bbc77b21399a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 16:21:58.529234 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:21:58.529234 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:21:58.529234 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:21:58.529234 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:21:58.529234 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:21:58.529234 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:21:58.529234 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:21:58.529234 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:21:58.529234 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:21:58.529234 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:21:58.529234 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:21:58.529234 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 16:21:58.529234 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 16:21:58.529234 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 16:21:58.529234 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 16:21:58.530445 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:21:58.530445 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:21:58.530445 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:21:58.530445 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:21:58.530445 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:21:58.530445 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:21:58.530445 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:21:58.530445 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 16:21:58.530445 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:21:58.530445 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:21:58.530445 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:21:58.530445 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:21:58.530445 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:21:58.530445 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:21:58.530445 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:21:58.530445 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:21:58.530445 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 16:21:58.531578 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 16:21:58.531578 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 16:21:58.531578 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 16:21:58.531578 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 630/1278] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 16:21:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:21:58.536060 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7f8135-d557-4079-a75b-cda923fb3a07 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:21:58.634577 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7f8135-d557-4079-a75b-cda923fb3a07 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:21:58.667153 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96adcffe-55b4-42f9-8b1e-1517bd819326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:21:58.667751 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96adcffe-55b4-42f9-8b1e-1517bd819326 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:21:58.668027 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96adcffe-55b4-42f9-8b1e-1517bd819326 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:21:58.668330 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96adcffe-55b4-42f9-8b1e-1517bd819326 None admin] PATH_INFO: `/v3/domains` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:21:58.668954 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96adcffe-55b4-42f9-8b1e-1517bd819326 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:21:58.669253 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96adcffe-55b4-42f9-8b1e-1517bd819326 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:21:58.670642 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96adcffe-55b4-42f9-8b1e-1517bd819326 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:21:58.682002 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 649/1279] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Sep 9 16:21:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:21:58.687833 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054a4a1e-253b-4835-8036-bbc77b21399a None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:21:58.719745 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:21:58.789311 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054a4a1e-253b-4835-8036-bbc77b21399a None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:21:58.822231 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b4c33b-0861-4816-a56d-a506adff7daa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:21:58.822870 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b4c33b-0861-4816-a56d-a506adff7daa None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:21:58.823146 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b4c33b-0861-4816-a56d-a506adff7daa None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:21:58.823414 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b4c33b-0861-4816-a56d-a506adff7daa None admin] PATH_INFO: `/v3/users/placement` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:21:58.830516 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b4c33b-0861-4816-a56d-a506adff7daa None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:21:58.831936 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b4c33b-0861-4816-a56d-a506adff7daa None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:21:58.842677 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-42b4c33b-0861-4816-a56d-a506adff7daa None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 09 16:21:58.842677 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:21:58.842677 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:21:58.842677 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:21:58.842677 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:21:58.842677 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:21:58.842677 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:21:58.842677 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:21:58.842677 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:21:58.842677 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:21:58.842677 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:21:58.842677 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:21:58.842677 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 16:21:58.842677 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 16:21:58.842677 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 16:21:58.842677 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 16:21:58.843756 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:21:58.843756 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:21:58.843756 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 16:21:58.843756 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 16:21:58.843756 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 16:21:58.843756 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 16:21:58.843756 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:21:58.843756 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:21:58.843756 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:21:58.843756 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:21:58.843756 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:21:58.843756 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 16:21:58.843756 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:21:58.843756 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:21:58.843756 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:21:58.843756 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:21:58.843756 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:21:58.843756 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:21:58.844867 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:21:58.844867 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:21:58.844867 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 16:21:58.844867 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 16:21:58.844867 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 16:21:58.844867 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 16:21:58.844867 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 16:21:58.844867 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 16:21:58.844867 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 09 16:21:58.844867 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 16:21:58.844867 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 631/1280] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 16:21:58 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:21:58.849683 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96adcffe-55b4-42f9-8b1e-1517bd819326 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:21:58.853464 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:21:58.946626 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96adcffe-55b4-42f9-8b1e-1517bd819326 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:21:58.978588 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273dd060-09f1-4295-bf1b-efea6eba76cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:21:58.979181 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273dd060-09f1-4295-bf1b-efea6eba76cb None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:21:58.979459 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273dd060-09f1-4295-bf1b-efea6eba76cb None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:21:58.979730 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273dd060-09f1-4295-bf1b-efea6eba76cb None admin] PATH_INFO: `/v3/users` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:21:58.980435 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273dd060-09f1-4295-bf1b-efea6eba76cb None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:21:58.980734 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273dd060-09f1-4295-bf1b-efea6eba76cb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:21:58.982147 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273dd060-09f1-4295-bf1b-efea6eba76cb None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:21:58.998913 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 650/1281] 10.222.0.27 () {56 vars in 1143 bytes} [Fri Sep 9 16:21:58 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:21:59.005247 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b4c33b-0861-4816-a56d-a506adff7daa None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:21:59.093035 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:21:59.106461 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b4c33b-0861-4816-a56d-a506adff7daa None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:21:59.140857 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d05078-e97b-4d31-8a30-30776c6358ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:21:59.141457 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d05078-e97b-4d31-8a30-30776c6358ed None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:21:59.141760 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d05078-e97b-4d31-8a30-30776c6358ed None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:21:59.142011 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d05078-e97b-4d31-8a30-30776c6358ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:21:59.207826 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d05078-e97b-4d31-8a30-30776c6358ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:21:59.209215 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d05078-e97b-4d31-8a30-30776c6358ed None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:21:59.294362 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:21:59.305628 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 632/1282] 10.222.0.27 () {58 vars in 1282 bytes} [Fri Sep 9 16:21:59 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 09 16:21:59.311359 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273dd060-09f1-4295-bf1b-efea6eba76cb None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:21:59.371915 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:21:59.409455 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273dd060-09f1-4295-bf1b-efea6eba76cb None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:21:59.443095 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaedc583-f8a3-455d-9c2a-be51686e0ffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:21:59.443703 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaedc583-f8a3-455d-9c2a-be51686e0ffc None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:21:59.443982 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaedc583-f8a3-455d-9c2a-be51686e0ffc None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:21:59.444254 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaedc583-f8a3-455d-9c2a-be51686e0ffc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:21:59.453895 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaedc583-f8a3-455d-9c2a-be51686e0ffc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:21:59.455900 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaedc583-f8a3-455d-9c2a-be51686e0ffc None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:21:59.469941 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-aaedc583-f8a3-455d-9c2a-be51686e0ffc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 16:21:59.469941 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:21:59.469941 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:21:59.469941 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:21:59.469941 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:21:59.469941 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:21:59.469941 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:21:59.469941 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:21:59.469941 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:21:59.469941 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:21:59.469941 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:21:59.469941 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:21:59.469941 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 16:21:59.469941 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 16:21:59.469941 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 16:21:59.469941 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 16:21:59.474464 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:21:59.474464 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:21:59.474464 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:21:59.474464 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:21:59.474464 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:21:59.474464 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:21:59.474464 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:21:59.474464 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Sep 09 16:21:59.474464 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:21:59.474464 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:21:59.474464 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:21:59.474464 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:21:59.474464 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:21:59.474464 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:21:59.474464 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:21:59.474464 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:21:59.474464 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 16:21:59.475730 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 16:21:59.475730 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 16:21:59.475730 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:21:59.475730 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 651/1283] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 16:21:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 16:21:59.476575 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d05078-e97b-4d31-8a30-30776c6358ed None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:21:59.572363 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d05078-e97b-4d31-8a30-30776c6358ed None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:21:59.604707 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aaf99f-77e4-4c2d-88a0-4d787b4a5ae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:21:59.605296 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aaf99f-77e4-4c2d-88a0-4d787b4a5ae1 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:21:59.605577 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aaf99f-77e4-4c2d-88a0-4d787b4a5ae1 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:21:59.605849 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aaf99f-77e4-4c2d-88a0-4d787b4a5ae1 None admin] PATH_INFO: `/v3/domains` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:21:59.606499 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81aaf99f-77e4-4c2d-88a0-4d787b4a5ae1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:21:59.606800 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81aaf99f-77e4-4c2d-88a0-4d787b4a5ae1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:21:59.608160 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81aaf99f-77e4-4c2d-88a0-4d787b4a5ae1 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:21:59.619477 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 633/1284] 10.222.0.27 () {56 vars in 1109 bytes} [Fri Sep 9 16:21:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:21:59.624856 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaedc583-f8a3-455d-9c2a-be51686e0ffc None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:21:59.721622 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaedc583-f8a3-455d-9c2a-be51686e0ffc None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:21:59.736925 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:21:59.760621 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258f9296-7ed3-476b-bac1-99916bb82387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:21:59.761295 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258f9296-7ed3-476b-bac1-99916bb82387 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:21:59.761581 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258f9296-7ed3-476b-bac1-99916bb82387 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:21:59.761854 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258f9296-7ed3-476b-bac1-99916bb82387 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:21:59.768368 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258f9296-7ed3-476b-bac1-99916bb82387 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:21:59.769790 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258f9296-7ed3-476b-bac1-99916bb82387 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:21:59.780729 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application [None req-258f9296-7ed3-476b-bac1-99916bb82387 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 16:21:59.780729 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:21:59.780729 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:21:59.780729 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:21:59.780729 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:21:59.780729 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:21:59.780729 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:21:59.780729 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:21:59.780729 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:21:59.780729 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:21:59.780729 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:21:59.780729 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:21:59.780729 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 16:21:59.780729 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 16:21:59.780729 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 16:21:59.781599 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 16:21:59.781599 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:21:59.781599 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:21:59.781599 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:21:59.781599 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:21:59.781599 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:21:59.781599 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:21:59.781599 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:21:59.781599 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application with Lock( Sep 09 16:21:59.781599 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:21:59.781599 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:21:59.781599 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:21:59.781599 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:21:59.781599 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:21:59.781599 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:21:59.781599 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:21:59.781599 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:21:59.782663 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 16:21:59.782663 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 16:21:59.782663 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 16:21:59.782663 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 16:21:59.782663 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 16:21:59.782663 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 16:21:59.782663 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 16:21:59.782663 dv-cinder-831247-27-smb devstack@keystone.service[81446]: ERROR keystone.server.flask.application Sep 09 16:21:59.782663 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 652/1285] 10.222.0.27 () {56 vars in 1111 bytes} [Fri Sep 9 16:21:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:21:59.787685 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aaf99f-77e4-4c2d-88a0-4d787b4a5ae1 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:21:59.836831 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:21:59.885359 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aaf99f-77e4-4c2d-88a0-4d787b4a5ae1 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:21:59.917541 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e979d21-b45a-4aff-a46d-ed9069f79dd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:21:59.918127 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e979d21-b45a-4aff-a46d-ed9069f79dd9 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:21:59.918435 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e979d21-b45a-4aff-a46d-ed9069f79dd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:21:59.918705 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e979d21-b45a-4aff-a46d-ed9069f79dd9 None admin] PATH_INFO: `/v3/projects` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:21:59.919371 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e979d21-b45a-4aff-a46d-ed9069f79dd9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:21:59.919673 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e979d21-b45a-4aff-a46d-ed9069f79dd9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:21:59.921092 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e979d21-b45a-4aff-a46d-ed9069f79dd9 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:21:59.933069 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 634/1286] 10.222.0.27 () {56 vars in 1148 bytes} [Fri Sep 9 16:21:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:21:59.938998 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258f9296-7ed3-476b-bac1-99916bb82387 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:22:00.036241 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258f9296-7ed3-476b-bac1-99916bb82387 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:22:00.068543 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5435d61f-9fd9-4411-a691-0dd0bee989a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:22:00.069124 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5435d61f-9fd9-4411-a691-0dd0bee989a6 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:22:00.069401 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5435d61f-9fd9-4411-a691-0dd0bee989a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:22:00.069673 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5435d61f-9fd9-4411-a691-0dd0bee989a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:22:00.070403 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5435d61f-9fd9-4411-a691-0dd0bee989a6 None admin] RBAC: Adding query filter params (role.id=0a36d1be416f4089be19be979943b731, scope.project.id=68d6aaafab824657b08ca91f3d46d5f8, user.id=2d73df92393c43b2b5ccc32a2d43d952) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:22:00.070710 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5435d61f-9fd9-4411-a691-0dd0bee989a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:22:00.072123 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5435d61f-9fd9-4411-a691-0dd0bee989a6 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:22:00.077640 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 653/1287] 10.222.0.27 () {56 vars in 1374 bytes} [Fri Sep 9 16:21:59 2022] GET /identity/v3/role_assignments?user.id=2d73df92393c43b2b5ccc32a2d43d952&scope.project.id=68d6aaafab824657b08ca91f3d46d5f8&role.id=0a36d1be416f4089be19be979943b731 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:22:02.206966 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eabed3f-daf5-458d-9a3b-78aedb5e9da2 None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:22:02.207515 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eabed3f-daf5-458d-9a3b-78aedb5e9da2 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:22:02.207515 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eabed3f-daf5-458d-9a3b-78aedb5e9da2 None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:22:02.208807 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 635/1288] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:22:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:22:02.214021 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93410aee-4c17-4eb4-b7a5-f5384496cdc0 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:22:02.214439 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93410aee-4c17-4eb4-b7a5-f5384496cdc0 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:22:02.214590 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93410aee-4c17-4eb4-b7a5-f5384496cdc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:22:02.232857 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-93410aee-4c17-4eb4-b7a5-f5384496cdc0 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:22:02.234026 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-93410aee-4c17-4eb4-b7a5-f5384496cdc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:22:02.263054 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:22:02.302053 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 654/1289] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:22:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 16:22:02.570042 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eabed3f-daf5-458d-9a3b-78aedb5e9da2 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:22:02.668395 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eabed3f-daf5-458d-9a3b-78aedb5e9da2 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:22:02.679929 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:22:02.706393 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2252c8-23e8-4b02-ac87-e5a92bc2bbaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:22:02.707020 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2252c8-23e8-4b02-ac87-e5a92bc2bbaa None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:22:02.707300 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2252c8-23e8-4b02-ac87-e5a92bc2bbaa None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:22:02.707571 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2252c8-23e8-4b02-ac87-e5a92bc2bbaa None admin] PATH_INFO: `/v3/services/placement` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:22:02.708144 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2252c8-23e8-4b02-ac87-e5a92bc2bbaa None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:22:02.709526 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2252c8-23e8-4b02-ac87-e5a92bc2bbaa None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:22:02.718121 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-7a2252c8-23e8-4b02-ac87-e5a92bc2bbaa None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 09 16:22:02.718121 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:22:02.718121 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 16:22:02.718121 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 16:22:02.718121 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 16:22:02.718121 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 16:22:02.718121 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 16:22:02.718121 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 16:22:02.718121 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 09 16:22:02.718121 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 16:22:02.718121 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 16:22:02.718121 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 16:22:02.718121 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:22:02.718121 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:22:02.718121 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:22:02.718121 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:22:02.718121 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:22:02.719375 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:22:02.719375 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:22:02.719375 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:22:02.719375 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:22:02.719375 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:22:02.719375 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:22:02.719375 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 16:22:02.719375 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 16:22:02.719375 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 16:22:02.719375 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 16:22:02.719375 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:22:02.719375 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:22:02.719375 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:22:02.719375 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:22:02.719375 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:22:02.719375 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:22:02.721153 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:22:02.721153 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 16:22:02.721153 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:22:02.721153 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:22:02.721153 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:22:02.721153 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:22:02.721153 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:22:02.721153 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:22:02.721153 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:22:02.721153 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:22:02.721153 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 16:22:02.721153 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 16:22:02.721153 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 09 16:22:02.721153 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 16:22:02.721153 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 636/1290] 10.222.0.27 () {56 vars in 1117 bytes} [Fri Sep 9 16:22:02 2022] GET /identity/v3/services/placement => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:22:02.725860 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93410aee-4c17-4eb4-b7a5-f5384496cdc0 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:22:02.837641 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93410aee-4c17-4eb4-b7a5-f5384496cdc0 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:22:02.870406 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b265c2b-2054-401b-8ac5-d9ae09d4833b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:22:02.871000 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b265c2b-2054-401b-8ac5-d9ae09d4833b None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:22:02.871278 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b265c2b-2054-401b-8ac5-d9ae09d4833b None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:22:02.871545 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b265c2b-2054-401b-8ac5-d9ae09d4833b None admin] PATH_INFO: `/v3/services` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:22:02.872152 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b265c2b-2054-401b-8ac5-d9ae09d4833b None admin] RBAC: Adding query filter params (name=placement) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:22:02.872451 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b265c2b-2054-401b-8ac5-d9ae09d4833b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:22:02.873813 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b265c2b-2054-401b-8ac5-d9ae09d4833b None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:22:02.878961 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 655/1291] 10.222.0.27 () {56 vars in 1116 bytes} [Fri Sep 9 16:22:02 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:22:02.884720 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2252c8-23e8-4b02-ac87-e5a92bc2bbaa None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:22:02.979436 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2252c8-23e8-4b02-ac87-e5a92bc2bbaa None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:22:03.020016 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f13a95-2f00-49de-bb7e-1ab188f1f702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:22:03.020621 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f13a95-2f00-49de-bb7e-1ab188f1f702 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:22:03.020898 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f13a95-2f00-49de-bb7e-1ab188f1f702 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:22:03.021166 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f13a95-2f00-49de-bb7e-1ab188f1f702 None admin] PATH_INFO: `/v3/services` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:22:03.021788 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f13a95-2f00-49de-bb7e-1ab188f1f702 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:22:03.022087 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f13a95-2f00-49de-bb7e-1ab188f1f702 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:22:03.023486 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f13a95-2f00-49de-bb7e-1ab188f1f702 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:22:03.027977 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 637/1292] 10.222.0.27 () {56 vars in 1116 bytes} [Fri Sep 9 16:22:02 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:22:05.147638 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150b4433-0171-41ac-82c0-cae115b3c8ff None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:22:05.148168 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150b4433-0171-41ac-82c0-cae115b3c8ff None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:22:05.148168 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150b4433-0171-41ac-82c0-cae115b3c8ff None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:22:05.149510 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 656/1293] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:22:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:22:05.154891 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30689b4-0746-4a72-987f-2a0b5ab811a9 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:22:05.155265 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30689b4-0746-4a72-987f-2a0b5ab811a9 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:22:05.155442 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30689b4-0746-4a72-987f-2a0b5ab811a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:22:05.173356 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-d30689b4-0746-4a72-987f-2a0b5ab811a9 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:22:05.174573 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-d30689b4-0746-4a72-987f-2a0b5ab811a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:22:05.203293 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:22:05.239360 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 638/1294] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:22:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 16:22:05.513934 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150b4433-0171-41ac-82c0-cae115b3c8ff None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:22:05.543818 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:22:05.611921 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150b4433-0171-41ac-82c0-cae115b3c8ff None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:22:05.643953 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cf6d5f-5616-46d0-b1c8-f731854ed41c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:22:05.644534 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cf6d5f-5616-46d0-b1c8-f731854ed41c None admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:22:05.644810 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cf6d5f-5616-46d0-b1c8-f731854ed41c None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:22:05.645072 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cf6d5f-5616-46d0-b1c8-f731854ed41c None admin] PATH_INFO: `/v3/services` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:22:05.645702 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cf6d5f-5616-46d0-b1c8-f731854ed41c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:22:05.647075 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cf6d5f-5616-46d0-b1c8-f731854ed41c None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:22:05.660507 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 657/1295] 10.222.0.27 () {60 vars in 1141 bytes} [Fri Sep 9 16:22:05 2022] POST /identity/v3/services => generated 246 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:22:07.805773 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529ac6c0-b60e-48f4-9ea4-a2c2b39cc333 None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:22:07.806420 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529ac6c0-b60e-48f4-9ea4-a2c2b39cc333 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:22:07.806420 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529ac6c0-b60e-48f4-9ea4-a2c2b39cc333 None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:22:07.807692 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 639/1296] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:22:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:22:07.812875 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658cef6a-c3ab-4940-bf38-5fb2a18469c2 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:22:07.813264 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658cef6a-c3ab-4940-bf38-5fb2a18469c2 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:22:07.813412 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658cef6a-c3ab-4940-bf38-5fb2a18469c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:22:07.831733 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-658cef6a-c3ab-4940-bf38-5fb2a18469c2 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:22:07.832888 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-658cef6a-c3ab-4940-bf38-5fb2a18469c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:22:07.902031 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 658/1297] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:22:07 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 16:22:08.164786 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529ac6c0-b60e-48f4-9ea4-a2c2b39cc333 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:22:08.262298 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529ac6c0-b60e-48f4-9ea4-a2c2b39cc333 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:22:08.295547 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceeb337-0b44-4e6a-909b-ab07e8e15755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:22:08.296164 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceeb337-0b44-4e6a-909b-ab07e8e15755 None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:22:08.296436 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceeb337-0b44-4e6a-909b-ab07e8e15755 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:22:08.296700 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceeb337-0b44-4e6a-909b-ab07e8e15755 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:22:08.297263 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ceeb337-0b44-4e6a-909b-ab07e8e15755 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:22:08.298657 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ceeb337-0b44-4e6a-909b-ab07e8e15755 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:22:08.307077 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-1ceeb337-0b44-4e6a-909b-ab07e8e15755 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 09 16:22:08.307077 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:22:08.307077 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 16:22:08.307077 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 16:22:08.307077 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 16:22:08.307077 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 16:22:08.307077 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 16:22:08.307077 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 16:22:08.307077 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 09 16:22:08.307077 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 16:22:08.307077 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 16:22:08.307077 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 16:22:08.307077 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:22:08.307077 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:22:08.307077 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:22:08.307077 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:22:08.307077 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:22:08.308222 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:22:08.308222 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:22:08.308222 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:22:08.308222 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:22:08.308222 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:22:08.308222 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:22:08.308222 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 16:22:08.308222 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 16:22:08.308222 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 16:22:08.308222 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 16:22:08.308222 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:22:08.308222 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:22:08.308222 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:22:08.308222 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:22:08.308222 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:22:08.308222 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:22:08.309501 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:22:08.309501 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 16:22:08.309501 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:22:08.309501 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:22:08.309501 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:22:08.309501 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:22:08.309501 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:22:08.309501 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:22:08.309501 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:22:08.309501 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:22:08.309501 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 16:22:08.309501 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 16:22:08.309501 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 09 16:22:08.309501 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 16:22:08.309501 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 640/1298] 10.222.0.27 () {56 vars in 1117 bytes} [Fri Sep 9 16:22:08 2022] GET /identity/v3/services/placement => generated 90 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:22:08.314001 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658cef6a-c3ab-4940-bf38-5fb2a18469c2 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:22:08.332895 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:22:08.413946 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658cef6a-c3ab-4940-bf38-5fb2a18469c2 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:22:08.446490 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d35a66b-29f8-4ef3-beb1-a8d4a10bc7d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:22:08.447082 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d35a66b-29f8-4ef3-beb1-a8d4a10bc7d7 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:22:08.447358 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d35a66b-29f8-4ef3-beb1-a8d4a10bc7d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:22:08.447626 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d35a66b-29f8-4ef3-beb1-a8d4a10bc7d7 None admin] PATH_INFO: `/v3/services` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:22:08.448236 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d35a66b-29f8-4ef3-beb1-a8d4a10bc7d7 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:22:08.448531 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d35a66b-29f8-4ef3-beb1-a8d4a10bc7d7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:22:08.449891 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d35a66b-29f8-4ef3-beb1-a8d4a10bc7d7 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:22:08.455408 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 659/1299] 10.222.0.27 () {56 vars in 1116 bytes} [Fri Sep 9 16:22:08 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:22:08.461310 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceeb337-0b44-4e6a-909b-ab07e8e15755 None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:22:08.492894 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:22:08.557922 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceeb337-0b44-4e6a-909b-ab07e8e15755 None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:22:08.589849 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16abe2d4-8a21-4f48-b616-0acc60af092e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:22:08.590523 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16abe2d4-8a21-4f48-b616-0acc60af092e None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:22:08.590798 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16abe2d4-8a21-4f48-b616-0acc60af092e None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:22:08.591062 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16abe2d4-8a21-4f48-b616-0acc60af092e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:22:08.591734 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16abe2d4-8a21-4f48-b616-0acc60af092e None admin] RBAC: Adding query filter params (interface=public, service_id=e27886e566334447b2bae797d7fbdb0b, region_id=RegionOne) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:22:08.592033 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16abe2d4-8a21-4f48-b616-0acc60af092e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:22:08.593386 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16abe2d4-8a21-4f48-b616-0acc60af092e None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:22:08.598115 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 641/1300] 10.222.0.27 () {56 vars in 1251 bytes} [Fri Sep 9 16:22:08 2022] GET /identity/v3/endpoints?service_id=e27886e566334447b2bae797d7fbdb0b&interface=public®ion_id=RegionOne => generated 194 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:22:08.603687 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d35a66b-29f8-4ef3-beb1-a8d4a10bc7d7 None admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:22:08.685394 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:22:08.703888 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d35a66b-29f8-4ef3-beb1-a8d4a10bc7d7 None admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:22:08.737214 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f15fe6-9fd8-41e1-beca-7bc205762d44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:22:08.737874 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f15fe6-9fd8-41e1-beca-7bc205762d44 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:22:08.738234 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f15fe6-9fd8-41e1-beca-7bc205762d44 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:22:08.738667 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f15fe6-9fd8-41e1-beca-7bc205762d44 None admin] PATH_INFO: `/v3/services` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:22:08.739453 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f15fe6-9fd8-41e1-beca-7bc205762d44 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:22:08.740885 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f15fe6-9fd8-41e1-beca-7bc205762d44 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:22:08.749546 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 660/1301] 10.222.0.27 () {56 vars in 1087 bytes} [Fri Sep 9 16:22:08 2022] GET /identity/v3/services => generated 2191 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:22:10.857841 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d47a58-1534-45ef-b7bf-cbb024678e9f None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:22:10.858419 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d47a58-1534-45ef-b7bf-cbb024678e9f None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:22:10.858419 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d47a58-1534-45ef-b7bf-cbb024678e9f None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:22:10.859719 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 642/1302] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:22:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:22:10.864806 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf05bf3-7696-436f-a4a8-ae677574f809 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:22:10.865173 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf05bf3-7696-436f-a4a8-ae677574f809 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:22:10.865352 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf05bf3-7696-436f-a4a8-ae677574f809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:22:10.882915 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-7cf05bf3-7696-436f-a4a8-ae677574f809 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:22:10.884079 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-7cf05bf3-7696-436f-a4a8-ae677574f809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:22:10.948974 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 661/1303] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:22:10 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 16:22:11.213522 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d47a58-1534-45ef-b7bf-cbb024678e9f None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:22:11.306963 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:22:11.314120 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d47a58-1534-45ef-b7bf-cbb024678e9f None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:22:11.346073 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5590fc6c-4700-4188-b2dd-32bc4e49b8dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:22:11.346709 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5590fc6c-4700-4188-b2dd-32bc4e49b8dc None admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:22:11.346983 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5590fc6c-4700-4188-b2dd-32bc4e49b8dc None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:22:11.347356 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5590fc6c-4700-4188-b2dd-32bc4e49b8dc None admin] PATH_INFO: `/v3/services/placement` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:22:11.347813 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5590fc6c-4700-4188-b2dd-32bc4e49b8dc None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:22:11.349181 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5590fc6c-4700-4188-b2dd-32bc4e49b8dc None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:22:11.359501 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application [None req-5590fc6c-4700-4188-b2dd-32bc4e49b8dc None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 09 16:22:11.359501 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:22:11.359501 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 16:22:11.359501 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 16:22:11.359501 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 16:22:11.359501 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 16:22:11.359501 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 16:22:11.359501 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 16:22:11.359501 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 09 16:22:11.359501 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 16:22:11.359501 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 16:22:11.359501 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 16:22:11.359501 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 16:22:11.359501 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 16:22:11.359501 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 16:22:11.359501 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 16:22:11.359501 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 16:22:11.360606 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 16:22:11.360606 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 16:22:11.360606 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 16:22:11.360606 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 16:22:11.360606 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 16:22:11.360606 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 16:22:11.360606 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 16:22:11.360606 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 16:22:11.360606 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 16:22:11.360606 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 16:22:11.360606 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 16:22:11.360606 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 16:22:11.360606 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 16:22:11.360606 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 16:22:11.360606 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 16:22:11.360606 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 16:22:11.362097 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 16:22:11.362097 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application with Lock( Sep 09 16:22:11.362097 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 16:22:11.362097 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self._enter() Sep 09 16:22:11.362097 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 16:22:11.362097 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 16:22:11.362097 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 16:22:11.362097 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application return self.creator() Sep 09 16:22:11.362097 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 16:22:11.362097 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application created_value = creator( Sep 09 16:22:11.362097 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 16:22:11.362097 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 16:22:11.362097 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 09 16:22:11.362097 dv-cinder-831247-27-smb devstack@keystone.service[81445]: ERROR keystone.server.flask.application Sep 09 16:22:11.362097 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 643/1304] 10.222.0.27 () {56 vars in 1117 bytes} [Fri Sep 9 16:22:11 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 16:22:11.367126 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf05bf3-7696-436f-a4a8-ae677574f809 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:22:11.441367 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:22:11.463344 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf05bf3-7696-436f-a4a8-ae677574f809 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:22:11.496591 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fcfc5c-8b2d-48c3-900c-cfb3ae54b483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:22:11.497123 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fcfc5c-8b2d-48c3-900c-cfb3ae54b483 None admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:22:11.497403 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fcfc5c-8b2d-48c3-900c-cfb3ae54b483 None admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:22:11.497670 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fcfc5c-8b2d-48c3-900c-cfb3ae54b483 None admin] PATH_INFO: `/v3/services` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:22:11.498281 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fcfc5c-8b2d-48c3-900c-cfb3ae54b483 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:22:11.498614 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fcfc5c-8b2d-48c3-900c-cfb3ae54b483 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:22:11.499968 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fcfc5c-8b2d-48c3-900c-cfb3ae54b483 None admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:22:11.504919 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 662/1305] 10.222.0.27 () {56 vars in 1116 bytes} [Fri Sep 9 16:22:11 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:22:11.510553 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5590fc6c-4700-4188-b2dd-32bc4e49b8dc None admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:22:11.605634 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5590fc6c-4700-4188-b2dd-32bc4e49b8dc None admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:22:11.637242 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d12fdc-4977-4816-a6fe-c667a9ee0038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:22:11.637819 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d12fdc-4977-4816-a6fe-c667a9ee0038 None admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:22:11.638091 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d12fdc-4977-4816-a6fe-c667a9ee0038 None admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:22:11.638378 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d12fdc-4977-4816-a6fe-c667a9ee0038 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:22:11.639014 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d12fdc-4977-4816-a6fe-c667a9ee0038 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:22:11.640359 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d12fdc-4977-4816-a6fe-c667a9ee0038 None admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:22:11.659606 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 644/1306] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 16:22:11 2022] POST /identity/v3/endpoints => generated 331 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:22:21.501987 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=30 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:22:21.655098 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:23:15.311259 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa67955-2437-44a5-a2c7-84a0a5349d73 None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:23:15.311698 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa67955-2437-44a5-a2c7-84a0a5349d73 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:23:15.311808 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa67955-2437-44a5-a2c7-84a0a5349d73 None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:23:15.320190 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce050c0a-05bc-474b-a44c-48dea49e8737 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:23:15.320592 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce050c0a-05bc-474b-a44c-48dea49e8737 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:23:15.320741 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce050c0a-05bc-474b-a44c-48dea49e8737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:23:15.324436 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 663/1307] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:23:15 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:23:15.446056 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-ce050c0a-05bc-474b-a44c-48dea49e8737 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:23:15.447684 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-ce050c0a-05bc-474b-a44c-48dea49e8737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:23:15.566259 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 645/1308] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:23:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:23:15.860121 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca821cc-0c9c-438a-928e-185fa96e6655 None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:23:15.860553 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca821cc-0c9c-438a-928e-185fa96e6655 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:23:15.861583 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca821cc-0c9c-438a-928e-185fa96e6655 None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:23:15.863034 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 664/1309] 10.222.0.27 () {54 vars in 965 bytes} [Fri Sep 9 16:23:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:23:15.869083 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38d75fd-0870-43e6-9db5-1bdd31586009 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:23:15.869443 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38d75fd-0870-43e6-9db5-1bdd31586009 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:23:15.869786 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38d75fd-0870-43e6-9db5-1bdd31586009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:23:15.953026 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-b38d75fd-0870-43e6-9db5-1bdd31586009 None None] MFA Rules not processed for user `d5f44bfdd5214e8d84a2c0a5b1fd9b84`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:23:15.954376 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-b38d75fd-0870-43e6-9db5-1bdd31586009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:23:15.978973 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:23:16.045855 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 646/1310] 10.222.0.27 () {58 vars in 1062 bytes} [Fri Sep 9 16:23:15 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:23:16.054996 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca821cc-0c9c-438a-928e-185fa96e6655 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:23:16.056845 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-9ca821cc-0c9c-438a-928e-185fa96e6655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:23:16.180801 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca821cc-0c9c-438a-928e-185fa96e6655 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:23:16.262506 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77234875-e0be-45ab-9e3c-803b2e1ce063 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f44bfdd5214e8d84a2c0a5b1fd9b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:23:16.263464 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77234875-e0be-45ab-9e3c-803b2e1ce063 service neutron] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:23:16.263917 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77234875-e0be-45ab-9e3c-803b2e1ce063 service neutron] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:23:16.264430 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77234875-e0be-45ab-9e3c-803b2e1ce063 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:23:16.266142 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-77234875-e0be-45ab-9e3c-803b2e1ce063 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:23:16.330933 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:23:16.389748 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77234875-e0be-45ab-9e3c-803b2e1ce063 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:23:16.391109 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77234875-e0be-45ab-9e3c-803b2e1ce063 service neutron] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:23:16.411157 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 665/1311] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:23:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:23:18.853583 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0032d05-23ff-4025-ad58-dfee08af2438 None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:23:18.854035 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0032d05-23ff-4025-ad58-dfee08af2438 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:23:18.854126 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0032d05-23ff-4025-ad58-dfee08af2438 None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:23:18.855630 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 647/1312] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:23:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:23:18.860670 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956b49d1-cdcf-403f-9640-6dc638de85d7 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:23:18.861688 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956b49d1-cdcf-403f-9640-6dc638de85d7 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:23:18.861777 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956b49d1-cdcf-403f-9640-6dc638de85d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:23:18.942819 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-956b49d1-cdcf-403f-9640-6dc638de85d7 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:23:18.944043 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-956b49d1-cdcf-403f-9640-6dc638de85d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:23:19.040486 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 666/1313] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:23:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:23:19.320339 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0032d05-23ff-4025-ad58-dfee08af2438 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:23:19.321863 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-f0032d05-23ff-4025-ad58-dfee08af2438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:23:19.424331 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0032d05-23ff-4025-ad58-dfee08af2438 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:23:19.494924 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:23:19.497429 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527cd0ba-6599-44af-bb8a-9f82a5a9dcd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f44bfdd5214e8d84a2c0a5b1fd9b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:23:19.498072 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527cd0ba-6599-44af-bb8a-9f82a5a9dcd6 service neutron] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:23:19.498384 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527cd0ba-6599-44af-bb8a-9f82a5a9dcd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:23:19.498691 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527cd0ba-6599-44af-bb8a-9f82a5a9dcd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:23:19.500827 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-527cd0ba-6599-44af-bb8a-9f82a5a9dcd6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:23:19.607383 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527cd0ba-6599-44af-bb8a-9f82a5a9dcd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:23:19.608743 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527cd0ba-6599-44af-bb8a-9f82a5a9dcd6 service neutron] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:23:19.626021 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 648/1314] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:23:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:23:22.083913 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c714124b-561f-497d-ab43-d7cb6434a984 None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:23:22.084454 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c714124b-561f-497d-ab43-d7cb6434a984 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:23:22.084454 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c714124b-561f-497d-ab43-d7cb6434a984 None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:23:22.085795 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 667/1315] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:23:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:23:22.090973 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49284a42-5a4d-4c21-9240-08fd2a82f91d None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:23:22.091346 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49284a42-5a4d-4c21-9240-08fd2a82f91d None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:23:22.091532 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49284a42-5a4d-4c21-9240-08fd2a82f91d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:23:22.156268 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-49284a42-5a4d-4c21-9240-08fd2a82f91d None None] MFA Rules not processed for user `f918acce5260406e8053172ddbf5a1fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:23:22.157471 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-49284a42-5a4d-4c21-9240-08fd2a82f91d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:23:22.209461 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:23:22.254103 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 649/1316] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:23:22 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:23:22.538933 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c714124b-561f-497d-ab43-d7cb6434a984 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:23:22.540473 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-c714124b-561f-497d-ab43-d7cb6434a984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:23:22.550138 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:23:22.642858 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c714124b-561f-497d-ab43-d7cb6434a984 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:23:22.714352 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f611fb-2af3-4c79-a53b-e2f4fe350ee3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f44bfdd5214e8d84a2c0a5b1fd9b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:23:22.714956 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f611fb-2af3-4c79-a53b-e2f4fe350ee3 service neutron] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:23:22.715234 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f611fb-2af3-4c79-a53b-e2f4fe350ee3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:23:22.715502 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f611fb-2af3-4c79-a53b-e2f4fe350ee3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:23:22.717070 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-e3f611fb-2af3-4c79-a53b-e2f4fe350ee3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:23:22.779131 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:23:22.825316 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f611fb-2af3-4c79-a53b-e2f4fe350ee3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:23:22.826739 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f611fb-2af3-4c79-a53b-e2f4fe350ee3 service neutron] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:23:22.845067 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 668/1317] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:23:22 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:23:25.519170 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d11a0d-ada2-49ee-ae5e-1e784f2b7d87 None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:23:25.519694 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d11a0d-ada2-49ee-ae5e-1e784f2b7d87 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:23:25.519694 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d11a0d-ada2-49ee-ae5e-1e784f2b7d87 None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:23:25.521066 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 650/1318] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:23:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:23:25.526249 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a876c5fa-3e68-4822-9200-96a5e503dc07 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:23:25.526647 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a876c5fa-3e68-4822-9200-96a5e503dc07 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:23:25.526821 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a876c5fa-3e68-4822-9200-96a5e503dc07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:23:25.590812 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-a876c5fa-3e68-4822-9200-96a5e503dc07 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:23:25.591930 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-a876c5fa-3e68-4822-9200-96a5e503dc07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:23:25.685254 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 669/1319] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:23:25 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:23:25.975039 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d11a0d-ada2-49ee-ae5e-1e784f2b7d87 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:23:25.976575 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-30d11a0d-ada2-49ee-ae5e-1e784f2b7d87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:23:26.081613 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d11a0d-ada2-49ee-ae5e-1e784f2b7d87 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:23:26.153032 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec851ba3-ff20-4e8b-a562-c7dcd7d95e29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f44bfdd5214e8d84a2c0a5b1fd9b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:23:26.153628 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec851ba3-ff20-4e8b-a562-c7dcd7d95e29 service neutron] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:23:26.153913 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec851ba3-ff20-4e8b-a562-c7dcd7d95e29 service neutron] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:23:26.154184 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec851ba3-ff20-4e8b-a562-c7dcd7d95e29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:23:26.155793 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-ec851ba3-ff20-4e8b-a562-c7dcd7d95e29 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:23:26.163068 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:23:26.262286 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec851ba3-ff20-4e8b-a562-c7dcd7d95e29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:23:26.263669 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec851ba3-ff20-4e8b-a562-c7dcd7d95e29 service neutron] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:23:26.281177 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 651/1320] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:23:25 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:23:29.036302 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218f91ef-483c-4486-bab5-7a3768d57e6a None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:23:29.036856 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218f91ef-483c-4486-bab5-7a3768d57e6a None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:23:29.036856 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218f91ef-483c-4486-bab5-7a3768d57e6a None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:23:29.038169 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 670/1321] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:23:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:23:29.043424 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da94fc54-724f-43bb-b14a-f287a929de4c None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:23:29.043802 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da94fc54-724f-43bb-b14a-f287a929de4c None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:23:29.043972 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da94fc54-724f-43bb-b14a-f287a929de4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:23:29.115672 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-da94fc54-724f-43bb-b14a-f287a929de4c None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:23:29.116830 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-da94fc54-724f-43bb-b14a-f287a929de4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:23:29.179355 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:23:29.223293 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 652/1322] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:23:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:23:29.507407 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218f91ef-483c-4486-bab5-7a3768d57e6a None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:23:29.508882 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-218f91ef-483c-4486-bab5-7a3768d57e6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:23:29.529300 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:23:29.612425 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218f91ef-483c-4486-bab5-7a3768d57e6a None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:23:29.700220 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ebc995-1c95-4fc6-94d5-517c055c8b67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f44bfdd5214e8d84a2c0a5b1fd9b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:23:29.700891 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ebc995-1c95-4fc6-94d5-517c055c8b67 service neutron] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:23:29.701174 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ebc995-1c95-4fc6-94d5-517c055c8b67 service neutron] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:23:29.701441 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ebc995-1c95-4fc6-94d5-517c055c8b67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:23:29.703074 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-52ebc995-1c95-4fc6-94d5-517c055c8b67 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:23:29.778717 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:23:29.817251 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ebc995-1c95-4fc6-94d5-517c055c8b67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:23:29.818976 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ebc995-1c95-4fc6-94d5-517c055c8b67 service neutron] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:23:29.836589 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 671/1323] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:23:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:23:32.044812 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25717e2-22b1-4000-b8fd-a12304af80d2 None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:23:32.045339 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25717e2-22b1-4000-b8fd-a12304af80d2 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:23:32.045339 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25717e2-22b1-4000-b8fd-a12304af80d2 None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:23:32.046707 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 653/1324] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:23:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:23:32.052545 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78532375-eb47-40df-b12a-7166182bc415 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:23:32.052993 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78532375-eb47-40df-b12a-7166182bc415 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:23:32.053090 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78532375-eb47-40df-b12a-7166182bc415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:23:32.119777 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-78532375-eb47-40df-b12a-7166182bc415 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:23:32.120976 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-78532375-eb47-40df-b12a-7166182bc415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:23:32.224153 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 672/1325] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:23:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:23:32.500063 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25717e2-22b1-4000-b8fd-a12304af80d2 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:23:32.502221 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-c25717e2-22b1-4000-b8fd-a12304af80d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:23:32.605018 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25717e2-22b1-4000-b8fd-a12304af80d2 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:23:32.678505 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd04560-6fcc-45b4-8476-a3970356fdec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f44bfdd5214e8d84a2c0a5b1fd9b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:23:32.679106 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd04560-6fcc-45b4-8476-a3970356fdec service neutron] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:23:32.679377 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd04560-6fcc-45b4-8476-a3970356fdec service neutron] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:23:32.679643 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd04560-6fcc-45b4-8476-a3970356fdec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:23:32.681190 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-dfd04560-6fcc-45b4-8476-a3970356fdec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:23:32.698741 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:23:32.798981 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd04560-6fcc-45b4-8476-a3970356fdec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:23:32.800275 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd04560-6fcc-45b4-8476-a3970356fdec service neutron] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:23:32.818717 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 654/1326] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:23:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:23:35.034179 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c5ffef-1302-45a1-bb53-625d7d916386 None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:23:35.034736 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c5ffef-1302-45a1-bb53-625d7d916386 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:23:35.034837 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c5ffef-1302-45a1-bb53-625d7d916386 None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:23:35.036373 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 673/1327] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:23:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:23:35.041506 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1282a392-22e0-4be5-9fed-1fe8eade05e0 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:23:35.041920 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1282a392-22e0-4be5-9fed-1fe8eade05e0 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:23:35.042061 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1282a392-22e0-4be5-9fed-1fe8eade05e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:23:35.113617 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-1282a392-22e0-4be5-9fed-1fe8eade05e0 None None] MFA Rules not processed for user `f918acce5260406e8053172ddbf5a1fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:23:35.114907 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-1282a392-22e0-4be5-9fed-1fe8eade05e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:23:35.188721 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:23:35.225199 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 655/1328] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:23:35 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:23:35.511298 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c5ffef-1302-45a1-bb53-625d7d916386 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:23:35.512820 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-d6c5ffef-1302-45a1-bb53-625d7d916386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:23:35.554443 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:23:35.635118 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c5ffef-1302-45a1-bb53-625d7d916386 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:23:35.709592 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dc3e2d-15a9-473a-9afb-a1c14709ce9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f44bfdd5214e8d84a2c0a5b1fd9b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:23:35.710193 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dc3e2d-15a9-473a-9afb-a1c14709ce9a service neutron] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:23:35.710500 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dc3e2d-15a9-473a-9afb-a1c14709ce9a service neutron] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:23:35.710767 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dc3e2d-15a9-473a-9afb-a1c14709ce9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:23:35.712340 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-84dc3e2d-15a9-473a-9afb-a1c14709ce9a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:23:35.795372 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:23:35.835026 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dc3e2d-15a9-473a-9afb-a1c14709ce9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:23:35.836782 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dc3e2d-15a9-473a-9afb-a1c14709ce9a service neutron] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:23:35.856799 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 674/1329] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:23:35 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:23:38.259148 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709dd1a4-90be-4f7c-8ec2-05d796e8add6 None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:23:38.259714 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709dd1a4-90be-4f7c-8ec2-05d796e8add6 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:23:38.259714 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709dd1a4-90be-4f7c-8ec2-05d796e8add6 None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:23:38.261007 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 656/1330] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:23:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:23:38.266581 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc132883-4be4-492f-a126-9501fd6e32e3 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:23:38.267114 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc132883-4be4-492f-a126-9501fd6e32e3 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:23:38.267590 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc132883-4be4-492f-a126-9501fd6e32e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:23:38.335863 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-dc132883-4be4-492f-a126-9501fd6e32e3 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:23:38.337075 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-dc132883-4be4-492f-a126-9501fd6e32e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:23:38.435976 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 675/1331] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:23:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:23:38.730357 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709dd1a4-90be-4f7c-8ec2-05d796e8add6 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:23:38.732385 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-709dd1a4-90be-4f7c-8ec2-05d796e8add6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:23:38.839687 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709dd1a4-90be-4f7c-8ec2-05d796e8add6 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:23:38.914060 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0377128-4e90-400f-8317-a4043ae0eff7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f44bfdd5214e8d84a2c0a5b1fd9b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:23:38.914692 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0377128-4e90-400f-8317-a4043ae0eff7 service neutron] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:23:38.914973 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0377128-4e90-400f-8317-a4043ae0eff7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:23:38.915244 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0377128-4e90-400f-8317-a4043ae0eff7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:23:38.916819 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-a0377128-4e90-400f-8317-a4043ae0eff7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:23:38.943470 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:23:39.023775 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0377128-4e90-400f-8317-a4043ae0eff7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:23:39.025137 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0377128-4e90-400f-8317-a4043ae0eff7 service neutron] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:23:39.042736 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 657/1332] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:23:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:23:41.235702 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0557747c-aace-46ea-8201-3e3557134c69 None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:23:41.236759 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0557747c-aace-46ea-8201-3e3557134c69 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:23:41.236890 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0557747c-aace-46ea-8201-3e3557134c69 None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:23:41.238326 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 676/1333] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:23:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:23:41.243780 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53262f40-d5a6-4455-9915-1f7b9cb8a201 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:23:41.244173 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53262f40-d5a6-4455-9915-1f7b9cb8a201 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:23:41.244363 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53262f40-d5a6-4455-9915-1f7b9cb8a201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:23:41.311610 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-53262f40-d5a6-4455-9915-1f7b9cb8a201 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:23:41.312801 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-53262f40-d5a6-4455-9915-1f7b9cb8a201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:23:41.384514 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:23:41.405976 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 658/1334] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:23:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 16:23:41.702014 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0557747c-aace-46ea-8201-3e3557134c69 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:23:41.703558 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-0557747c-aace-46ea-8201-3e3557134c69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:23:41.743723 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:23:41.811540 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0557747c-aace-46ea-8201-3e3557134c69 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:23:41.883499 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22b18eb-879b-4fbc-b8b4-5a2b9650330d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f44bfdd5214e8d84a2c0a5b1fd9b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:23:41.884100 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22b18eb-879b-4fbc-b8b4-5a2b9650330d service neutron] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:23:41.884377 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22b18eb-879b-4fbc-b8b4-5a2b9650330d service neutron] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:23:41.884644 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22b18eb-879b-4fbc-b8b4-5a2b9650330d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:23:41.886204 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-c22b18eb-879b-4fbc-b8b4-5a2b9650330d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:23:41.967525 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:23:41.992284 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22b18eb-879b-4fbc-b8b4-5a2b9650330d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:23:41.993694 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22b18eb-879b-4fbc-b8b4-5a2b9650330d service neutron] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:23:42.011570 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 677/1335] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:23:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:23:44.462733 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b12e4a-ec6c-48e2-afcf-69b379d1f966 None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:23:44.463355 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b12e4a-ec6c-48e2-afcf-69b379d1f966 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:23:44.463355 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b12e4a-ec6c-48e2-afcf-69b379d1f966 None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:23:44.464600 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 659/1336] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:23:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:23:44.469629 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9fc40c-b345-4ff2-b8cd-d9ea15d361bb None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:23:44.470066 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9fc40c-b345-4ff2-b8cd-d9ea15d361bb None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:23:44.470813 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9fc40c-b345-4ff2-b8cd-d9ea15d361bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:23:44.537353 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-cb9fc40c-b345-4ff2-b8cd-d9ea15d361bb None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:23:44.538525 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-cb9fc40c-b345-4ff2-b8cd-d9ea15d361bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:23:44.633415 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 678/1337] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:23:44 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:23:44.920477 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b12e4a-ec6c-48e2-afcf-69b379d1f966 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:23:44.922020 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-46b12e4a-ec6c-48e2-afcf-69b379d1f966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:23:45.022164 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b12e4a-ec6c-48e2-afcf-69b379d1f966 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:23:45.100994 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7216d513-d95f-4b2f-8053-b6827f738923 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f44bfdd5214e8d84a2c0a5b1fd9b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:23:45.101865 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7216d513-d95f-4b2f-8053-b6827f738923 service neutron] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:23:45.102279 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7216d513-d95f-4b2f-8053-b6827f738923 service neutron] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:23:45.102730 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7216d513-d95f-4b2f-8053-b6827f738923 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:23:45.105198 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-7216d513-d95f-4b2f-8053-b6827f738923 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:23:45.151417 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:23:45.225826 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7216d513-d95f-4b2f-8053-b6827f738923 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:23:45.227283 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7216d513-d95f-4b2f-8053-b6827f738923 service neutron] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:23:45.245666 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 660/1338] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:23:44 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:23:49.320750 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad9de80-e05c-49d8-9bf5-00e2fca1aa14 None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:23:49.321262 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad9de80-e05c-49d8-9bf5-00e2fca1aa14 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:23:49.321376 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad9de80-e05c-49d8-9bf5-00e2fca1aa14 None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:23:49.322685 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 679/1339] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:23:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:23:49.327929 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9c57f8-9aee-4398-aba0-6d1e4066e772 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:23:49.328328 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9c57f8-9aee-4398-aba0-6d1e4066e772 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:23:49.328472 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9c57f8-9aee-4398-aba0-6d1e4066e772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:23:49.394518 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-fb9c57f8-9aee-4398-aba0-6d1e4066e772 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:23:49.395652 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-fb9c57f8-9aee-4398-aba0-6d1e4066e772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:23:49.482681 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:23:49.494761 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 661/1340] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:23:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:23:49.784536 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad9de80-e05c-49d8-9bf5-00e2fca1aa14 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:23:49.786068 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-6ad9de80-e05c-49d8-9bf5-00e2fca1aa14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:23:49.834327 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:23:49.889079 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad9de80-e05c-49d8-9bf5-00e2fca1aa14 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:23:49.963473 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71674b40-f853-4583-8a89-95f5c5b5a2ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f44bfdd5214e8d84a2c0a5b1fd9b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:23:49.964105 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71674b40-f853-4583-8a89-95f5c5b5a2ae service neutron] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:23:49.964383 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71674b40-f853-4583-8a89-95f5c5b5a2ae service neutron] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:23:49.964653 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71674b40-f853-4583-8a89-95f5c5b5a2ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:23:49.966233 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-71674b40-f853-4583-8a89-95f5c5b5a2ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:23:50.057639 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:23:50.074202 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71674b40-f853-4583-8a89-95f5c5b5a2ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:23:50.075669 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71674b40-f853-4583-8a89-95f5c5b5a2ae service neutron] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:23:50.093890 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 680/1341] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:23:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:23:52.929688 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6a3ebb-4697-4c05-9494-9a924db0171c None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:23:52.930214 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6a3ebb-4697-4c05-9494-9a924db0171c None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:23:52.930214 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6a3ebb-4697-4c05-9494-9a924db0171c None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:23:52.931582 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 662/1342] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:23:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:23:52.937031 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3983e0e0-78e5-4500-941c-4a12db76b3b7 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:23:52.937446 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3983e0e0-78e5-4500-941c-4a12db76b3b7 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:23:52.937577 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3983e0e0-78e5-4500-941c-4a12db76b3b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:23:53.006995 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-3983e0e0-78e5-4500-941c-4a12db76b3b7 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:23:53.008204 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-3983e0e0-78e5-4500-941c-4a12db76b3b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:23:53.104658 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 681/1343] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:23:52 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:23:53.407072 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9d5d1a-8127-42bf-91d8-8ca22b64a0a7 None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:23:53.407351 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9d5d1a-8127-42bf-91d8-8ca22b64a0a7 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:23:53.407669 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9d5d1a-8127-42bf-91d8-8ca22b64a0a7 None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:23:53.408996 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 663/1344] 10.222.0.27 () {54 vars in 965 bytes} [Fri Sep 9 16:23:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:23:53.414957 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab06e72-7180-44e5-aa7b-234c522ebd81 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:23:53.415241 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab06e72-7180-44e5-aa7b-234c522ebd81 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:23:53.415514 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab06e72-7180-44e5-aa7b-234c522ebd81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:23:53.488890 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:23:53.498056 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-9ab06e72-7180-44e5-aa7b-234c522ebd81 None None] MFA Rules not processed for user `d5f44bfdd5214e8d84a2c0a5b1fd9b84`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:23:53.499279 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-9ab06e72-7180-44e5-aa7b-234c522ebd81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:23:53.574388 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 682/1345] 10.222.0.27 () {58 vars in 1062 bytes} [Fri Sep 9 16:23:53 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:23:53.583183 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9d5d1a-8127-42bf-91d8-8ca22b64a0a7 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:23:53.584701 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-2d9d5d1a-8127-42bf-91d8-8ca22b64a0a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:23:53.687841 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9d5d1a-8127-42bf-91d8-8ca22b64a0a7 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:23:53.765910 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0e6ea5-f82b-4175-9101-0a65271e613e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f44bfdd5214e8d84a2c0a5b1fd9b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:23:53.766532 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0e6ea5-f82b-4175-9101-0a65271e613e service neutron] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:23:53.766808 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0e6ea5-f82b-4175-9101-0a65271e613e service neutron] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:23:53.767112 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0e6ea5-f82b-4175-9101-0a65271e613e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:23:53.770751 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-9a0e6ea5-f82b-4175-9101-0a65271e613e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:23:53.827405 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:23:53.904138 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0e6ea5-f82b-4175-9101-0a65271e613e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:23:53.905779 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0e6ea5-f82b-4175-9101-0a65271e613e service neutron] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:23:53.926416 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 664/1346] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:23:53 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:23:58.778858 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3621aff8-7284-4bab-9dfe-b34e4500ce6c None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:23:58.779363 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3621aff8-7284-4bab-9dfe-b34e4500ce6c None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:23:58.779452 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3621aff8-7284-4bab-9dfe-b34e4500ce6c None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:23:58.780768 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 683/1347] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:23:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:23:58.785925 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3204e1e8-392e-453a-b713-e69a3eb02990 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:23:58.786371 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3204e1e8-392e-453a-b713-e69a3eb02990 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:23:58.786521 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3204e1e8-392e-453a-b713-e69a3eb02990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:23:58.855629 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-3204e1e8-392e-453a-b713-e69a3eb02990 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:23:58.856939 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-3204e1e8-392e-453a-b713-e69a3eb02990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:23:58.960387 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:23:58.963476 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 665/1348] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:23:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:23:59.245798 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3621aff8-7284-4bab-9dfe-b34e4500ce6c None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:23:59.247394 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-3621aff8-7284-4bab-9dfe-b34e4500ce6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:23:59.349272 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3621aff8-7284-4bab-9dfe-b34e4500ce6c None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:23:59.395078 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:23:59.420197 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daca2a5-724d-4db8-8a21-95c558752096 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f44bfdd5214e8d84a2c0a5b1fd9b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:23:59.420795 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daca2a5-724d-4db8-8a21-95c558752096 service neutron] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:23:59.421067 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daca2a5-724d-4db8-8a21-95c558752096 service neutron] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:23:59.421329 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daca2a5-724d-4db8-8a21-95c558752096 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:23:59.422904 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-4daca2a5-724d-4db8-8a21-95c558752096 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:23:59.530075 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daca2a5-724d-4db8-8a21-95c558752096 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:23:59.531529 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daca2a5-724d-4db8-8a21-95c558752096 service neutron] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:23:59.549760 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 684/1349] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:23:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:24:04.542154 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723bc2f4-98d0-4ebd-85bc-62c2e727290c None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:24:04.542640 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723bc2f4-98d0-4ebd-85bc-62c2e727290c None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:24:04.542723 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723bc2f4-98d0-4ebd-85bc-62c2e727290c None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:24:04.544196 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 666/1350] 10.222.0.27 () {54 vars in 921 bytes} [Fri Sep 9 16:24:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:24:04.549730 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d737c7af-6c04-44a4-a58d-dec7f322a89c None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:24:04.550604 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d737c7af-6c04-44a4-a58d-dec7f322a89c None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:24:04.551237 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d737c7af-6c04-44a4-a58d-dec7f322a89c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:24:04.692002 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-d737c7af-6c04-44a4-a58d-dec7f322a89c None None] MFA Rules not processed for user `2d73df92393c43b2b5ccc32a2d43d952`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:24:04.693491 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-d737c7af-6c04-44a4-a58d-dec7f322a89c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:24:04.718173 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:24:04.834419 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 685/1351] 10.222.0.27 () {58 vars in 1018 bytes} [Fri Sep 9 16:24:04 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:24:09.105432 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d6d071-880e-4558-856e-d297d0a1b3ad None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:24:09.105946 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d6d071-880e-4558-856e-d297d0a1b3ad None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:24:09.105946 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d6d071-880e-4558-856e-d297d0a1b3ad None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:24:09.107321 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 667/1352] 10.222.0.27 () {54 vars in 921 bytes} [Fri Sep 9 16:24:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:24:09.112787 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc9367b-3bcb-4725-b733-3a5aa849ade2 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:24:09.113221 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc9367b-3bcb-4725-b733-3a5aa849ade2 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:24:09.113318 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc9367b-3bcb-4725-b733-3a5aa849ade2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:24:09.193974 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-4cc9367b-3bcb-4725-b733-3a5aa849ade2 None None] MFA Rules not processed for user `2d73df92393c43b2b5ccc32a2d43d952`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:24:09.195451 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-4cc9367b-3bcb-4725-b733-3a5aa849ade2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:24:09.283557 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:24:09.322604 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 686/1353] 10.222.0.27 () {58 vars in 1018 bytes} [Fri Sep 9 16:24:09 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 16:24:10.498002 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974294df-4c91-4baa-b60a-cf2a5341b225 None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:24:10.498625 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974294df-4c91-4baa-b60a-cf2a5341b225 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:24:10.498731 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974294df-4c91-4baa-b60a-cf2a5341b225 None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:24:10.500005 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 668/1354] 10.222.0.27 () {54 vars in 921 bytes} [Fri Sep 9 16:24:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:24:10.505074 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af1a9d8-43d2-4873-9e18-9b1a3719eb72 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:24:10.505465 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af1a9d8-43d2-4873-9e18-9b1a3719eb72 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:24:10.505649 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af1a9d8-43d2-4873-9e18-9b1a3719eb72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:24:10.583642 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-7af1a9d8-43d2-4873-9e18-9b1a3719eb72 None None] MFA Rules not processed for user `2d73df92393c43b2b5ccc32a2d43d952`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:24:10.584738 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-7af1a9d8-43d2-4873-9e18-9b1a3719eb72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:24:10.689519 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 687/1355] 10.222.0.27 () {58 vars in 1018 bytes} [Fri Sep 9 16:24:10 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:24:14.268011 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de744d43-3539-49af-9834-b24ce08b52d5 None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:24:14.268507 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de744d43-3539-49af-9834-b24ce08b52d5 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:24:14.268507 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de744d43-3539-49af-9834-b24ce08b52d5 None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:24:14.270010 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 669/1356] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:24:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:24:14.275330 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2d2336-8dfc-4f95-96ce-e56d52d11159 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:24:14.275755 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2d2336-8dfc-4f95-96ce-e56d52d11159 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:24:14.275881 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2d2336-8dfc-4f95-96ce-e56d52d11159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:24:14.322946 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:24:14.358766 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-bd2d2336-8dfc-4f95-96ce-e56d52d11159 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:24:14.360354 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-bd2d2336-8dfc-4f95-96ce-e56d52d11159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:24:14.461840 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 688/1357] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:24:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:24:14.766705 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2196a19d-8785-42d0-b12c-af83afa9e33d None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:24:14.767911 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2196a19d-8785-42d0-b12c-af83afa9e33d None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:24:14.768570 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2196a19d-8785-42d0-b12c-af83afa9e33d None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:24:14.770527 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 670/1358] 10.222.0.27 () {54 vars in 962 bytes} [Fri Sep 9 16:24:14 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:24:14.783141 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba0301b-74a6-43d0-9459-237e01cc8f29 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:24:14.783446 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba0301b-74a6-43d0-9459-237e01cc8f29 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:24:14.783725 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba0301b-74a6-43d0-9459-237e01cc8f29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:24:14.864246 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-dba0301b-74a6-43d0-9459-237e01cc8f29 None None] MFA Rules not processed for user `a332b9b4980646a3b14633293f77b505`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:24:14.865563 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-dba0301b-74a6-43d0-9459-237e01cc8f29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:24:14.926641 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:24:14.999563 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 689/1359] 10.222.0.27 () {58 vars in 1059 bytes} [Fri Sep 9 16:24:14 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:24:15.007870 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2196a19d-8785-42d0-b12c-af83afa9e33d None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:24:15.009373 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-2196a19d-8785-42d0-b12c-af83afa9e33d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:24:15.174042 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2196a19d-8785-42d0-b12c-af83afa9e33d None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:24:15.252427 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:24:15.296473 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bd78f0-b248-44aa-b823-a5ac9630613c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a332b9b4980646a3b14633293f77b505', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:24:15.297097 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bd78f0-b248-44aa-b823-a5ac9630613c service nova] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:24:15.297348 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bd78f0-b248-44aa-b823-a5ac9630613c service nova] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:24:15.297621 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bd78f0-b248-44aa-b823-a5ac9630613c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:24:15.299739 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-92bd78f0-b248-44aa-b823-a5ac9630613c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:24:15.401844 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bd78f0-b248-44aa-b823-a5ac9630613c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:24:15.403487 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bd78f0-b248-44aa-b823-a5ac9630613c service nova] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:24:15.435508 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 671/1360] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:24:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:24:17.791129 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb44081-4fef-4520-8b26-1810d485dcab None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:24:17.791639 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb44081-4fef-4520-8b26-1810d485dcab None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:24:17.791639 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb44081-4fef-4520-8b26-1810d485dcab None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:24:17.793767 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 690/1361] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:24:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:24:17.803780 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9defebc0-97be-4efb-ad81-ef26dda0d41b None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:24:17.803780 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9defebc0-97be-4efb-ad81-ef26dda0d41b None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:24:17.803780 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9defebc0-97be-4efb-ad81-ef26dda0d41b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:24:17.882867 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-9defebc0-97be-4efb-ad81-ef26dda0d41b None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:24:17.884250 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-9defebc0-97be-4efb-ad81-ef26dda0d41b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:24:17.931976 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:24:17.992507 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 672/1362] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:24:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:24:18.283248 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb44081-4fef-4520-8b26-1810d485dcab None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:24:18.284735 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-deb44081-4fef-4520-8b26-1810d485dcab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:24:18.462451 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb44081-4fef-4520-8b26-1810d485dcab None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:24:18.474114 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:24:18.604859 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3eaf76-08af-4227-80b9-9b7bdddda436 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a332b9b4980646a3b14633293f77b505', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:24:18.605465 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3eaf76-08af-4227-80b9-9b7bdddda436 service nova] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:24:18.605742 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3eaf76-08af-4227-80b9-9b7bdddda436 service nova] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:24:18.606027 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3eaf76-08af-4227-80b9-9b7bdddda436 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:24:18.607743 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-1f3eaf76-08af-4227-80b9-9b7bdddda436 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:24:18.702024 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3eaf76-08af-4227-80b9-9b7bdddda436 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:24:18.703666 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3eaf76-08af-4227-80b9-9b7bdddda436 service nova] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:24:18.722461 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 691/1363] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:24:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:24:21.193403 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb52710b-1f37-4d9e-8107-4080f28e5451 None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:24:21.193962 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb52710b-1f37-4d9e-8107-4080f28e5451 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:24:21.193962 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb52710b-1f37-4d9e-8107-4080f28e5451 None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:24:21.199761 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 673/1364] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:24:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:24:21.201661 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e9b5ed-a729-4334-9a52-f1f87915a88e None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:24:21.202126 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e9b5ed-a729-4334-9a52-f1f87915a88e None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:24:21.202295 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e9b5ed-a729-4334-9a52-f1f87915a88e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:24:21.223865 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:24:21.279909 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-07e9b5ed-a729-4334-9a52-f1f87915a88e None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:24:21.281057 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-07e9b5ed-a729-4334-9a52-f1f87915a88e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:24:21.388589 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 692/1365] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:24:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:24:21.679301 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e4ccec-8497-4732-af50-0245a73a8943 None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:24:21.679666 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e4ccec-8497-4732-af50-0245a73a8943 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:24:21.680039 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e4ccec-8497-4732-af50-0245a73a8943 None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:24:21.681596 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 674/1366] 10.222.0.27 () {54 vars in 962 bytes} [Fri Sep 9 16:24:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:24:21.687079 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9f4ac9-c5cc-4369-ab36-b149aa14e6ff None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:24:21.687366 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9f4ac9-c5cc-4369-ab36-b149aa14e6ff None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:24:21.687638 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9f4ac9-c5cc-4369-ab36-b149aa14e6ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:24:21.766866 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-2b9f4ac9-c5cc-4369-ab36-b149aa14e6ff None None] MFA Rules not processed for user `a332b9b4980646a3b14633293f77b505`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:24:21.768079 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-2b9f4ac9-c5cc-4369-ab36-b149aa14e6ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:24:21.805267 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:24:21.905228 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 693/1367] 10.222.0.27 () {58 vars in 1059 bytes} [Fri Sep 9 16:24:21 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:24:21.908334 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e4ccec-8497-4732-af50-0245a73a8943 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:24:21.910074 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-04e4ccec-8497-4732-af50-0245a73a8943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:24:22.063857 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e4ccec-8497-4732-af50-0245a73a8943 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:24:22.085257 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:24:22.184023 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e769a45-bc45-46c8-a0b1-71c2496a0a20 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a332b9b4980646a3b14633293f77b505', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:24:22.185002 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e769a45-bc45-46c8-a0b1-71c2496a0a20 service nova] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:24:22.185505 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e769a45-bc45-46c8-a0b1-71c2496a0a20 service nova] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:24:22.185974 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e769a45-bc45-46c8-a0b1-71c2496a0a20 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:24:22.187923 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-1e769a45-bc45-46c8-a0b1-71c2496a0a20 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:24:22.298359 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e769a45-bc45-46c8-a0b1-71c2496a0a20 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:24:22.299963 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e769a45-bc45-46c8-a0b1-71c2496a0a20 service nova] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:24:22.318744 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 675/1368] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:24:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:24:22.380761 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9672e5ad-0471-4562-a38c-809890e62832 None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:24:22.381216 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9672e5ad-0471-4562-a38c-809890e62832 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:24:22.381379 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9672e5ad-0471-4562-a38c-809890e62832 None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:24:22.382872 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 694/1369] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:24:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:24:22.388359 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c09a8c-adcc-46ad-9fdd-02594b6f86b4 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:24:22.388864 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c09a8c-adcc-46ad-9fdd-02594b6f86b4 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:24:22.389317 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c09a8c-adcc-46ad-9fdd-02594b6f86b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:24:22.423998 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:24:22.473070 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-b7c09a8c-adcc-46ad-9fdd-02594b6f86b4 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:24:22.474331 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-b7c09a8c-adcc-46ad-9fdd-02594b6f86b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:24:22.595946 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 676/1370] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:24:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:24:22.936864 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff63179-3cfb-4337-9b6e-0dd21cd37a37 None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:24:22.936864 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff63179-3cfb-4337-9b6e-0dd21cd37a37 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:24:22.936864 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff63179-3cfb-4337-9b6e-0dd21cd37a37 None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:24:22.937964 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 695/1371] 10.222.0.27 () {54 vars in 964 bytes} [Fri Sep 9 16:24:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:24:22.943410 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19f9dfc-54a2-4ef6-a1fd-bc291e8bbd6c None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:24:22.943802 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19f9dfc-54a2-4ef6-a1fd-bc291e8bbd6c None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:24:22.943959 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19f9dfc-54a2-4ef6-a1fd-bc291e8bbd6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:24:23.023395 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-b19f9dfc-54a2-4ef6-a1fd-bc291e8bbd6c None None] MFA Rules not processed for user `8078e791ba68460f8b3aeafb4b79b73a`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:24:23.024605 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-b19f9dfc-54a2-4ef6-a1fd-bc291e8bbd6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:24:23.074557 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:24:23.111210 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 677/1372] 10.222.0.27 () {58 vars in 1061 bytes} [Fri Sep 9 16:24:22 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:24:23.118571 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff63179-3cfb-4337-9b6e-0dd21cd37a37 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:24:23.120192 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-0ff63179-3cfb-4337-9b6e-0dd21cd37a37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:24:23.230767 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff63179-3cfb-4337-9b6e-0dd21cd37a37 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:24:23.283459 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:24:23.324993 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf04fdb9-6ead-4900-9ebc-dd22413f80f1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8078e791ba68460f8b3aeafb4b79b73a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:24:23.325838 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf04fdb9-6ead-4900-9ebc-dd22413f80f1 service cinder] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:24:23.326119 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf04fdb9-6ead-4900-9ebc-dd22413f80f1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:24:23.326408 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf04fdb9-6ead-4900-9ebc-dd22413f80f1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:24:23.328001 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-bf04fdb9-6ead-4900-9ebc-dd22413f80f1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:24:23.471360 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf04fdb9-6ead-4900-9ebc-dd22413f80f1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:24:23.473291 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf04fdb9-6ead-4900-9ebc-dd22413f80f1 service cinder] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:24:23.500405 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 696/1373] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:24:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:24:24.563352 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81cfbca-d520-4838-83a2-4375d75595cd None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:24:24.563913 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81cfbca-d520-4838-83a2-4375d75595cd None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:24:24.563913 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81cfbca-d520-4838-83a2-4375d75595cd None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:24:24.565264 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 678/1374] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:24:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:24:24.570926 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9f722d-d316-4849-ac30-dd36fff52615 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:24:24.571323 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9f722d-d316-4849-ac30-dd36fff52615 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:24:24.571465 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9f722d-d316-4849-ac30-dd36fff52615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:24:24.637536 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-dc9f722d-d316-4849-ac30-dd36fff52615 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:24:24.638758 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-dc9f722d-d316-4849-ac30-dd36fff52615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:24:24.660283 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:24:24.736564 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 697/1375] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:24:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:24:25.036534 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81cfbca-d520-4838-83a2-4375d75595cd None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:24:25.038209 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-b81cfbca-d520-4838-83a2-4375d75595cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:24:25.195061 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81cfbca-d520-4838-83a2-4375d75595cd None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:24:25.259020 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:24:25.325312 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f20bab2-0ed1-4ef5-a7ea-bc9942a794b2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a332b9b4980646a3b14633293f77b505', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:24:25.325913 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f20bab2-0ed1-4ef5-a7ea-bc9942a794b2 service nova] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:24:25.326186 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f20bab2-0ed1-4ef5-a7ea-bc9942a794b2 service nova] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:24:25.326607 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f20bab2-0ed1-4ef5-a7ea-bc9942a794b2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:24:25.328176 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-7f20bab2-0ed1-4ef5-a7ea-bc9942a794b2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:24:25.420852 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f20bab2-0ed1-4ef5-a7ea-bc9942a794b2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:24:25.422645 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f20bab2-0ed1-4ef5-a7ea-bc9942a794b2 service nova] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:24:25.442536 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 679/1376] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:24:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:24:27.650960 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91548d62-a7e2-4dd7-a8f7-a32a2320e2ce None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:24:27.651476 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91548d62-a7e2-4dd7-a8f7-a32a2320e2ce None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:24:27.651476 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91548d62-a7e2-4dd7-a8f7-a32a2320e2ce None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:24:27.652915 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 698/1377] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:24:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:24:27.658508 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ed0fde-aba4-4328-85e4-aaa20029109d None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:24:27.658891 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ed0fde-aba4-4328-85e4-aaa20029109d None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:24:27.659055 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ed0fde-aba4-4328-85e4-aaa20029109d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:24:27.727601 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-e3ed0fde-aba4-4328-85e4-aaa20029109d None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:24:27.728838 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-e3ed0fde-aba4-4328-85e4-aaa20029109d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:24:27.738769 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:24:27.838746 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 680/1378] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:24:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:24:28.136797 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91548d62-a7e2-4dd7-a8f7-a32a2320e2ce None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:24:28.138467 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-91548d62-a7e2-4dd7-a8f7-a32a2320e2ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:24:28.299591 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91548d62-a7e2-4dd7-a8f7-a32a2320e2ce None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:24:28.303568 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:24:28.418406 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08abd990-1f29-4fb4-8896-a69398cc52d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a332b9b4980646a3b14633293f77b505', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:24:28.419011 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08abd990-1f29-4fb4-8896-a69398cc52d9 service nova] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:24:28.419299 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08abd990-1f29-4fb4-8896-a69398cc52d9 service nova] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:24:28.419567 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08abd990-1f29-4fb4-8896-a69398cc52d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:24:28.421117 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-08abd990-1f29-4fb4-8896-a69398cc52d9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:24:28.515954 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08abd990-1f29-4fb4-8896-a69398cc52d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:24:28.518270 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08abd990-1f29-4fb4-8896-a69398cc52d9 service nova] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:24:28.539093 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 699/1379] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:24:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:24:30.755498 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c46e444-e049-44a4-bfb9-8cbf2db31e5a None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:24:30.755957 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c46e444-e049-44a4-bfb9-8cbf2db31e5a None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:24:30.756041 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c46e444-e049-44a4-bfb9-8cbf2db31e5a None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:24:30.757366 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 681/1380] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:24:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:24:30.762531 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d445c951-68c3-4672-bfb1-ca549926c69a None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:24:30.762951 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d445c951-68c3-4672-bfb1-ca549926c69a None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:24:30.763054 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d445c951-68c3-4672-bfb1-ca549926c69a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:24:30.776456 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:24:30.847707 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-d445c951-68c3-4672-bfb1-ca549926c69a None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:24:30.849600 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-d445c951-68c3-4672-bfb1-ca549926c69a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:24:30.981735 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 700/1381] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:24:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:24:31.269155 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c46e444-e049-44a4-bfb9-8cbf2db31e5a None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:24:31.270705 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-3c46e444-e049-44a4-bfb9-8cbf2db31e5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:24:31.412114 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:24:31.422873 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c46e444-e049-44a4-bfb9-8cbf2db31e5a None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:24:31.549158 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565531ef-e723-4a02-b09c-70a054a6d250 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a332b9b4980646a3b14633293f77b505', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:24:31.549704 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565531ef-e723-4a02-b09c-70a054a6d250 service nova] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:24:31.549925 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565531ef-e723-4a02-b09c-70a054a6d250 service nova] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:24:31.550192 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565531ef-e723-4a02-b09c-70a054a6d250 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:24:31.551804 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-565531ef-e723-4a02-b09c-70a054a6d250 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:24:31.659424 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565531ef-e723-4a02-b09c-70a054a6d250 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:24:31.661464 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565531ef-e723-4a02-b09c-70a054a6d250 service nova] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:24:31.674220 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:24:31.684797 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 682/1382] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:24:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:24:33.946648 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07012c15-b026-4f0f-a611-7a9358279d8a None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:24:33.947179 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07012c15-b026-4f0f-a611-7a9358279d8a None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:24:33.947382 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07012c15-b026-4f0f-a611-7a9358279d8a None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:24:33.949084 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 701/1383] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:24:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:24:33.955063 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d697c77-2db0-4fa2-bdec-872b7459f7f2 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:24:33.955541 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d697c77-2db0-4fa2-bdec-872b7459f7f2 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:24:33.955639 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d697c77-2db0-4fa2-bdec-872b7459f7f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:24:34.021408 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-6d697c77-2db0-4fa2-bdec-872b7459f7f2 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:24:34.022573 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-6d697c77-2db0-4fa2-bdec-872b7459f7f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:24:34.130171 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 683/1384] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:24:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:24:34.424679 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07012c15-b026-4f0f-a611-7a9358279d8a None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:24:34.426664 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-07012c15-b026-4f0f-a611-7a9358279d8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:24:34.518708 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:24:34.581284 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07012c15-b026-4f0f-a611-7a9358279d8a None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:24:34.696139 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387253eb-aef6-4885-a5dc-48e392cae2c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a332b9b4980646a3b14633293f77b505', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:24:34.696758 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387253eb-aef6-4885-a5dc-48e392cae2c9 service nova] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:24:34.697033 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387253eb-aef6-4885-a5dc-48e392cae2c9 service nova] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:24:34.697300 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387253eb-aef6-4885-a5dc-48e392cae2c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:24:34.698956 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-387253eb-aef6-4885-a5dc-48e392cae2c9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:24:34.751437 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:24:34.792200 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387253eb-aef6-4885-a5dc-48e392cae2c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:24:34.793843 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387253eb-aef6-4885-a5dc-48e392cae2c9 service nova] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:24:34.812612 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 702/1385] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:24:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:24:37.053317 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c86fb61-5340-4f2a-aaa2-f33a69c8e081 None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:24:37.053854 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c86fb61-5340-4f2a-aaa2-f33a69c8e081 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:24:37.053948 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c86fb61-5340-4f2a-aaa2-f33a69c8e081 None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:24:37.055306 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 684/1386] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:24:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:24:37.061455 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bed1336-bbc2-46ec-b7e8-6a782ea4f19f None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:24:37.061985 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bed1336-bbc2-46ec-b7e8-6a782ea4f19f None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:24:37.061985 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bed1336-bbc2-46ec-b7e8-6a782ea4f19f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:24:37.137619 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-5bed1336-bbc2-46ec-b7e8-6a782ea4f19f None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:24:37.138849 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-5bed1336-bbc2-46ec-b7e8-6a782ea4f19f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:24:37.237065 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 703/1387] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:24:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:24:37.531667 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c86fb61-5340-4f2a-aaa2-f33a69c8e081 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:24:37.533216 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-0c86fb61-5340-4f2a-aaa2-f33a69c8e081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:24:37.616756 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:24:37.700631 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c86fb61-5340-4f2a-aaa2-f33a69c8e081 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:24:37.817063 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330cffa7-bf47-4b86-ac4d-93d1eb6d7370 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a332b9b4980646a3b14633293f77b505', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:24:37.817589 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330cffa7-bf47-4b86-ac4d-93d1eb6d7370 service nova] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:24:37.817864 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330cffa7-bf47-4b86-ac4d-93d1eb6d7370 service nova] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:24:37.818117 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330cffa7-bf47-4b86-ac4d-93d1eb6d7370 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:24:37.819955 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-330cffa7-bf47-4b86-ac4d-93d1eb6d7370 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:24:37.858756 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:24:37.910176 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330cffa7-bf47-4b86-ac4d-93d1eb6d7370 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:24:37.911785 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330cffa7-bf47-4b86-ac4d-93d1eb6d7370 service nova] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:24:37.929744 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 685/1388] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:24:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:24:40.141774 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa356ad-1644-4ca2-8947-dc8fa4a9a966 None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:24:40.142374 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa356ad-1644-4ca2-8947-dc8fa4a9a966 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:24:40.142374 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa356ad-1644-4ca2-8947-dc8fa4a9a966 None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:24:40.143674 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 704/1389] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:24:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:24:40.150897 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b5d2b3-52c1-47c8-9623-e5b0fb7c753b None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:24:40.151386 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b5d2b3-52c1-47c8-9623-e5b0fb7c753b None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:24:40.151484 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b5d2b3-52c1-47c8-9623-e5b0fb7c753b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:24:40.219560 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-62b5d2b3-52c1-47c8-9623-e5b0fb7c753b None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:24:40.220752 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-62b5d2b3-52c1-47c8-9623-e5b0fb7c753b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:24:40.322906 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 686/1390] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:24:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 16:24:40.634792 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa356ad-1644-4ca2-8947-dc8fa4a9a966 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:24:40.636323 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-daa356ad-1644-4ca2-8947-dc8fa4a9a966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:24:40.670104 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:24:40.826496 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa356ad-1644-4ca2-8947-dc8fa4a9a966 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:24:40.928317 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:24:40.940295 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d8a48e-4a83-43e5-b96a-46d0aa5531a0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a332b9b4980646a3b14633293f77b505', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:24:40.940892 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d8a48e-4a83-43e5-b96a-46d0aa5531a0 service nova] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:24:40.941190 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d8a48e-4a83-43e5-b96a-46d0aa5531a0 service nova] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:24:40.941458 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d8a48e-4a83-43e5-b96a-46d0aa5531a0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:24:40.943115 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-e1d8a48e-4a83-43e5-b96a-46d0aa5531a0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:24:41.036697 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d8a48e-4a83-43e5-b96a-46d0aa5531a0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:24:41.038295 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d8a48e-4a83-43e5-b96a-46d0aa5531a0 service nova] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:24:41.055990 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 705/1391] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:24:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:24:41.105766 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2af82e7-4359-4e4e-95b7-aade1b698af0 None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:24:41.106121 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2af82e7-4359-4e4e-95b7-aade1b698af0 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:24:41.106519 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2af82e7-4359-4e4e-95b7-aade1b698af0 None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:24:41.107902 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 687/1392] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:24:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:24:41.114363 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83263c66-8c56-4dde-8e3c-9f57abebc972 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:24:41.117745 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83263c66-8c56-4dde-8e3c-9f57abebc972 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:24:41.117745 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83263c66-8c56-4dde-8e3c-9f57abebc972 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:24:41.193492 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-83263c66-8c56-4dde-8e3c-9f57abebc972 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:24:41.194911 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-83263c66-8c56-4dde-8e3c-9f57abebc972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:24:41.260727 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:24:41.303289 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 706/1393] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:24:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:24:41.602560 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecf122b-df71-4194-9261-46bec2273312 None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:24:41.603058 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecf122b-df71-4194-9261-46bec2273312 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:24:41.603161 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecf122b-df71-4194-9261-46bec2273312 None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:24:41.604467 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 688/1394] 10.222.0.27 () {54 vars in 966 bytes} [Fri Sep 9 16:24:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:24:41.609664 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4498afa-5257-43bd-b53b-66af4d3b5b8a None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:24:41.610514 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4498afa-5257-43bd-b53b-66af4d3b5b8a None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:24:41.610780 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4498afa-5257-43bd-b53b-66af4d3b5b8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:24:41.689525 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-c4498afa-5257-43bd-b53b-66af4d3b5b8a None None] MFA Rules not processed for user `3ddd42508eee4412ae139cb8526090d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:24:41.690755 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-c4498afa-5257-43bd-b53b-66af4d3b5b8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:24:41.769729 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 707/1395] 10.222.0.27 () {58 vars in 1063 bytes} [Fri Sep 9 16:24:41 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 16:24:41.778711 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecf122b-df71-4194-9261-46bec2273312 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:24:41.780193 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-7ecf122b-df71-4194-9261-46bec2273312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:24:41.794253 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:24:41.887111 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecf122b-df71-4194-9261-46bec2273312 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:24:41.960013 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223df11a-2828-4cc7-8a32-955b72a93012 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ddd42508eee4412ae139cb8526090d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:24:41.960635 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223df11a-2828-4cc7-8a32-955b72a93012 service glance] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:24:41.960907 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223df11a-2828-4cc7-8a32-955b72a93012 service glance] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:24:41.961171 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223df11a-2828-4cc7-8a32-955b72a93012 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:24:41.962879 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-223df11a-2828-4cc7-8a32-955b72a93012 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:24:42.032894 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:24:42.073907 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223df11a-2828-4cc7-8a32-955b72a93012 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:24:42.075482 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223df11a-2828-4cc7-8a32-955b72a93012 service glance] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:24:42.096650 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 689/1396] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:24:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:24:42.840675 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7995218d-be58-4fbd-a5cb-c9203827c710 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:24:42.841161 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7995218d-be58-4fbd-a5cb-c9203827c710 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:24:42.841271 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7995218d-be58-4fbd-a5cb-c9203827c710 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:24:42.910763 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-7995218d-be58-4fbd-a5cb-c9203827c710 None None] MFA Rules not processed for user `b9d05f3782d24127aa613c8d7ac8041b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:24:42.911953 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-7995218d-be58-4fbd-a5cb-c9203827c710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:24:42.920240 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:24:42.999997 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 708/1397] 10.222.0.27 () {58 vars in 1009 bytes} [Fri Sep 9 16:24:42 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:24:43.045317 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dc7616-8c3c-49a2-ac88-37258db21d73 None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:24:43.045868 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dc7616-8c3c-49a2-ac88-37258db21d73 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:24:43.045868 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dc7616-8c3c-49a2-ac88-37258db21d73 None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:24:43.047776 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 690/1398] 10.222.0.27 () {54 vars in 943 bytes} [Fri Sep 9 16:24:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:24:43.054253 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2c3964-dd96-4993-be6c-429162515749 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:24:43.054570 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2c3964-dd96-4993-be6c-429162515749 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:24:43.054842 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2c3964-dd96-4993-be6c-429162515749 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:24:43.131261 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-9c2c3964-dd96-4993-be6c-429162515749 None None] MFA Rules not processed for user `a2350bbc4a194c2dab2e3be830fd0eba`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:24:43.132375 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-9c2c3964-dd96-4993-be6c-429162515749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:24:43.223436 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:24:43.247400 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 709/1399] 10.222.0.27 () {58 vars in 1040 bytes} [Fri Sep 9 16:24:43 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:24:43.257649 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dc7616-8c3c-49a2-ac88-37258db21d73 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:24:43.259219 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-e0dc7616-8c3c-49a2-ac88-37258db21d73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:24:43.264102 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60192ba2-fcca-48dd-ac51-c8740473f7c7 None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:24:43.264415 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60192ba2-fcca-48dd-ac51-c8740473f7c7 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:24:43.264689 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60192ba2-fcca-48dd-ac51-c8740473f7c7 None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:24:43.266021 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 710/1400] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:24:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:24:43.271011 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecbc52d-7826-46d8-b9f6-4fbfbcd37fc6 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:24:43.271298 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecbc52d-7826-46d8-b9f6-4fbfbcd37fc6 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:24:43.271570 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecbc52d-7826-46d8-b9f6-4fbfbcd37fc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:24:43.345884 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-fecbc52d-7826-46d8-b9f6-4fbfbcd37fc6 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:24:43.347106 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-fecbc52d-7826-46d8-b9f6-4fbfbcd37fc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:24:43.400857 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dc7616-8c3c-49a2-ac88-37258db21d73 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:24:43.437615 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:24:43.445661 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 711/1401] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:24:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 16:24:43.504402 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef904786-10d7-4c89-a202-1e5e84d693aa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2350bbc4a194c2dab2e3be830fd0eba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:24:43.504996 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef904786-10d7-4c89-a202-1e5e84d693aa service swift] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:24:43.505268 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef904786-10d7-4c89-a202-1e5e84d693aa service swift] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:24:43.505536 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef904786-10d7-4c89-a202-1e5e84d693aa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:24:43.507165 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-ef904786-10d7-4c89-a202-1e5e84d693aa service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:24:43.590935 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef904786-10d7-4c89-a202-1e5e84d693aa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:24:43.592526 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef904786-10d7-4c89-a202-1e5e84d693aa service swift] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:24:43.601168 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 691/1402] 10.222.0.27 () {60 vars in 1384 bytes} [Fri Sep 9 16:24:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 09 16:24:43.746876 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecbc52d-7826-46d8-b9f6-4fbfbcd37fc6 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:24:43.748844 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-fecbc52d-7826-46d8-b9f6-4fbfbcd37fc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:24:43.824426 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:24:43.880572 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecbc52d-7826-46d8-b9f6-4fbfbcd37fc6 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:24:44.012856 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab54cf3-2017-4801-845e-e94f46f91795 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a332b9b4980646a3b14633293f77b505', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:24:44.013448 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab54cf3-2017-4801-845e-e94f46f91795 service nova] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:24:44.013724 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab54cf3-2017-4801-845e-e94f46f91795 service nova] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:24:44.013988 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab54cf3-2017-4801-845e-e94f46f91795 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:24:44.016041 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-3ab54cf3-2017-4801-845e-e94f46f91795 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:24:44.082248 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:24:44.117411 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab54cf3-2017-4801-845e-e94f46f91795 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:24:44.119070 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab54cf3-2017-4801-845e-e94f46f91795 service nova] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:24:44.138282 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 712/1403] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:24:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:24:46.366720 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d68ac2-3821-48e5-8f90-e8dcf1c44aa6 None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:24:46.367261 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d68ac2-3821-48e5-8f90-e8dcf1c44aa6 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:24:46.367261 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d68ac2-3821-48e5-8f90-e8dcf1c44aa6 None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:24:46.368508 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 692/1404] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:24:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:24:46.373765 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676d22f7-b443-4895-baa9-bca52abe32c0 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:24:46.374178 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676d22f7-b443-4895-baa9-bca52abe32c0 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:24:46.374333 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676d22f7-b443-4895-baa9-bca52abe32c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:24:46.448055 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-676d22f7-b443-4895-baa9-bca52abe32c0 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:24:46.450546 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-676d22f7-b443-4895-baa9-bca52abe32c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:24:46.560993 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 713/1405] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:24:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:24:46.848955 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d68ac2-3821-48e5-8f90-e8dcf1c44aa6 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:24:46.850672 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-f6d68ac2-3821-48e5-8f90-e8dcf1c44aa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:24:46.947223 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:24:47.032687 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d68ac2-3821-48e5-8f90-e8dcf1c44aa6 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:24:47.160246 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95d5334-bad0-44a7-aeeb-b2f32b259650 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a332b9b4980646a3b14633293f77b505', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:24:47.161259 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95d5334-bad0-44a7-aeeb-b2f32b259650 service nova] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:24:47.161595 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95d5334-bad0-44a7-aeeb-b2f32b259650 service nova] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:24:47.161920 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95d5334-bad0-44a7-aeeb-b2f32b259650 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:24:47.163527 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-d95d5334-bad0-44a7-aeeb-b2f32b259650 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:24:47.202749 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:24:47.273696 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95d5334-bad0-44a7-aeeb-b2f32b259650 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:24:47.275464 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95d5334-bad0-44a7-aeeb-b2f32b259650 service nova] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:24:47.299376 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 693/1406] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:24:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:24:49.534930 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d27bc3-033b-4605-bb94-1ac31af5bad8 None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:24:49.535502 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d27bc3-033b-4605-bb94-1ac31af5bad8 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:24:49.535502 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d27bc3-033b-4605-bb94-1ac31af5bad8 None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:24:49.536886 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 714/1407] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:24:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:24:49.542599 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31083824-adfd-4621-97fc-9c889a464885 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:24:49.543002 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31083824-adfd-4621-97fc-9c889a464885 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:24:49.543085 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31083824-adfd-4621-97fc-9c889a464885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:24:49.613657 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-31083824-adfd-4621-97fc-9c889a464885 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:24:49.614906 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-31083824-adfd-4621-97fc-9c889a464885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:24:49.723978 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 694/1408] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:24:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:24:50.022086 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d27bc3-033b-4605-bb94-1ac31af5bad8 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:24:50.024263 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-f4d27bc3-033b-4605-bb94-1ac31af5bad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:24:50.068788 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:24:50.191511 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d27bc3-033b-4605-bb94-1ac31af5bad8 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:24:50.311524 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:24:50.317430 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25d1552-f263-4451-9d6e-5d34af86476a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a332b9b4980646a3b14633293f77b505', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:24:50.318040 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25d1552-f263-4451-9d6e-5d34af86476a service nova] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:24:50.318350 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25d1552-f263-4451-9d6e-5d34af86476a service nova] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:24:50.318627 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25d1552-f263-4451-9d6e-5d34af86476a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:24:50.320475 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-e25d1552-f263-4451-9d6e-5d34af86476a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:24:50.424537 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25d1552-f263-4451-9d6e-5d34af86476a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:24:50.426610 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25d1552-f263-4451-9d6e-5d34af86476a service nova] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:24:50.446035 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 715/1409] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:24:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:24:59.722608 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=97 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:25:00.443322 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=47 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:25:06.322287 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c07944-511c-4e62-9660-f2e97251179e None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:25:06.322836 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c07944-511c-4e62-9660-f2e97251179e None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:25:06.322836 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c07944-511c-4e62-9660-f2e97251179e None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:25:06.324107 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 695/1410] 10.222.0.27 () {54 vars in 918 bytes} [Fri Sep 9 16:25:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:25:06.329786 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bbc7d8-dcb8-435c-85af-0c39a30aedbd None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:25:06.330223 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bbc7d8-dcb8-435c-85af-0c39a30aedbd None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:25:06.330345 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bbc7d8-dcb8-435c-85af-0c39a30aedbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:25:06.403908 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-02bbc7d8-dcb8-435c-85af-0c39a30aedbd None None] MFA Rules not processed for user `2d73df92393c43b2b5ccc32a2d43d952`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:25:06.405697 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-02bbc7d8-dcb8-435c-85af-0c39a30aedbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:25:06.508663 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 716/1411] 10.222.0.27 () {58 vars in 1015 bytes} [Fri Sep 9 16:25:06 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:25:06.523292 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb07b234-8afc-40e7-af69-49b836b6aaad None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:25:06.523576 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb07b234-8afc-40e7-af69-49b836b6aaad None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:25:06.523853 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb07b234-8afc-40e7-af69-49b836b6aaad None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:25:06.525170 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 696/1412] 10.222.0.27 () {54 vars in 918 bytes} [Fri Sep 9 16:25:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:25:06.530351 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183994ad-9ec2-432f-b459-73da45205ed3 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:25:06.530642 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183994ad-9ec2-432f-b459-73da45205ed3 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:25:06.530940 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183994ad-9ec2-432f-b459-73da45205ed3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:25:06.603175 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:25:06.605976 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-183994ad-9ec2-432f-b459-73da45205ed3 None None] MFA Rules not processed for user `a332b9b4980646a3b14633293f77b505`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:25:06.607915 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-183994ad-9ec2-432f-b459-73da45205ed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:25:06.724883 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 717/1413] 10.222.0.27 () {58 vars in 1015 bytes} [Fri Sep 9 16:25:06 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 16:25:09.288883 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6896f6-58d7-4ab4-9458-81a6373dc587 None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:25:09.289286 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6896f6-58d7-4ab4-9458-81a6373dc587 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:25:09.289417 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6896f6-58d7-4ab4-9458-81a6373dc587 None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:25:09.290795 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 697/1414] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 9 16:25:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:25:09.296110 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875ac4ba-7435-482a-b560-17b8af72c477 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:25:09.296522 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875ac4ba-7435-482a-b560-17b8af72c477 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:25:09.296660 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875ac4ba-7435-482a-b560-17b8af72c477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:25:09.365951 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-875ac4ba-7435-482a-b560-17b8af72c477 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:25:09.367205 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-875ac4ba-7435-482a-b560-17b8af72c477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:25:09.421023 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:25:09.462333 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 718/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 9 16:25:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 16:25:09.756141 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6896f6-58d7-4ab4-9458-81a6373dc587 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:25:09.757810 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-3d6896f6-58d7-4ab4-9458-81a6373dc587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:25:09.902393 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6896f6-58d7-4ab4-9458-81a6373dc587 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:25:09.978879 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:25:10.019120 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89c83fa-bf52-4038-9e48-3caa1644dfab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a332b9b4980646a3b14633293f77b505', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:25:10.019648 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89c83fa-bf52-4038-9e48-3caa1644dfab service nova] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:25:10.019924 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89c83fa-bf52-4038-9e48-3caa1644dfab service nova] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:25:10.020190 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89c83fa-bf52-4038-9e48-3caa1644dfab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:25:10.021776 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-e89c83fa-bf52-4038-9e48-3caa1644dfab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:25:10.110012 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89c83fa-bf52-4038-9e48-3caa1644dfab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:25:10.111647 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89c83fa-bf52-4038-9e48-3caa1644dfab service nova] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:25:10.129348 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 698/1416] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:25:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:25:11.273491 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7a4ad7-f97d-41fb-9be9-8bd90568611e None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:25:11.274023 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7a4ad7-f97d-41fb-9be9-8bd90568611e None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:25:11.274023 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7a4ad7-f97d-41fb-9be9-8bd90568611e None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:25:11.275355 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 719/1417] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 9 16:25:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:25:11.281755 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dca9480-0349-4d25-b286-165314caa850 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:25:11.282200 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dca9480-0349-4d25-b286-165314caa850 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:25:11.282325 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dca9480-0349-4d25-b286-165314caa850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:25:11.380154 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-4dca9480-0349-4d25-b286-165314caa850 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:25:11.381349 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-4dca9480-0349-4d25-b286-165314caa850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:25:11.407636 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:25:11.476456 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 699/1418] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 9 16:25:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:25:11.625476 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7a4ad7-f97d-41fb-9be9-8bd90568611e None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:25:11.627072 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-2d7a4ad7-f97d-41fb-9be9-8bd90568611e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:25:11.777797 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7a4ad7-f97d-41fb-9be9-8bd90568611e None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:25:11.817873 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:25:11.890132 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d692f56e-1a53-4c78-8740-0f92e98bb088 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a332b9b4980646a3b14633293f77b505', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:25:11.890692 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d692f56e-1a53-4c78-8740-0f92e98bb088 service nova] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:25:11.890973 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d692f56e-1a53-4c78-8740-0f92e98bb088 service nova] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:25:11.891241 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d692f56e-1a53-4c78-8740-0f92e98bb088 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:25:11.892817 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-d692f56e-1a53-4c78-8740-0f92e98bb088 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:25:11.981942 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d692f56e-1a53-4c78-8740-0f92e98bb088 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:25:11.984165 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d692f56e-1a53-4c78-8740-0f92e98bb088 service nova] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:25:12.001445 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 720/1419] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:25:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 16:25:13.129236 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2350b1de-d0c5-4c66-bc25-8a16ad9499d2 None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:25:13.129805 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2350b1de-d0c5-4c66-bc25-8a16ad9499d2 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:25:13.129805 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2350b1de-d0c5-4c66-bc25-8a16ad9499d2 None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:25:13.131160 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 700/1420] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 9 16:25:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:25:13.137137 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ecd072-7665-4aee-a02f-2286665b148f None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:25:13.137537 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ecd072-7665-4aee-a02f-2286665b148f None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:25:13.137679 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ecd072-7665-4aee-a02f-2286665b148f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:25:13.192162 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:25:13.214167 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-b1ecd072-7665-4aee-a02f-2286665b148f None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:25:13.215387 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-b1ecd072-7665-4aee-a02f-2286665b148f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:25:13.310551 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 721/1421] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 9 16:25:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:25:13.460414 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2350b1de-d0c5-4c66-bc25-8a16ad9499d2 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:25:13.461854 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-2350b1de-d0c5-4c66-bc25-8a16ad9499d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:25:13.602627 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2350b1de-d0c5-4c66-bc25-8a16ad9499d2 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:25:13.614380 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:25:13.715563 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0329506b-3f52-47ab-8dea-a2caad5b1e33 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a332b9b4980646a3b14633293f77b505', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:25:13.716101 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0329506b-3f52-47ab-8dea-a2caad5b1e33 service nova] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:25:13.716379 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0329506b-3f52-47ab-8dea-a2caad5b1e33 service nova] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:25:13.716644 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0329506b-3f52-47ab-8dea-a2caad5b1e33 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:25:13.718214 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-0329506b-3f52-47ab-8dea-a2caad5b1e33 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:25:13.805597 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0329506b-3f52-47ab-8dea-a2caad5b1e33 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:25:13.807210 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0329506b-3f52-47ab-8dea-a2caad5b1e33 service nova] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:25:13.825428 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 701/1422] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:25:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:25:14.928283 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337c2cd2-403b-4828-9bbe-bfd7d894a0c6 None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:25:14.928706 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337c2cd2-403b-4828-9bbe-bfd7d894a0c6 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:25:14.928846 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337c2cd2-403b-4828-9bbe-bfd7d894a0c6 None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:25:14.930164 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 722/1423] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 9 16:25:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:25:14.936370 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab2247d-0dd6-4127-b227-72d14e37a4e5 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:25:14.936808 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab2247d-0dd6-4127-b227-72d14e37a4e5 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:25:14.936937 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab2247d-0dd6-4127-b227-72d14e37a4e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:25:14.956427 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:25:15.012963 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-bab2247d-0dd6-4127-b227-72d14e37a4e5 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:25:15.014196 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-bab2247d-0dd6-4127-b227-72d14e37a4e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:25:15.107972 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 702/1424] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 9 16:25:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:25:15.255093 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337c2cd2-403b-4828-9bbe-bfd7d894a0c6 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:25:15.256510 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-337c2cd2-403b-4828-9bbe-bfd7d894a0c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:25:15.365760 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:25:15.400912 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337c2cd2-403b-4828-9bbe-bfd7d894a0c6 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:25:15.512269 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29da85d0-055a-4a6e-97bb-d7744fe22fb7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a332b9b4980646a3b14633293f77b505', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:25:15.512826 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29da85d0-055a-4a6e-97bb-d7744fe22fb7 service nova] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:25:15.513109 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29da85d0-055a-4a6e-97bb-d7744fe22fb7 service nova] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:25:15.513868 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29da85d0-055a-4a6e-97bb-d7744fe22fb7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:25:15.515555 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-29da85d0-055a-4a6e-97bb-d7744fe22fb7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:25:15.592426 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:25:15.606185 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29da85d0-055a-4a6e-97bb-d7744fe22fb7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:25:15.607857 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29da85d0-055a-4a6e-97bb-d7744fe22fb7 service nova] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:25:15.625652 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 723/1425] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:25:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:25:16.732774 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e405106-b72f-44ab-acfc-e108ed1fa4f2 None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:25:16.733328 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e405106-b72f-44ab-acfc-e108ed1fa4f2 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:25:16.733328 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e405106-b72f-44ab-acfc-e108ed1fa4f2 None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:25:16.734697 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 703/1426] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 9 16:25:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:25:16.740793 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae662b9-c728-4c30-a9b6-bb489648f2d0 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:25:16.741237 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae662b9-c728-4c30-a9b6-bb489648f2d0 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:25:16.741342 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae662b9-c728-4c30-a9b6-bb489648f2d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:25:16.817487 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-bae662b9-c728-4c30-a9b6-bb489648f2d0 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:25:16.818933 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-bae662b9-c728-4c30-a9b6-bb489648f2d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:25:16.916640 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 724/1427] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 9 16:25:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:25:17.064395 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e405106-b72f-44ab-acfc-e108ed1fa4f2 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:25:17.065937 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-8e405106-b72f-44ab-acfc-e108ed1fa4f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:25:17.149254 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:25:17.211799 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e405106-b72f-44ab-acfc-e108ed1fa4f2 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:25:17.321169 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77cc9df-a5e0-4aaa-b167-a9e1ce863813 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a332b9b4980646a3b14633293f77b505', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:25:17.321764 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77cc9df-a5e0-4aaa-b167-a9e1ce863813 service nova] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:25:17.322037 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77cc9df-a5e0-4aaa-b167-a9e1ce863813 service nova] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:25:17.322326 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77cc9df-a5e0-4aaa-b167-a9e1ce863813 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:25:17.323892 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-a77cc9df-a5e0-4aaa-b167-a9e1ce863813 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:25:17.370861 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:25:17.411209 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77cc9df-a5e0-4aaa-b167-a9e1ce863813 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:25:17.412724 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77cc9df-a5e0-4aaa-b167-a9e1ce863813 service nova] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:25:17.430047 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 704/1428] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:25:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:25:18.482158 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9132fe9b-298b-4675-8b46-a035150f7ce1 None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:25:18.482747 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9132fe9b-298b-4675-8b46-a035150f7ce1 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:25:18.482747 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9132fe9b-298b-4675-8b46-a035150f7ce1 None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:25:18.484138 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 725/1429] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 9 16:25:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:25:18.490277 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb0cdbc-5346-44b7-b1e4-11a95dbaa962 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:25:18.490731 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb0cdbc-5346-44b7-b1e4-11a95dbaa962 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:25:18.490843 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb0cdbc-5346-44b7-b1e4-11a95dbaa962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:25:18.566257 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-abb0cdbc-5346-44b7-b1e4-11a95dbaa962 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:25:18.567408 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-abb0cdbc-5346-44b7-b1e4-11a95dbaa962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:25:18.661125 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 705/1430] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 9 16:25:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:25:18.811543 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9132fe9b-298b-4675-8b46-a035150f7ce1 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:25:18.813051 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-9132fe9b-298b-4675-8b46-a035150f7ce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:25:18.862819 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:25:18.958192 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9132fe9b-298b-4675-8b46-a035150f7ce1 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:25:19.070242 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555eda39-5ff9-462e-b4b4-fc7c6f8f3216 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a332b9b4980646a3b14633293f77b505', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:25:19.070872 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555eda39-5ff9-462e-b4b4-fc7c6f8f3216 service nova] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:25:19.071143 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555eda39-5ff9-462e-b4b4-fc7c6f8f3216 service nova] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:25:19.071411 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555eda39-5ff9-462e-b4b4-fc7c6f8f3216 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:25:19.072970 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-555eda39-5ff9-462e-b4b4-fc7c6f8f3216 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:25:19.080201 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:25:19.162625 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555eda39-5ff9-462e-b4b4-fc7c6f8f3216 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:25:19.164123 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555eda39-5ff9-462e-b4b4-fc7c6f8f3216 service nova] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:25:19.181302 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 726/1431] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:25:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:25:20.253261 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6c03f8-3614-44ce-936f-be12b2156c84 None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:25:20.253803 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6c03f8-3614-44ce-936f-be12b2156c84 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:25:20.253803 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6c03f8-3614-44ce-936f-be12b2156c84 None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:25:20.255174 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 706/1432] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 9 16:25:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:25:20.261311 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3a60df-ee67-4b97-a80c-c02b8d17bff5 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:25:20.261732 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3a60df-ee67-4b97-a80c-c02b8d17bff5 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:25:20.261853 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3a60df-ee67-4b97-a80c-c02b8d17bff5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:25:20.463333 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-8e3a60df-ee67-4b97-a80c-c02b8d17bff5 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:25:20.464535 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-8e3a60df-ee67-4b97-a80c-c02b8d17bff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:25:20.531289 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:25:20.559588 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 727/1433] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 9 16:25:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:25:20.709253 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6c03f8-3614-44ce-936f-be12b2156c84 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:25:20.710808 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-db6c03f8-3614-44ce-936f-be12b2156c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:25:20.728842 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:25:20.855856 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6c03f8-3614-44ce-936f-be12b2156c84 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:25:20.941922 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:25:20.968016 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1343931-f4f9-45e4-92de-c2f2361bb47b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a332b9b4980646a3b14633293f77b505', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:25:20.968657 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1343931-f4f9-45e4-92de-c2f2361bb47b service nova] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:25:20.968934 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1343931-f4f9-45e4-92de-c2f2361bb47b service nova] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:25:20.969201 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1343931-f4f9-45e4-92de-c2f2361bb47b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:25:20.970840 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-b1343931-f4f9-45e4-92de-c2f2361bb47b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:25:21.059020 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1343931-f4f9-45e4-92de-c2f2361bb47b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:25:21.061092 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1343931-f4f9-45e4-92de-c2f2361bb47b service nova] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:25:21.079329 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 707/1434] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:25:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:25:22.119240 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405b5f17-2710-4d23-94fa-ddce807b51b4 None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:25:22.119807 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405b5f17-2710-4d23-94fa-ddce807b51b4 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:25:22.119807 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405b5f17-2710-4d23-94fa-ddce807b51b4 None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:25:22.121106 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 728/1435] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 9 16:25:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:25:22.127289 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6d4b6b-b721-4089-994e-0cf037822818 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:25:22.127728 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6d4b6b-b721-4089-994e-0cf037822818 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:25:22.127836 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6d4b6b-b721-4089-994e-0cf037822818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:25:22.203743 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-4e6d4b6b-b721-4089-994e-0cf037822818 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:25:22.204958 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-4e6d4b6b-b721-4089-994e-0cf037822818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:25:22.245857 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:25:22.300684 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 708/1436] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 9 16:25:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:25:22.449462 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405b5f17-2710-4d23-94fa-ddce807b51b4 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:25:22.451611 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-405b5f17-2710-4d23-94fa-ddce807b51b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:25:22.591369 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405b5f17-2710-4d23-94fa-ddce807b51b4 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:25:22.644979 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:25:22.702738 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43b2fea-d650-436d-91b5-3f75c61deeaa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a332b9b4980646a3b14633293f77b505', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:25:22.703270 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43b2fea-d650-436d-91b5-3f75c61deeaa service nova] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:25:22.703544 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43b2fea-d650-436d-91b5-3f75c61deeaa service nova] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:25:22.703812 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43b2fea-d650-436d-91b5-3f75c61deeaa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:25:22.705368 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-d43b2fea-d650-436d-91b5-3f75c61deeaa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:25:22.812483 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43b2fea-d650-436d-91b5-3f75c61deeaa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:25:22.814062 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43b2fea-d650-436d-91b5-3f75c61deeaa service nova] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:25:22.832048 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 729/1437] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:25:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:25:23.889529 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b130143a-3f5f-4202-aaab-fabc71c6b23f None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:25:23.890078 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b130143a-3f5f-4202-aaab-fabc71c6b23f None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:25:23.890078 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b130143a-3f5f-4202-aaab-fabc71c6b23f None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:25:23.891429 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 709/1438] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 9 16:25:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:25:23.897446 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2031338-b122-4083-a80e-bd236430c442 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:25:23.897830 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2031338-b122-4083-a80e-bd236430c442 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:25:23.897990 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2031338-b122-4083-a80e-bd236430c442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:25:23.972195 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-b2031338-b122-4083-a80e-bd236430c442 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:25:23.973385 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-b2031338-b122-4083-a80e-bd236430c442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:25:23.975386 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:25:24.067850 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 730/1439] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 9 16:25:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:25:24.220995 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b130143a-3f5f-4202-aaab-fabc71c6b23f None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:25:24.222624 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-b130143a-3f5f-4202-aaab-fabc71c6b23f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:25:24.365616 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b130143a-3f5f-4202-aaab-fabc71c6b23f None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:25:24.391932 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:25:24.478352 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1116132-1e23-415e-b569-5a90378720c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a332b9b4980646a3b14633293f77b505', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:25:24.478878 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1116132-1e23-415e-b569-5a90378720c8 service nova] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:25:24.479153 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1116132-1e23-415e-b569-5a90378720c8 service nova] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:25:24.479422 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1116132-1e23-415e-b569-5a90378720c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:25:24.481004 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-a1116132-1e23-415e-b569-5a90378720c8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:25:24.571516 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1116132-1e23-415e-b569-5a90378720c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:25:24.573133 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1116132-1e23-415e-b569-5a90378720c8 service nova] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:25:24.593323 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 710/1440] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:25:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:25:26.686824 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2b0c87-693e-4d12-83da-61e930cf497e None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:25:26.687394 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2b0c87-693e-4d12-83da-61e930cf497e None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:25:26.687394 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2b0c87-693e-4d12-83da-61e930cf497e None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:25:26.688691 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 731/1441] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 9 16:25:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:25:26.694114 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f9db05-cff5-46f0-8c82-ea97ef66f8aa None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:25:26.694526 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f9db05-cff5-46f0-8c82-ea97ef66f8aa None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:25:26.694670 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f9db05-cff5-46f0-8c82-ea97ef66f8aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:25:26.735581 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:25:26.764029 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-c8f9db05-cff5-46f0-8c82-ea97ef66f8aa None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:25:26.765634 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-c8f9db05-cff5-46f0-8c82-ea97ef66f8aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:25:26.865603 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 711/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 9 16:25:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:25:27.152752 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2b0c87-693e-4d12-83da-61e930cf497e None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:25:27.154334 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-fa2b0c87-693e-4d12-83da-61e930cf497e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:25:27.258023 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2b0c87-693e-4d12-83da-61e930cf497e None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:25:27.290075 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:25:27.332583 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe63b104-9fb0-4efa-85ea-2c44375efc07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f44bfdd5214e8d84a2c0a5b1fd9b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:25:27.333185 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe63b104-9fb0-4efa-85ea-2c44375efc07 service neutron] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:25:27.333458 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe63b104-9fb0-4efa-85ea-2c44375efc07 service neutron] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:25:27.333722 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe63b104-9fb0-4efa-85ea-2c44375efc07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:25:27.335338 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-fe63b104-9fb0-4efa-85ea-2c44375efc07 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:25:27.442368 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe63b104-9fb0-4efa-85ea-2c44375efc07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:25:27.444047 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe63b104-9fb0-4efa-85ea-2c44375efc07 service neutron] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:25:27.461321 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 732/1443] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:25:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:25:29.753773 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3bc88e-cdb7-44f0-873f-8384556768a0 None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:25:29.754342 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3bc88e-cdb7-44f0-873f-8384556768a0 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:25:29.754447 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3bc88e-cdb7-44f0-873f-8384556768a0 None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:25:29.755745 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 712/1444] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 9 16:25:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:25:29.760863 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c2238c-d923-4bb1-b2c8-7763fd54f955 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:25:29.761259 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c2238c-d923-4bb1-b2c8-7763fd54f955 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:25:29.761409 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c2238c-d923-4bb1-b2c8-7763fd54f955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:25:29.826205 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-76c2238c-d923-4bb1-b2c8-7763fd54f955 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:25:29.827423 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-76c2238c-d923-4bb1-b2c8-7763fd54f955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:25:29.839819 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:25:29.923392 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 733/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 9 16:25:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:25:30.204568 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3bc88e-cdb7-44f0-873f-8384556768a0 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:25:30.206092 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-2c3bc88e-cdb7-44f0-873f-8384556768a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:25:30.309723 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3bc88e-cdb7-44f0-873f-8384556768a0 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:25:30.322835 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:25:30.383720 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6704805-3ce9-4f98-a155-50ca33a3947f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f44bfdd5214e8d84a2c0a5b1fd9b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:25:30.384463 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6704805-3ce9-4f98-a155-50ca33a3947f service neutron] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:25:30.384741 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6704805-3ce9-4f98-a155-50ca33a3947f service neutron] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:25:30.385012 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6704805-3ce9-4f98-a155-50ca33a3947f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:25:30.386610 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-a6704805-3ce9-4f98-a155-50ca33a3947f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:25:30.495277 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6704805-3ce9-4f98-a155-50ca33a3947f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:25:30.496627 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6704805-3ce9-4f98-a155-50ca33a3947f service neutron] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:25:30.514748 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 713/1446] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:25:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:25:32.943466 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9b08a7-b6d6-47eb-b6c6-825b0d9e9946 None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:25:32.943874 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9b08a7-b6d6-47eb-b6c6-825b0d9e9946 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:25:32.944006 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9b08a7-b6d6-47eb-b6c6-825b0d9e9946 None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:25:32.945407 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 734/1447] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 9 16:25:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:25:32.951261 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f62b7b-2c6b-44e2-a9b0-77e8ee7e999e None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:25:32.951685 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f62b7b-2c6b-44e2-a9b0-77e8ee7e999e None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:25:32.951789 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f62b7b-2c6b-44e2-a9b0-77e8ee7e999e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:25:32.997683 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:25:33.016185 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-b4f62b7b-2c6b-44e2-a9b0-77e8ee7e999e None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:25:33.017382 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-b4f62b7b-2c6b-44e2-a9b0-77e8ee7e999e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:25:33.111528 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 714/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 9 16:25:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:25:33.393672 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9b08a7-b6d6-47eb-b6c6-825b0d9e9946 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:25:33.395240 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-8a9b08a7-b6d6-47eb-b6c6-825b0d9e9946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:25:33.504575 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9b08a7-b6d6-47eb-b6c6-825b0d9e9946 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:25:33.546145 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:25:33.582695 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca8e4b5-07f9-458a-81ea-f304acbc1a96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f44bfdd5214e8d84a2c0a5b1fd9b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:25:33.583298 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca8e4b5-07f9-458a-81ea-f304acbc1a96 service neutron] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:25:33.583571 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca8e4b5-07f9-458a-81ea-f304acbc1a96 service neutron] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:25:33.583836 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca8e4b5-07f9-458a-81ea-f304acbc1a96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:25:33.585415 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-8ca8e4b5-07f9-458a-81ea-f304acbc1a96 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:25:33.697830 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca8e4b5-07f9-458a-81ea-f304acbc1a96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:25:33.699328 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca8e4b5-07f9-458a-81ea-f304acbc1a96 service neutron] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:25:33.717817 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 735/1449] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:25:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:25:35.996931 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284ce5c8-0bcf-4a48-9e86-d50776075475 None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:25:35.997551 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284ce5c8-0bcf-4a48-9e86-d50776075475 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:25:35.997551 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284ce5c8-0bcf-4a48-9e86-d50776075475 None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:25:35.998849 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 715/1450] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 9 16:25:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:25:36.004335 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872c1c5c-46c4-4fd8-9efd-77997bc60630 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:25:36.004739 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872c1c5c-46c4-4fd8-9efd-77997bc60630 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:25:36.004878 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872c1c5c-46c4-4fd8-9efd-77997bc60630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:25:36.071845 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-872c1c5c-46c4-4fd8-9efd-77997bc60630 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:25:36.073258 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-872c1c5c-46c4-4fd8-9efd-77997bc60630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:25:36.094808 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:25:36.170272 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 736/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 9 16:25:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:25:36.452886 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284ce5c8-0bcf-4a48-9e86-d50776075475 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:25:36.454447 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-284ce5c8-0bcf-4a48-9e86-d50776075475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:25:36.555258 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284ce5c8-0bcf-4a48-9e86-d50776075475 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:25:36.576185 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:25:36.628516 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff40e38f-a33d-4e6d-8354-0449eaedf4da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f44bfdd5214e8d84a2c0a5b1fd9b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:25:36.629108 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff40e38f-a33d-4e6d-8354-0449eaedf4da service neutron] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:25:36.629379 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff40e38f-a33d-4e6d-8354-0449eaedf4da service neutron] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:25:36.629647 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff40e38f-a33d-4e6d-8354-0449eaedf4da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:25:36.631232 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-ff40e38f-a33d-4e6d-8354-0449eaedf4da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:25:36.737796 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff40e38f-a33d-4e6d-8354-0449eaedf4da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:25:36.739239 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff40e38f-a33d-4e6d-8354-0449eaedf4da service neutron] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:25:36.757453 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 716/1452] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:25:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:25:38.958100 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c21e13-7817-460c-b350-a69a57d64018 None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:25:38.958612 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c21e13-7817-460c-b350-a69a57d64018 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:25:38.958817 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c21e13-7817-460c-b350-a69a57d64018 None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:25:38.960331 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 737/1453] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 9 16:25:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:25:38.966065 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba9708c-8655-4c8a-ab64-e07eed2aea64 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:25:38.966481 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba9708c-8655-4c8a-ab64-e07eed2aea64 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:25:38.966632 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba9708c-8655-4c8a-ab64-e07eed2aea64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:25:39.029436 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:25:39.032438 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-fba9708c-8655-4c8a-ab64-e07eed2aea64 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:25:39.034280 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-fba9708c-8655-4c8a-ab64-e07eed2aea64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:25:39.129470 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 717/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 9 16:25:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:25:39.414270 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c21e13-7817-460c-b350-a69a57d64018 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:25:39.415848 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-17c21e13-7817-460c-b350-a69a57d64018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:25:39.516568 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c21e13-7817-460c-b350-a69a57d64018 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:25:39.564648 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:25:39.589263 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f955327f-db94-4982-a36d-95e03b08a5f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f44bfdd5214e8d84a2c0a5b1fd9b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:25:39.590538 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f955327f-db94-4982-a36d-95e03b08a5f8 service neutron] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:25:39.590815 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f955327f-db94-4982-a36d-95e03b08a5f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:25:39.591084 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f955327f-db94-4982-a36d-95e03b08a5f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:25:39.592649 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-f955327f-db94-4982-a36d-95e03b08a5f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:25:39.698260 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f955327f-db94-4982-a36d-95e03b08a5f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:25:39.700345 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f955327f-db94-4982-a36d-95e03b08a5f8 service neutron] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:25:39.718507 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 738/1455] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:25:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:25:41.931799 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c61159-5c85-4280-8098-33585e1a6fbc None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:25:41.932360 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c61159-5c85-4280-8098-33585e1a6fbc None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:25:41.932360 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c61159-5c85-4280-8098-33585e1a6fbc None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:25:41.934222 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 718/1456] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 9 16:25:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:25:41.939473 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d58b98-e8e4-4b8a-893f-658b41cab26c None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:25:41.939853 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d58b98-e8e4-4b8a-893f-658b41cab26c None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:25:41.940011 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d58b98-e8e4-4b8a-893f-658b41cab26c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:25:42.005360 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-b9d58b98-e8e4-4b8a-893f-658b41cab26c None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:25:42.006571 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-b9d58b98-e8e4-4b8a-893f-658b41cab26c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:25:42.034806 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:25:42.101729 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 739/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 9 16:25:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:25:42.391033 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c61159-5c85-4280-8098-33585e1a6fbc None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:25:42.392584 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-25c61159-5c85-4280-8098-33585e1a6fbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:25:42.506293 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c61159-5c85-4280-8098-33585e1a6fbc None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:25:42.534294 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:25:42.581390 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e79f91-05c3-413d-b738-30adeac0ead0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f44bfdd5214e8d84a2c0a5b1fd9b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:25:42.581912 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e79f91-05c3-413d-b738-30adeac0ead0 service neutron] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:25:42.582188 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e79f91-05c3-413d-b738-30adeac0ead0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:25:42.582488 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e79f91-05c3-413d-b738-30adeac0ead0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:25:42.584076 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-27e79f91-05c3-413d-b738-30adeac0ead0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:25:42.690608 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e79f91-05c3-413d-b738-30adeac0ead0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:25:42.692303 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e79f91-05c3-413d-b738-30adeac0ead0 service neutron] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:25:42.710200 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 719/1458] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:25:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:25:44.894198 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c38694f-8874-4208-8e4a-cfd92016dd13 None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:25:44.894814 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c38694f-8874-4208-8e4a-cfd92016dd13 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:25:44.894814 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c38694f-8874-4208-8e4a-cfd92016dd13 None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:25:44.896166 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 740/1459] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 9 16:25:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:25:44.902340 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51378e75-766e-4a8d-abd7-587191be6582 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:25:44.902749 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51378e75-766e-4a8d-abd7-587191be6582 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:25:44.902880 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51378e75-766e-4a8d-abd7-587191be6582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:25:44.969332 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-51378e75-766e-4a8d-abd7-587191be6582 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:25:44.970575 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-51378e75-766e-4a8d-abd7-587191be6582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:25:44.978764 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:25:45.069872 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 720/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 9 16:25:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:25:45.352391 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c38694f-8874-4208-8e4a-cfd92016dd13 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:25:45.353910 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-3c38694f-8874-4208-8e4a-cfd92016dd13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:25:45.456725 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c38694f-8874-4208-8e4a-cfd92016dd13 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:25:45.512117 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:25:45.529975 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc902411-2aca-43ac-85c8-742f157629d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f44bfdd5214e8d84a2c0a5b1fd9b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:25:45.530607 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc902411-2aca-43ac-85c8-742f157629d3 service neutron] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:25:45.530885 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc902411-2aca-43ac-85c8-742f157629d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:25:45.531152 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc902411-2aca-43ac-85c8-742f157629d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:25:45.532727 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-dc902411-2aca-43ac-85c8-742f157629d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:25:45.639745 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc902411-2aca-43ac-85c8-742f157629d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:25:45.641415 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc902411-2aca-43ac-85c8-742f157629d3 service neutron] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:25:45.658857 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 741/1461] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:25:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:25:47.834933 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20580354-49fe-4182-9429-4c7eb6ef78cb None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:25:47.835503 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20580354-49fe-4182-9429-4c7eb6ef78cb None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:25:47.835503 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20580354-49fe-4182-9429-4c7eb6ef78cb None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:25:47.836782 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 721/1462] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 9 16:25:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:25:47.842624 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7238b78-b212-49eb-9113-8e7ccbb161ad None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:25:47.843043 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7238b78-b212-49eb-9113-8e7ccbb161ad None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:25:47.843151 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7238b78-b212-49eb-9113-8e7ccbb161ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:25:47.909719 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-d7238b78-b212-49eb-9113-8e7ccbb161ad None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:25:47.910958 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-d7238b78-b212-49eb-9113-8e7ccbb161ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:25:47.949616 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:25:48.006504 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 742/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 9 16:25:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:25:48.293352 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20580354-49fe-4182-9429-4c7eb6ef78cb None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:25:48.294941 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-20580354-49fe-4182-9429-4c7eb6ef78cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:25:48.396478 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20580354-49fe-4182-9429-4c7eb6ef78cb None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:25:48.434608 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:25:48.470656 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e4598d-d22b-4660-9608-f7922551cf75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f44bfdd5214e8d84a2c0a5b1fd9b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:25:48.471255 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e4598d-d22b-4660-9608-f7922551cf75 service neutron] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:25:48.471534 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e4598d-d22b-4660-9608-f7922551cf75 service neutron] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:25:48.471807 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e4598d-d22b-4660-9608-f7922551cf75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:25:48.473378 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-e2e4598d-d22b-4660-9608-f7922551cf75 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:25:48.579297 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e4598d-d22b-4660-9608-f7922551cf75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:25:48.580651 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e4598d-d22b-4660-9608-f7922551cf75 service neutron] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:25:48.598803 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 722/1464] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:25:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:25:50.749393 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ef5017-ca0c-4856-b549-bb0bf9a40223 None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:25:50.750177 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ef5017-ca0c-4856-b549-bb0bf9a40223 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:25:50.750177 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ef5017-ca0c-4856-b549-bb0bf9a40223 None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:25:50.751752 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 743/1465] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 9 16:25:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:25:50.757718 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea9f266-09b8-4457-bc14-fe130a059836 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:25:50.758160 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea9f266-09b8-4457-bc14-fe130a059836 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:25:50.758278 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea9f266-09b8-4457-bc14-fe130a059836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:25:50.835119 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-bea9f266-09b8-4457-bc14-fe130a059836 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:25:50.836332 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-bea9f266-09b8-4457-bc14-fe130a059836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:25:50.854085 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:25:50.939839 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 723/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 9 16:25:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:25:51.221035 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ef5017-ca0c-4856-b549-bb0bf9a40223 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:25:51.222596 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-a0ef5017-ca0c-4856-b549-bb0bf9a40223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:25:51.327648 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ef5017-ca0c-4856-b549-bb0bf9a40223 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:25:51.393253 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:25:51.400324 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583da25f-5300-49a4-8916-c89a41c489e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f44bfdd5214e8d84a2c0a5b1fd9b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:25:51.400925 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583da25f-5300-49a4-8916-c89a41c489e1 service neutron] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:25:51.401825 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583da25f-5300-49a4-8916-c89a41c489e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:25:51.402091 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583da25f-5300-49a4-8916-c89a41c489e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:25:51.403689 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-583da25f-5300-49a4-8916-c89a41c489e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:25:51.511590 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583da25f-5300-49a4-8916-c89a41c489e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:25:51.512928 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583da25f-5300-49a4-8916-c89a41c489e1 service neutron] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:25:51.531385 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 744/1467] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:25:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:25:53.686861 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c2a798-11b3-4c86-a883-f81e97c112ac None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:25:53.687428 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c2a798-11b3-4c86-a883-f81e97c112ac None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:25:53.687428 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c2a798-11b3-4c86-a883-f81e97c112ac None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:25:53.688831 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 724/1468] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 9 16:25:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:25:53.694356 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b77d0b-ddb0-4622-bde0-e74b709b6969 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:25:53.694806 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b77d0b-ddb0-4622-bde0-e74b709b6969 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:25:53.694906 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b77d0b-ddb0-4622-bde0-e74b709b6969 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:25:53.758754 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-e8b77d0b-ddb0-4622-bde0-e74b709b6969 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:25:53.759939 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-e8b77d0b-ddb0-4622-bde0-e74b709b6969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:25:53.808587 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:25:53.861407 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 745/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 9 16:25:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:25:54.149999 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c2a798-11b3-4c86-a883-f81e97c112ac None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:25:54.151594 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-35c2a798-11b3-4c86-a883-f81e97c112ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:25:54.262163 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c2a798-11b3-4c86-a883-f81e97c112ac None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:25:54.312252 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:25:54.337412 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0178bb6-5ef8-4937-bef1-4ae843a292a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f44bfdd5214e8d84a2c0a5b1fd9b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:25:54.338009 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0178bb6-5ef8-4937-bef1-4ae843a292a4 service neutron] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:25:54.338285 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0178bb6-5ef8-4937-bef1-4ae843a292a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:25:54.338584 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0178bb6-5ef8-4937-bef1-4ae843a292a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:25:54.340160 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-c0178bb6-5ef8-4937-bef1-4ae843a292a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:25:54.446206 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0178bb6-5ef8-4937-bef1-4ae843a292a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:25:54.447673 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0178bb6-5ef8-4937-bef1-4ae843a292a4 service neutron] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:25:54.465149 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 725/1470] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:25:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:26:03.859905 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=22 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:26:04.462925 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=66 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:26:14.827868 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c4e98e-9ebc-4e5c-91eb-88262f232e12 None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:26:14.828468 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c4e98e-9ebc-4e5c-91eb-88262f232e12 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:26:14.828468 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c4e98e-9ebc-4e5c-91eb-88262f232e12 None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:26:14.829798 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 746/1471] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:26:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:26:14.835487 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d91af8e-df5d-4915-8252-cdb68ea70478 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:26:14.835951 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d91af8e-df5d-4915-8252-cdb68ea70478 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:26:14.836166 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d91af8e-df5d-4915-8252-cdb68ea70478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:26:14.903003 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-5d91af8e-df5d-4915-8252-cdb68ea70478 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:26:14.904206 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-5d91af8e-df5d-4915-8252-cdb68ea70478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:26:14.999397 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 726/1472] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:26:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:26:15.296164 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a2bcac-259f-4846-8b6a-31da4d56981e None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:26:15.296445 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a2bcac-259f-4846-8b6a-31da4d56981e None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:26:15.296716 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a2bcac-259f-4846-8b6a-31da4d56981e None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:26:15.298055 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 747/1473] 10.222.0.27 () {54 vars in 966 bytes} [Fri Sep 9 16:26:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:26:15.303063 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8dff74-16af-4788-a623-0081558116ce None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:26:15.303351 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8dff74-16af-4788-a623-0081558116ce None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:26:15.303624 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8dff74-16af-4788-a623-0081558116ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:26:15.378706 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-1f8dff74-16af-4788-a623-0081558116ce None None] MFA Rules not processed for user `3ddd42508eee4412ae139cb8526090d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:26:15.379912 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-1f8dff74-16af-4788-a623-0081558116ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:26:15.401178 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:26:15.457519 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 727/1474] 10.222.0.27 () {58 vars in 1063 bytes} [Fri Sep 9 16:26:15 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:26:15.466061 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a2bcac-259f-4846-8b6a-31da4d56981e None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:26:15.467599 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-b4a2bcac-259f-4846-8b6a-31da4d56981e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:26:15.570230 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a2bcac-259f-4846-8b6a-31da4d56981e None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:26:15.648708 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee6bfea-6d24-4892-b57d-ddbf347a2bd7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ddd42508eee4412ae139cb8526090d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:26:15.649309 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee6bfea-6d24-4892-b57d-ddbf347a2bd7 service glance] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:26:15.649611 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee6bfea-6d24-4892-b57d-ddbf347a2bd7 service glance] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:26:15.649879 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee6bfea-6d24-4892-b57d-ddbf347a2bd7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:26:15.651496 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-1ee6bfea-6d24-4892-b57d-ddbf347a2bd7 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:26:15.705576 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:26:15.760037 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee6bfea-6d24-4892-b57d-ddbf347a2bd7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:26:15.761463 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee6bfea-6d24-4892-b57d-ddbf347a2bd7 service glance] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:26:15.779436 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 748/1475] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:26:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:26:18.000887 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeeb21d-be64-46ea-addd-6619ec43bcb7 None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:26:18.001455 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeeb21d-be64-46ea-addd-6619ec43bcb7 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:26:18.001455 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeeb21d-be64-46ea-addd-6619ec43bcb7 None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:26:18.002797 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 728/1476] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:26:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:26:18.007975 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b995240b-ca5e-42a8-a244-d71f86c89e1d None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:26:18.008365 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b995240b-ca5e-42a8-a244-d71f86c89e1d None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:26:18.008616 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b995240b-ca5e-42a8-a244-d71f86c89e1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:26:18.074443 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-b995240b-ca5e-42a8-a244-d71f86c89e1d None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:26:18.075652 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-b995240b-ca5e-42a8-a244-d71f86c89e1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:26:18.170939 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 749/1477] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:26:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:26:18.448172 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeeb21d-be64-46ea-addd-6619ec43bcb7 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:26:18.449691 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-eaeeb21d-be64-46ea-addd-6619ec43bcb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:26:18.572620 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeeb21d-be64-46ea-addd-6619ec43bcb7 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:26:18.621832 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:26:18.665469 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b015293-52e5-430d-81d2-97dec8adf904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:26:18.666073 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b015293-52e5-430d-81d2-97dec8adf904 admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:26:18.666402 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b015293-52e5-430d-81d2-97dec8adf904 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:26:18.666677 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b015293-52e5-430d-81d2-97dec8adf904 admin admin] PATH_INFO: `/v3/projects` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:26:18.667300 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b015293-52e5-430d-81d2-97dec8adf904 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:26:18.669083 dv-cinder-831247-27-smb devstack@keystone.service[81445]: WARNING py.warnings [None req-2b015293-52e5-430d-81d2-97dec8adf904 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 09 16:26:18.669083 dv-cinder-831247-27-smb devstack@keystone.service[81445]: warnings.warn(msg) Sep 09 16:26:18.669083 dv-cinder-831247-27-smb devstack@keystone.service[81445]: Sep 09 16:26:18.670214 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b015293-52e5-430d-81d2-97dec8adf904 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:26:18.689286 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 729/1478] 10.222.0.27 () {56 vars in 1108 bytes} [Fri Sep 9 16:26:18 2022] GET /identity/v3/projects => generated 2553 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:26:20.835912 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d18db27-d34e-438b-a04b-581fe53d347b None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:26:20.836499 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d18db27-d34e-438b-a04b-581fe53d347b None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:26:20.836499 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d18db27-d34e-438b-a04b-581fe53d347b None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:26:20.838507 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 750/1479] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:26:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:26:20.843661 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3702e888-f87f-4ee1-a913-6cc0fc2905da None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:26:20.844050 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3702e888-f87f-4ee1-a913-6cc0fc2905da None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:26:20.844207 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3702e888-f87f-4ee1-a913-6cc0fc2905da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:26:20.910471 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-3702e888-f87f-4ee1-a913-6cc0fc2905da None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:26:20.911702 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-3702e888-f87f-4ee1-a913-6cc0fc2905da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:26:21.006053 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 730/1480] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:26:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:26:21.303225 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d18db27-d34e-438b-a04b-581fe53d347b None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:26:21.304898 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-7d18db27-d34e-438b-a04b-581fe53d347b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:26:21.315057 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:26:21.449246 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d18db27-d34e-438b-a04b-581fe53d347b None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:26:21.526791 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:26:21.558566 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaef3a28-b5cc-48c0-bac0-4a27dbc03748 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a332b9b4980646a3b14633293f77b505', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:26:21.559103 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaef3a28-b5cc-48c0-bac0-4a27dbc03748 service nova] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:26:21.559379 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaef3a28-b5cc-48c0-bac0-4a27dbc03748 service nova] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:26:21.559644 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaef3a28-b5cc-48c0-bac0-4a27dbc03748 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:26:21.561216 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-aaef3a28-b5cc-48c0-bac0-4a27dbc03748 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:26:21.656035 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaef3a28-b5cc-48c0-bac0-4a27dbc03748 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:26:21.657637 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaef3a28-b5cc-48c0-bac0-4a27dbc03748 service nova] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:26:21.675320 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 751/1481] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:26:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:26:24.018666 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78146b4c-5bdf-45cd-9cf4-24c74c80756b None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:26:24.019204 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78146b4c-5bdf-45cd-9cf4-24c74c80756b None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:26:24.019204 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78146b4c-5bdf-45cd-9cf4-24c74c80756b None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:26:24.020553 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 731/1482] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:26:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:26:24.025792 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b482cd67-e7b5-4b2f-8b0b-cbc42baac114 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:26:24.026182 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b482cd67-e7b5-4b2f-8b0b-cbc42baac114 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:26:24.026354 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b482cd67-e7b5-4b2f-8b0b-cbc42baac114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:26:24.092061 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-b482cd67-e7b5-4b2f-8b0b-cbc42baac114 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:26:24.093247 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-b482cd67-e7b5-4b2f-8b0b-cbc42baac114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:26:24.140051 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:26:24.189548 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 752/1483] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:26:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:26:24.482195 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78146b4c-5bdf-45cd-9cf4-24c74c80756b None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:26:24.483732 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-78146b4c-5bdf-45cd-9cf4-24c74c80756b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:26:24.507763 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:26:24.585674 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78146b4c-5bdf-45cd-9cf4-24c74c80756b None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:26:24.667664 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b30b07-de77-413d-810c-99e46661802f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f44bfdd5214e8d84a2c0a5b1fd9b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:26:24.668264 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b30b07-de77-413d-810c-99e46661802f service neutron] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:26:24.668539 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b30b07-de77-413d-810c-99e46661802f service neutron] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:26:24.668809 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b30b07-de77-413d-810c-99e46661802f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:26:24.670433 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-70b30b07-de77-413d-810c-99e46661802f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:26:24.743707 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:26:24.778835 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b30b07-de77-413d-810c-99e46661802f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:26:24.780265 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b30b07-de77-413d-810c-99e46661802f service neutron] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:26:24.798620 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 732/1484] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:26:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:26:26.995675 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cc3fb6-38b4-4aba-80cd-f02a2b0200d0 None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:26:26.996215 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cc3fb6-38b4-4aba-80cd-f02a2b0200d0 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:26:26.996215 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cc3fb6-38b4-4aba-80cd-f02a2b0200d0 None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:26:26.997550 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 753/1485] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:26:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:26:27.002715 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ee5645-3779-4757-a992-f2b50a846c5f None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:26:27.003166 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ee5645-3779-4757-a992-f2b50a846c5f None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:26:27.003282 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ee5645-3779-4757-a992-f2b50a846c5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:26:27.069132 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-25ee5645-3779-4757-a992-f2b50a846c5f None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:26:27.070406 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-25ee5645-3779-4757-a992-f2b50a846c5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:26:27.165687 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 733/1486] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:26:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:26:27.456661 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cc3fb6-38b4-4aba-80cd-f02a2b0200d0 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:26:27.458201 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-32cc3fb6-38b4-4aba-80cd-f02a2b0200d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:26:27.559438 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cc3fb6-38b4-4aba-80cd-f02a2b0200d0 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:26:27.631827 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:26:27.633981 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2382a1f9-19e9-4408-b7e3-140ab59c90e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f44bfdd5214e8d84a2c0a5b1fd9b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:26:27.634726 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2382a1f9-19e9-4408-b7e3-140ab59c90e7 service neutron] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:26:27.635226 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2382a1f9-19e9-4408-b7e3-140ab59c90e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:26:27.635674 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2382a1f9-19e9-4408-b7e3-140ab59c90e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:26:27.637489 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-2382a1f9-19e9-4408-b7e3-140ab59c90e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:26:27.744858 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2382a1f9-19e9-4408-b7e3-140ab59c90e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:26:27.746286 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2382a1f9-19e9-4408-b7e3-140ab59c90e7 service neutron] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:26:27.765475 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 754/1487] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:26:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:26:30.073052 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bc1fdb-7d6a-48a2-969b-f0f896abfe22 None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:26:30.073612 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bc1fdb-7d6a-48a2-969b-f0f896abfe22 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:26:30.073612 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bc1fdb-7d6a-48a2-969b-f0f896abfe22 None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:26:30.074981 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 734/1488] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:26:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:26:30.080264 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576a843d-a056-41f9-afd8-e68d3e89b307 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:26:30.080668 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576a843d-a056-41f9-afd8-e68d3e89b307 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:26:30.080827 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576a843d-a056-41f9-afd8-e68d3e89b307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:26:30.145378 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-576a843d-a056-41f9-afd8-e68d3e89b307 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:26:30.146584 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-576a843d-a056-41f9-afd8-e68d3e89b307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:26:30.199554 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:26:30.244784 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 755/1489] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:26:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:26:30.532282 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bc1fdb-7d6a-48a2-969b-f0f896abfe22 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:26:30.533793 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-83bc1fdb-7d6a-48a2-969b-f0f896abfe22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:26:30.568934 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:26:30.637786 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bc1fdb-7d6a-48a2-969b-f0f896abfe22 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:26:30.710544 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e52007a-ae8f-4743-8f70-1ca1254ef1ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f44bfdd5214e8d84a2c0a5b1fd9b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:26:30.711191 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e52007a-ae8f-4743-8f70-1ca1254ef1ea service neutron] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:26:30.711470 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e52007a-ae8f-4743-8f70-1ca1254ef1ea service neutron] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:26:30.711739 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e52007a-ae8f-4743-8f70-1ca1254ef1ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:26:30.713308 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-2e52007a-ae8f-4743-8f70-1ca1254ef1ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:26:30.791423 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:26:30.821420 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e52007a-ae8f-4743-8f70-1ca1254ef1ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:26:30.822892 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e52007a-ae8f-4743-8f70-1ca1254ef1ea service neutron] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:26:30.840996 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 735/1490] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:26:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:26:33.187107 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ceb75f-6d05-4f62-8d02-690cb09ff9ae None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:26:33.187636 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ceb75f-6d05-4f62-8d02-690cb09ff9ae None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:26:33.187636 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ceb75f-6d05-4f62-8d02-690cb09ff9ae None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:26:33.189005 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 756/1491] 10.222.0.27 () {54 vars in 927 bytes} [Fri Sep 9 16:26:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:26:33.194610 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d44e78-f683-4a33-8801-e26c3477c5d5 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:26:33.195020 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d44e78-f683-4a33-8801-e26c3477c5d5 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:26:33.195147 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d44e78-f683-4a33-8801-e26c3477c5d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:26:33.261034 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-83d44e78-f683-4a33-8801-e26c3477c5d5 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:26:33.262146 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-83d44e78-f683-4a33-8801-e26c3477c5d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:26:33.473529 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 736/1492] 10.222.0.27 () {58 vars in 1024 bytes} [Fri Sep 9 16:26:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:26:33.760747 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ceb75f-6d05-4f62-8d02-690cb09ff9ae None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:26:33.762394 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-85ceb75f-6d05-4f62-8d02-690cb09ff9ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:26:33.873327 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ceb75f-6d05-4f62-8d02-690cb09ff9ae None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:26:33.950863 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e818930a-df56-4a04-8144-55de95a955c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f44bfdd5214e8d84a2c0a5b1fd9b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:26:33.951534 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e818930a-df56-4a04-8144-55de95a955c7 service neutron] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:26:33.951816 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e818930a-df56-4a04-8144-55de95a955c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:26:33.952108 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e818930a-df56-4a04-8144-55de95a955c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:26:33.953702 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-e818930a-df56-4a04-8144-55de95a955c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:26:33.963344 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:26:34.061316 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e818930a-df56-4a04-8144-55de95a955c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:26:34.062706 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e818930a-df56-4a04-8144-55de95a955c7 service neutron] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:26:34.080297 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 757/1493] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:26:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 16:26:43.471986 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=82 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:26:44.078067 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=50 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:28:16.328671 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4eec30-6a8a-4514-b2a9-f59018764ad8 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:28:16.329132 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4eec30-6a8a-4514-b2a9-f59018764ad8 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:28:16.329244 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4eec30-6a8a-4514-b2a9-f59018764ad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:28:16.410196 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-5e4eec30-6a8a-4514-b2a9-f59018764ad8 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:28:16.411360 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-5e4eec30-6a8a-4514-b2a9-f59018764ad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:28:16.511222 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 737/1494] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:28:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:28:16.519109 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dbd750-249d-4a5a-a89f-76cfeff87a82 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:28:16.520207 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dbd750-249d-4a5a-a89f-76cfeff87a82 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:28:16.520315 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dbd750-249d-4a5a-a89f-76cfeff87a82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:28:16.539782 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-18dbd750-249d-4a5a-a89f-76cfeff87a82 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:28:16.540958 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-18dbd750-249d-4a5a-a89f-76cfeff87a82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:28:16.549260 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 758/1495] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:28:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:28:16.553609 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4eec30-6a8a-4514-b2a9-f59018764ad8 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:28:16.563094 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4eec30-6a8a-4514-b2a9-f59018764ad8 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:28:16.568396 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf54d1ac-f7a2-437c-a307-03d185c7f54d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:28:16.568986 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf54d1ac-f7a2-437c-a307-03d185c7f54d admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:28:16.569266 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf54d1ac-f7a2-437c-a307-03d185c7f54d admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:28:16.569539 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf54d1ac-f7a2-437c-a307-03d185c7f54d admin admin] PATH_INFO: `/v3/domains` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:28:16.570170 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf54d1ac-f7a2-437c-a307-03d185c7f54d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:28:16.570500 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf54d1ac-f7a2-437c-a307-03d185c7f54d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:28:16.571528 dv-cinder-831247-27-smb devstack@keystone.service[81445]: WARNING py.warnings [None req-bf54d1ac-f7a2-437c-a307-03d185c7f54d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 09 16:28:16.571528 dv-cinder-831247-27-smb devstack@keystone.service[81445]: warnings.warn(msg) Sep 09 16:28:16.571528 dv-cinder-831247-27-smb devstack@keystone.service[81445]: Sep 09 16:28:16.572409 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf54d1ac-f7a2-437c-a307-03d185c7f54d admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:28:16.585008 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 738/1496] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Sep 9 16:28:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:28:16.593009 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dbd750-249d-4a5a-a89f-76cfeff87a82 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:28:16.602382 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dbd750-249d-4a5a-a89f-76cfeff87a82 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:28:16.606982 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da9b125-dd61-4ffa-95d3-f57622351c74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:28:16.607567 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da9b125-dd61-4ffa-95d3-f57622351c74 admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:28:16.607845 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da9b125-dd61-4ffa-95d3-f57622351c74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:28:16.608113 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da9b125-dd61-4ffa-95d3-f57622351c74 admin admin] PATH_INFO: `/v3/projects` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:28:16.608737 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da9b125-dd61-4ffa-95d3-f57622351c74 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:28:16.610491 dv-cinder-831247-27-smb devstack@keystone.service[81446]: WARNING py.warnings [None req-5da9b125-dd61-4ffa-95d3-f57622351c74 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 09 16:28:16.610491 dv-cinder-831247-27-smb devstack@keystone.service[81446]: warnings.warn(msg) Sep 09 16:28:16.610491 dv-cinder-831247-27-smb devstack@keystone.service[81446]: Sep 09 16:28:16.611669 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da9b125-dd61-4ffa-95d3-f57622351c74 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:28:16.648910 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 759/1497] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 16:28:16 2022] POST /identity/v3/projects => generated 377 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 16:28:16.653002 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf54d1ac-f7a2-437c-a307-03d185c7f54d admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:28:16.662879 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf54d1ac-f7a2-437c-a307-03d185c7f54d admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:28:16.714386 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:28:16.721544 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc83e4e-1824-44fb-97bb-ddf9d49d80bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:28:16.722146 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc83e4e-1824-44fb-97bb-ddf9d49d80bd admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:28:16.722481 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc83e4e-1824-44fb-97bb-ddf9d49d80bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:28:16.722754 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc83e4e-1824-44fb-97bb-ddf9d49d80bd admin admin] PATH_INFO: `/v3/users` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:28:16.723396 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc83e4e-1824-44fb-97bb-ddf9d49d80bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:28:16.724451 dv-cinder-831247-27-smb devstack@keystone.service[81445]: WARNING py.warnings [None req-6cc83e4e-1824-44fb-97bb-ddf9d49d80bd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 09 16:28:16.724451 dv-cinder-831247-27-smb devstack@keystone.service[81445]: warnings.warn(msg) Sep 09 16:28:16.724451 dv-cinder-831247-27-smb devstack@keystone.service[81445]: Sep 09 16:28:16.725644 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc83e4e-1824-44fb-97bb-ddf9d49d80bd admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:28:16.746701 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 739/1498] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 16:28:16 2022] POST /identity/v3/users => generated 289 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 16:28:16.750889 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da9b125-dd61-4ffa-95d3-f57622351c74 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:28:16.762259 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da9b125-dd61-4ffa-95d3-f57622351c74 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:28:16.767247 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8e059d-c0cf-4829-b837-800060067888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:28:16.767844 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8e059d-c0cf-4829-b837-800060067888 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:28:16.768124 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8e059d-c0cf-4829-b837-800060067888 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:28:16.768396 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8e059d-c0cf-4829-b837-800060067888 admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:28:16.769031 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8e059d-c0cf-4829-b837-800060067888 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:28:16.770069 dv-cinder-831247-27-smb devstack@keystone.service[81446]: WARNING py.warnings [None req-0e8e059d-c0cf-4829-b837-800060067888 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 09 16:28:16.770069 dv-cinder-831247-27-smb devstack@keystone.service[81446]: warnings.warn(msg) Sep 09 16:28:16.770069 dv-cinder-831247-27-smb devstack@keystone.service[81446]: Sep 09 16:28:16.770987 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8e059d-c0cf-4829-b837-800060067888 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:28:16.783543 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 760/1499] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:28:16 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:28:16.787769 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc83e4e-1824-44fb-97bb-ddf9d49d80bd admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:28:16.797635 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc83e4e-1824-44fb-97bb-ddf9d49d80bd admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:28:16.802820 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500d3724-e238-4d5f-8272-a832f27d4789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:28:16.803401 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500d3724-e238-4d5f-8272-a832f27d4789 admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:28:16.803677 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500d3724-e238-4d5f-8272-a832f27d4789 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:28:16.803945 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500d3724-e238-4d5f-8272-a832f27d4789 admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:28:16.804568 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500d3724-e238-4d5f-8272-a832f27d4789 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:28:16.805590 dv-cinder-831247-27-smb devstack@keystone.service[81445]: WARNING py.warnings [None req-500d3724-e238-4d5f-8272-a832f27d4789 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 09 16:28:16.805590 dv-cinder-831247-27-smb devstack@keystone.service[81445]: warnings.warn(msg) Sep 09 16:28:16.805590 dv-cinder-831247-27-smb devstack@keystone.service[81445]: Sep 09 16:28:16.806480 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500d3724-e238-4d5f-8272-a832f27d4789 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:28:16.820137 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 740/1500] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:28:16 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:28:16.823976 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8e059d-c0cf-4829-b837-800060067888 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:28:16.833631 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8e059d-c0cf-4829-b837-800060067888 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:28:16.838216 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b3a196-3a35-4106-91f3-918bea4f0acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:28:16.838872 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b3a196-3a35-4106-91f3-918bea4f0acb admin admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:28:16.839152 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b3a196-3a35-4106-91f3-918bea4f0acb admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:28:16.839428 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b3a196-3a35-4106-91f3-918bea4f0acb admin admin] PATH_INFO: `/v3/projects/fb3f49276c7e450e80c1abde26c9b399/users/307bbb6a04c64ec79c985c53839fd04e/roles/b38e84bf077846ee802e6bb1bad83522` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:28:16.853658 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b3a196-3a35-4106-91f3-918bea4f0acb admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb3f49276c7e450e80c1abde26c9b399, user_id=307bbb6a04c64ec79c985c53839fd04e, role_id=b38e84bf077846ee802e6bb1bad83522)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:28:16.854713 dv-cinder-831247-27-smb devstack@keystone.service[81446]: WARNING py.warnings [None req-64b3a196-3a35-4106-91f3-918bea4f0acb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 09 16:28:16.854713 dv-cinder-831247-27-smb devstack@keystone.service[81446]: warnings.warn(msg) Sep 09 16:28:16.854713 dv-cinder-831247-27-smb devstack@keystone.service[81446]: Sep 09 16:28:16.856610 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b3a196-3a35-4106-91f3-918bea4f0acb admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:28:16.869685 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 761/1501] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 16:28:16 2022] PUT /identity/v3/projects/fb3f49276c7e450e80c1abde26c9b399/users/307bbb6a04c64ec79c985c53839fd04e/roles/b38e84bf077846ee802e6bb1bad83522 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 16:28:16.882400 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d8e7f6-30c2-409e-ad15-d232570618ce None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:28:16.882674 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d8e7f6-30c2-409e-ad15-d232570618ce None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:28:16.882944 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d8e7f6-30c2-409e-ad15-d232570618ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:28:16.909503 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-23d8e7f6-30c2-409e-ad15-d232570618ce None None] MFA Rules not processed for user `307bbb6a04c64ec79c985c53839fd04e`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:28:16.910727 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-23d8e7f6-30c2-409e-ad15-d232570618ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:28:16.974765 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 741/1502] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:28:16 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:28:16.988535 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a677970-4da3-4642-9be5-0138c7606c5f None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:28:16.988818 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a677970-4da3-4642-9be5-0138c7606c5f None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:28:16.989089 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a677970-4da3-4642-9be5-0138c7606c5f None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:28:16.990489 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 762/1503] 10.222.0.27 () {54 vars in 964 bytes} [Fri Sep 9 16:28:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:28:16.995225 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7317cb-3bf1-4258-8964-2a413171fb83 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:28:16.995512 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7317cb-3bf1-4258-8964-2a413171fb83 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:28:16.995784 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7317cb-3bf1-4258-8964-2a413171fb83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:28:17.053349 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-2b7317cb-3bf1-4258-8964-2a413171fb83 None None] MFA Rules not processed for user `8078e791ba68460f8b3aeafb4b79b73a`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:28:17.054556 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-2b7317cb-3bf1-4258-8964-2a413171fb83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:28:17.129201 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 742/1504] 10.222.0.27 () {58 vars in 1061 bytes} [Fri Sep 9 16:28:16 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:28:17.137069 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a677970-4da3-4642-9be5-0138c7606c5f None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:28:17.147630 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a677970-4da3-4642-9be5-0138c7606c5f None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:28:17.151096 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c484d46-baa2-45fe-8217-b8893f47797f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8078e791ba68460f8b3aeafb4b79b73a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:28:17.151682 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c484d46-baa2-45fe-8217-b8893f47797f service cinder] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:28:17.151953 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c484d46-baa2-45fe-8217-b8893f47797f service cinder] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:28:17.152221 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c484d46-baa2-45fe-8217-b8893f47797f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:28:17.160785 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c484d46-baa2-45fe-8217-b8893f47797f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:28:17.162209 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c484d46-baa2-45fe-8217-b8893f47797f service cinder] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:28:17.170821 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 763/1505] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:28:17 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 16:28:17.217132 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d83f248-ace6-474b-8339-3e5a87c35996 None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:28:17.217420 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d83f248-ace6-474b-8339-3e5a87c35996 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:28:17.217717 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d83f248-ace6-474b-8339-3e5a87c35996 None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:28:17.218997 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 743/1506] 10.222.0.27 () {52 vars in 830 bytes} [Fri Sep 9 16:28:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:28:17.223055 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c484d46-baa2-45fe-8217-b8893f47797f service cinder] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:28:17.286643 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c484d46-baa2-45fe-8217-b8893f47797f service cinder] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:28:17.291356 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0cef96-c185-4910-9498-69aebd2ea9e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:28:17.291981 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0cef96-c185-4910-9498-69aebd2ea9e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:28:17.292261 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0cef96-c185-4910-9498-69aebd2ea9e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:28:17.292534 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0cef96-c185-4910-9498-69aebd2ea9e0 admin admin] PATH_INFO: `/v3/users/307bbb6a04c64ec79c985c53839fd04e` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:28:17.293687 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0cef96-c185-4910-9498-69aebd2ea9e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=307bbb6a04c64ec79c985c53839fd04e)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:28:17.294807 dv-cinder-831247-27-smb devstack@keystone.service[81446]: WARNING py.warnings [None req-dc0cef96-c185-4910-9498-69aebd2ea9e0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 09 16:28:17.294807 dv-cinder-831247-27-smb devstack@keystone.service[81446]: warnings.warn(msg) Sep 09 16:28:17.294807 dv-cinder-831247-27-smb devstack@keystone.service[81446]: Sep 09 16:28:17.296000 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0cef96-c185-4910-9498-69aebd2ea9e0 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:28:17.363709 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-dc0cef96-c185-4910-9498-69aebd2ea9e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '307bbb6a04c64ec79c985c53839fd04e'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:28:17.377406 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-dc0cef96-c185-4910-9498-69aebd2ea9e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '307bbb6a04c64ec79c985c53839fd04e'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:28:17.401615 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-dc0cef96-c185-4910-9498-69aebd2ea9e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '307bbb6a04c64ec79c985c53839fd04e'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:28:17.405547 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:28:17.411922 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-dc0cef96-c185-4910-9498-69aebd2ea9e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '307bbb6a04c64ec79c985c53839fd04e'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:28:17.413136 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-dc0cef96-c185-4910-9498-69aebd2ea9e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '307bbb6a04c64ec79c985c53839fd04e'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:28:17.420010 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 764/1507] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 16:28:17 2022] DELETE /identity/v3/users/307bbb6a04c64ec79c985c53839fd04e => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 16:28:17.424373 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9b2187-79df-444f-8260-24a0220d498f None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:28:17.424847 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9b2187-79df-444f-8260-24a0220d498f None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:28:17.424952 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9b2187-79df-444f-8260-24a0220d498f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:28:17.444253 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-ab9b2187-79df-444f-8260-24a0220d498f None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:28:17.445458 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-ab9b2187-79df-444f-8260-24a0220d498f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:28:17.454468 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:28:17.505555 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 744/1508] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:28:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:28:17.515087 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0cef96-c185-4910-9498-69aebd2ea9e0 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:28:17.516486 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-dc0cef96-c185-4910-9498-69aebd2ea9e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:28:17.592564 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0cef96-c185-4910-9498-69aebd2ea9e0 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:28:17.596108 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7174ea2-3a47-4404-8207-cf3b68437f5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f44bfdd5214e8d84a2c0a5b1fd9b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:28:17.596701 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7174ea2-3a47-4404-8207-cf3b68437f5d service neutron] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:28:17.596991 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7174ea2-3a47-4404-8207-cf3b68437f5d service neutron] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:28:17.597239 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7174ea2-3a47-4404-8207-cf3b68437f5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:28:17.606660 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7174ea2-3a47-4404-8207-cf3b68437f5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:28:17.608075 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7174ea2-3a47-4404-8207-cf3b68437f5d service neutron] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:28:17.617199 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 765/1509] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:28:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:28:17.962542 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9b2187-79df-444f-8260-24a0220d498f None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:28:17.964064 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-ab9b2187-79df-444f-8260-24a0220d498f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:28:17.975844 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9b2187-79df-444f-8260-24a0220d498f None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:28:17.980955 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754efbd8-84c7-4509-8db2-900a319ca46b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:28:17.981879 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754efbd8-84c7-4509-8db2-900a319ca46b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:28:17.982201 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754efbd8-84c7-4509-8db2-900a319ca46b admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:28:17.982466 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754efbd8-84c7-4509-8db2-900a319ca46b admin admin] PATH_INFO: `/v3/projects/fb3f49276c7e450e80c1abde26c9b399` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:28:17.983736 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754efbd8-84c7-4509-8db2-900a319ca46b admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb3f49276c7e450e80c1abde26c9b399)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:28:17.984801 dv-cinder-831247-27-smb devstack@keystone.service[81445]: WARNING py.warnings [None req-754efbd8-84c7-4509-8db2-900a319ca46b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 09 16:28:17.984801 dv-cinder-831247-27-smb devstack@keystone.service[81445]: warnings.warn(msg) Sep 09 16:28:17.984801 dv-cinder-831247-27-smb devstack@keystone.service[81445]: Sep 09 16:28:17.986256 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754efbd8-84c7-4509-8db2-900a319ca46b admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:28:18.049406 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-754efbd8-84c7-4509-8db2-900a319ca46b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb3f49276c7e450e80c1abde26c9b399', 'request_id': 'req-754efbd8-84c7-4509-8db2-900a319ca46b'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:28:18.062404 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-754efbd8-84c7-4509-8db2-900a319ca46b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb3f49276c7e450e80c1abde26c9b399', 'request_id': 'req-754efbd8-84c7-4509-8db2-900a319ca46b'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:28:18.072797 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-754efbd8-84c7-4509-8db2-900a319ca46b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb3f49276c7e450e80c1abde26c9b399', 'request_id': 'req-754efbd8-84c7-4509-8db2-900a319ca46b'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:28:18.084243 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-754efbd8-84c7-4509-8db2-900a319ca46b admin admin] The token cache is being invalidate because project fb3f49276c7e450e80c1abde26c9b399 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81445) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 16:28:18.084525 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-754efbd8-84c7-4509-8db2-900a319ca46b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:28:18.085226 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-754efbd8-84c7-4509-8db2-900a319ca46b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:28:18.086738 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 745/1510] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 16:28:17 2022] DELETE /identity/v3/projects/fb3f49276c7e450e80c1abde26c9b399 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:28:27.613263 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:DELETE=1,keystone:SELECT=37 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:28:28.080569 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=47,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:29:48.137406 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decafc5a-3ab3-4264-b674-6ad381c6e5e1 None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:29:48.138070 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decafc5a-3ab3-4264-b674-6ad381c6e5e1 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:29:48.138070 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decafc5a-3ab3-4264-b674-6ad381c6e5e1 None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:29:48.139586 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 766/1511] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 9 16:29:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:29:48.144925 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6f816d-1b2e-4f71-9235-6112ed39a617 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:29:48.145420 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6f816d-1b2e-4f71-9235-6112ed39a617 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:29:48.145538 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6f816d-1b2e-4f71-9235-6112ed39a617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:29:48.165434 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-7b6f816d-1b2e-4f71-9235-6112ed39a617 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:29:48.166678 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-7b6f816d-1b2e-4f71-9235-6112ed39a617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:29:48.225365 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 746/1512] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 9 16:29:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:29:48.377334 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decafc5a-3ab3-4264-b674-6ad381c6e5e1 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:29:48.379074 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-decafc5a-3ab3-4264-b674-6ad381c6e5e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:29:48.479870 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decafc5a-3ab3-4264-b674-6ad381c6e5e1 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:29:48.485412 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96338db1-e6f4-4523-bfa8-3014fb9c1368 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a332b9b4980646a3b14633293f77b505', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:29:48.486003 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96338db1-e6f4-4523-bfa8-3014fb9c1368 service nova] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:29:48.486286 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96338db1-e6f4-4523-bfa8-3014fb9c1368 service nova] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:29:48.486584 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96338db1-e6f4-4523-bfa8-3014fb9c1368 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:29:48.494575 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96338db1-e6f4-4523-bfa8-3014fb9c1368 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:29:48.496145 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96338db1-e6f4-4523-bfa8-3014fb9c1368 service nova] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:29:48.505276 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 767/1513] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:29:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:29:49.596317 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb58bc4-46a8-4830-92d8-5837c25d7bcf None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:29:49.596904 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb58bc4-46a8-4830-92d8-5837c25d7bcf None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:29:49.596904 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb58bc4-46a8-4830-92d8-5837c25d7bcf None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:29:49.598175 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 747/1514] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 9 16:29:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:29:49.604207 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0117372-3a16-4d9e-b719-4c4e0f0ba777 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:29:49.604650 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0117372-3a16-4d9e-b719-4c4e0f0ba777 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:29:49.604783 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0117372-3a16-4d9e-b719-4c4e0f0ba777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:29:49.624677 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-f0117372-3a16-4d9e-b719-4c4e0f0ba777 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:29:49.625855 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-f0117372-3a16-4d9e-b719-4c4e0f0ba777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:29:49.633965 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 768/1515] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 9 16:29:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:29:49.787245 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb58bc4-46a8-4830-92d8-5837c25d7bcf None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:29:49.801788 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb58bc4-46a8-4830-92d8-5837c25d7bcf None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:29:49.807064 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3918ee0b-5c58-4dd8-9386-1a4ab4c30dd2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a332b9b4980646a3b14633293f77b505', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:29:49.807644 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3918ee0b-5c58-4dd8-9386-1a4ab4c30dd2 service nova] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:29:49.807919 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3918ee0b-5c58-4dd8-9386-1a4ab4c30dd2 service nova] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:29:49.808183 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3918ee0b-5c58-4dd8-9386-1a4ab4c30dd2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:29:49.816284 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3918ee0b-5c58-4dd8-9386-1a4ab4c30dd2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:29:49.817858 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3918ee0b-5c58-4dd8-9386-1a4ab4c30dd2 service nova] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:29:49.827191 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 748/1516] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:29:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:29:49.873267 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e13aa1-8343-4c78-827b-3a2ff4e65d7f None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:29:49.873524 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e13aa1-8343-4c78-827b-3a2ff4e65d7f None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:29:49.873798 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e13aa1-8343-4c78-827b-3a2ff4e65d7f None None] PATH_INFO: `/v3` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:29:49.875207 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 769/1517] 10.222.0.20 () {54 vars in 925 bytes} [Fri Sep 9 16:29:49 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:29:49.881701 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1b40f4-a1d8-4104-9fd5-de4380f7d9f5 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:29:49.882008 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1b40f4-a1d8-4104-9fd5-de4380f7d9f5 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:29:49.882279 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1b40f4-a1d8-4104-9fd5-de4380f7d9f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:29:49.939080 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-0e1b40f4-a1d8-4104-9fd5-de4380f7d9f5 None None] MFA Rules not processed for user `2d73df92393c43b2b5ccc32a2d43d952`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:29:49.940310 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-0e1b40f4-a1d8-4104-9fd5-de4380f7d9f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:29:50.012206 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 749/1518] 10.222.0.20 () {58 vars in 1015 bytes} [Fri Sep 9 16:29:49 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:29:53.664815 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e911db89-9405-42cc-b5b3-652e9314c652 None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:29:53.665506 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e911db89-9405-42cc-b5b3-652e9314c652 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:29:53.665506 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e911db89-9405-42cc-b5b3-652e9314c652 None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:29:53.666810 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 770/1519] 10.222.0.27 () {54 vars in 961 bytes} [Fri Sep 9 16:29:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:29:53.672800 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdea73c4-0f65-4d2e-8a13-dd21c99cc503 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:29:53.673247 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdea73c4-0f65-4d2e-8a13-dd21c99cc503 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:29:53.673354 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdea73c4-0f65-4d2e-8a13-dd21c99cc503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:29:53.693517 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-bdea73c4-0f65-4d2e-8a13-dd21c99cc503 None None] MFA Rules not processed for user `2d73df92393c43b2b5ccc32a2d43d952`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:29:53.694743 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-bdea73c4-0f65-4d2e-8a13-dd21c99cc503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:29:53.703445 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 750/1520] 10.222.0.27 () {58 vars in 1058 bytes} [Fri Sep 9 16:29:53 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 16:29:53.711301 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e911db89-9405-42cc-b5b3-652e9314c652 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:29:53.725829 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e911db89-9405-42cc-b5b3-652e9314c652 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:29:53.730803 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0549b13-926f-42a7-b274-a375f1ba6c42 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d73df92393c43b2b5ccc32a2d43d952', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:29:53.731390 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0549b13-926f-42a7-b274-a375f1ba6c42 service placement] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:29:53.731665 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0549b13-926f-42a7-b274-a375f1ba6c42 service placement] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:29:53.731928 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0549b13-926f-42a7-b274-a375f1ba6c42 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:29:53.740497 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0549b13-926f-42a7-b274-a375f1ba6c42 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:29:53.742056 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0549b13-926f-42a7-b274-a375f1ba6c42 service placement] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:29:53.752759 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 771/1521] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:29:53 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:30:01.304926 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0f5784-93ac-450f-8e99-474136d88ca5 None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:30:01.305413 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0f5784-93ac-450f-8e99-474136d88ca5 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:30:01.305510 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0f5784-93ac-450f-8e99-474136d88ca5 None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:30:01.306922 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 751/1522] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 9 16:30:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 16:30:01.313122 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d296a4-305f-4123-b480-620fe9f0ef56 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:30:01.313578 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d296a4-305f-4123-b480-620fe9f0ef56 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:30:01.313689 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d296a4-305f-4123-b480-620fe9f0ef56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:30:01.333706 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-c6d296a4-305f-4123-b480-620fe9f0ef56 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:30:01.334868 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-c6d296a4-305f-4123-b480-620fe9f0ef56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:30:01.342602 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 772/1523] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 9 16:30:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:30:01.496800 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0f5784-93ac-450f-8e99-474136d88ca5 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:30:01.511523 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0f5784-93ac-450f-8e99-474136d88ca5 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:30:01.517139 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcfde62-c0ff-4b09-951b-c7b87f539a1a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a332b9b4980646a3b14633293f77b505', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:30:01.518148 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcfde62-c0ff-4b09-951b-c7b87f539a1a service nova] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:30:01.518667 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcfde62-c0ff-4b09-951b-c7b87f539a1a service nova] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:30:01.519149 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcfde62-c0ff-4b09-951b-c7b87f539a1a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:30:01.529189 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcfde62-c0ff-4b09-951b-c7b87f539a1a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:30:01.531295 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcfde62-c0ff-4b09-951b-c7b87f539a1a service nova] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:30:01.541693 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 752/1524] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:30:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:30:02.637115 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b018ed-02a7-4162-8540-f5ad50de753e None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:30:02.637641 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b018ed-02a7-4162-8540-f5ad50de753e None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:30:02.637641 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b018ed-02a7-4162-8540-f5ad50de753e None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:30:02.639009 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 773/1525] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 9 16:30:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:30:02.645097 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aedc4b-42bb-4358-bc54-a15e47c2de59 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:30:02.645560 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aedc4b-42bb-4358-bc54-a15e47c2de59 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:30:02.645677 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aedc4b-42bb-4358-bc54-a15e47c2de59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:30:02.664588 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-14aedc4b-42bb-4358-bc54-a15e47c2de59 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:30:02.665776 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-14aedc4b-42bb-4358-bc54-a15e47c2de59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:30:02.673962 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 753/1526] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 9 16:30:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:30:02.825258 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b018ed-02a7-4162-8540-f5ad50de753e None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:30:02.839414 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b018ed-02a7-4162-8540-f5ad50de753e None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:30:02.845313 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda24480-044e-4a54-a630-d2270a9a1f95 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a332b9b4980646a3b14633293f77b505', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:30:02.845901 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda24480-044e-4a54-a630-d2270a9a1f95 service nova] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:30:02.846177 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda24480-044e-4a54-a630-d2270a9a1f95 service nova] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:30:02.846479 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda24480-044e-4a54-a630-d2270a9a1f95 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:30:02.854449 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda24480-044e-4a54-a630-d2270a9a1f95 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:30:02.856003 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda24480-044e-4a54-a630-d2270a9a1f95 service nova] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:30:02.865768 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 774/1527] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:30:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:30:06.874804 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c3c8b1-b5be-4002-8824-4cdff0e89812 None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:30:06.875370 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c3c8b1-b5be-4002-8824-4cdff0e89812 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:30:06.875370 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c3c8b1-b5be-4002-8824-4cdff0e89812 None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:30:06.876707 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 754/1528] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 9 16:30:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:30:06.881794 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7532ce-c457-46fe-a82f-73181a1b87a7 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:30:06.882232 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7532ce-c457-46fe-a82f-73181a1b87a7 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:30:06.882412 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7532ce-c457-46fe-a82f-73181a1b87a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:30:06.901851 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-4d7532ce-c457-46fe-a82f-73181a1b87a7 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:30:06.903077 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-4d7532ce-c457-46fe-a82f-73181a1b87a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:30:06.911514 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 775/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 9 16:30:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:30:07.219597 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c3c8b1-b5be-4002-8824-4cdff0e89812 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:30:07.221317 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-22c3c8b1-b5be-4002-8824-4cdff0e89812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:30:07.249082 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:30:07.278276 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c3c8b1-b5be-4002-8824-4cdff0e89812 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:30:07.282495 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6280de1f-fbee-4ad8-b91e-09f824fc1a7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f44bfdd5214e8d84a2c0a5b1fd9b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:30:07.283200 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6280de1f-fbee-4ad8-b91e-09f824fc1a7b service neutron] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:30:07.283477 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6280de1f-fbee-4ad8-b91e-09f824fc1a7b service neutron] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:30:07.283749 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6280de1f-fbee-4ad8-b91e-09f824fc1a7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:30:07.292823 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6280de1f-fbee-4ad8-b91e-09f824fc1a7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:30:07.294243 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6280de1f-fbee-4ad8-b91e-09f824fc1a7b service neutron] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:30:07.303336 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 755/1530] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:30:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:30:09.452475 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c334d586-ae06-4c92-9ef1-3e1ca3bc3ab1 None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:30:09.453007 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c334d586-ae06-4c92-9ef1-3e1ca3bc3ab1 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:30:09.453128 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c334d586-ae06-4c92-9ef1-3e1ca3bc3ab1 None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:30:09.454560 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 776/1531] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 9 16:30:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:30:09.459764 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a4242f-3311-41b1-a296-180c95c2b5b7 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:30:09.460219 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a4242f-3311-41b1-a296-180c95c2b5b7 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:30:09.460316 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a4242f-3311-41b1-a296-180c95c2b5b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:30:09.479318 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-d2a4242f-3311-41b1-a296-180c95c2b5b7 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:30:09.480503 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-d2a4242f-3311-41b1-a296-180c95c2b5b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:30:09.488719 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 756/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 9 16:30:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:30:09.774680 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c334d586-ae06-4c92-9ef1-3e1ca3bc3ab1 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:30:09.786191 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c334d586-ae06-4c92-9ef1-3e1ca3bc3ab1 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:30:09.789652 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dea78a3-9f27-4d8b-bbf9-ab9663df4ab7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f44bfdd5214e8d84a2c0a5b1fd9b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:30:09.790242 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dea78a3-9f27-4d8b-bbf9-ab9663df4ab7 service neutron] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:30:09.790553 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dea78a3-9f27-4d8b-bbf9-ab9663df4ab7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:30:09.791087 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dea78a3-9f27-4d8b-bbf9-ab9663df4ab7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:30:09.800795 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dea78a3-9f27-4d8b-bbf9-ab9663df4ab7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:30:09.802234 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dea78a3-9f27-4d8b-bbf9-ab9663df4ab7 service neutron] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:30:09.811388 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 777/1533] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:30:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:30:13.498209 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14960b7-eb02-49c7-9adb-d0994b9e9210 None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:30:13.498776 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14960b7-eb02-49c7-9adb-d0994b9e9210 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:30:13.498776 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14960b7-eb02-49c7-9adb-d0994b9e9210 None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:30:13.500151 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 757/1534] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 9 16:30:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:30:13.505422 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1492b98-1809-4060-9fdd-2e93be7adcac None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:30:13.505873 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1492b98-1809-4060-9fdd-2e93be7adcac None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:30:13.505995 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1492b98-1809-4060-9fdd-2e93be7adcac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:30:13.525210 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-f1492b98-1809-4060-9fdd-2e93be7adcac None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:30:13.526422 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-f1492b98-1809-4060-9fdd-2e93be7adcac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:30:13.534518 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 778/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 9 16:30:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:30:13.837108 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14960b7-eb02-49c7-9adb-d0994b9e9210 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:30:13.838877 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-f14960b7-eb02-49c7-9adb-d0994b9e9210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:30:13.894898 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14960b7-eb02-49c7-9adb-d0994b9e9210 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:30:13.898389 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b21a43d-2afb-4617-935c-b3e81c8efaa1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8078e791ba68460f8b3aeafb4b79b73a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:30:13.898985 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b21a43d-2afb-4617-935c-b3e81c8efaa1 service cinder] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:30:13.899264 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b21a43d-2afb-4617-935c-b3e81c8efaa1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:30:13.899537 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b21a43d-2afb-4617-935c-b3e81c8efaa1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:30:13.908767 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b21a43d-2afb-4617-935c-b3e81c8efaa1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:30:13.910213 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b21a43d-2afb-4617-935c-b3e81c8efaa1 service cinder] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:30:13.919641 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 758/1536] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:30:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:30:16.069937 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601e219f-bb8c-450f-bd98-eca40539e951 None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:30:16.070520 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601e219f-bb8c-450f-bd98-eca40539e951 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:30:16.070520 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601e219f-bb8c-450f-bd98-eca40539e951 None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:30:16.071850 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 779/1537] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 9 16:30:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:30:16.076986 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575d5a8f-0793-4b86-aa9d-e09716da6ef9 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:30:16.077927 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575d5a8f-0793-4b86-aa9d-e09716da6ef9 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:30:16.078067 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575d5a8f-0793-4b86-aa9d-e09716da6ef9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:30:16.097784 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-575d5a8f-0793-4b86-aa9d-e09716da6ef9 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:30:16.099002 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-575d5a8f-0793-4b86-aa9d-e09716da6ef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:30:16.106679 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 759/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 9 16:30:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:30:16.415134 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601e219f-bb8c-450f-bd98-eca40539e951 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:30:16.416832 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-601e219f-bb8c-450f-bd98-eca40539e951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:30:16.429779 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601e219f-bb8c-450f-bd98-eca40539e951 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:30:16.433363 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1a93c5-9778-43f6-9b68-a33fd57c3c5c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8078e791ba68460f8b3aeafb4b79b73a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:30:16.433953 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1a93c5-9778-43f6-9b68-a33fd57c3c5c service cinder] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:30:16.434239 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1a93c5-9778-43f6-9b68-a33fd57c3c5c service cinder] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:30:16.434545 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1a93c5-9778-43f6-9b68-a33fd57c3c5c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:30:16.444405 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1a93c5-9778-43f6-9b68-a33fd57c3c5c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:30:16.445832 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1a93c5-9778-43f6-9b68-a33fd57c3c5c service cinder] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:30:16.455724 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 780/1539] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:30:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:30:26.091885 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=47 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:30:26.451030 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=82 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:31:42.368934 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc34f1dd-d9f7-4415-8f0d-ceaa1368d7fa None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:31:42.369567 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc34f1dd-d9f7-4415-8f0d-ceaa1368d7fa None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:31:42.369567 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc34f1dd-d9f7-4415-8f0d-ceaa1368d7fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:31:42.409068 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-bc34f1dd-d9f7-4415-8f0d-ceaa1368d7fa None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:31:42.410193 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-bc34f1dd-d9f7-4415-8f0d-ceaa1368d7fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:31:42.416687 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18ebad2-180a-4e32-8653-c31dc12f04de None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:31:42.417268 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18ebad2-180a-4e32-8653-c31dc12f04de None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:31:42.417268 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18ebad2-180a-4e32-8653-c31dc12f04de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:31:42.423308 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 760/1540] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:31:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 16:31:42.432219 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37559671-c618-4ce4-8262-7e08150ef26d None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:31:42.432573 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37559671-c618-4ce4-8262-7e08150ef26d None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:31:42.432769 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37559671-c618-4ce4-8262-7e08150ef26d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:31:42.448692 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-c18ebad2-180a-4e32-8653-c31dc12f04de None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:31:42.450556 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-c18ebad2-180a-4e32-8653-c31dc12f04de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:31:42.463617 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-37559671-c618-4ce4-8262-7e08150ef26d None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:31:42.464864 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-37559671-c618-4ce4-8262-7e08150ef26d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:31:42.472064 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 781/1541] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:31:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 16:31:42.481394 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f88697-7104-49a4-a47d-85f9deeb1a3d None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:31:42.482037 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f88697-7104-49a4-a47d-85f9deeb1a3d None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:31:42.482184 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 761/1542] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:31:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 16:31:42.482798 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f88697-7104-49a4-a47d-85f9deeb1a3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:31:42.488639 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37559671-c618-4ce4-8262-7e08150ef26d None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:31:42.501389 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37559671-c618-4ce4-8262-7e08150ef26d None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:31:42.511849 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-29f88697-7104-49a4-a47d-85f9deeb1a3d None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:31:42.512675 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb821214-3022-4e1d-a502-846664ae00de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:31:42.513302 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb821214-3022-4e1d-a502-846664ae00de admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:31:42.513581 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb821214-3022-4e1d-a502-846664ae00de admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:31:42.513848 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb821214-3022-4e1d-a502-846664ae00de admin admin] PATH_INFO: `/v3/domains` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:31:42.514528 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb821214-3022-4e1d-a502-846664ae00de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:31:42.514821 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-29f88697-7104-49a4-a47d-85f9deeb1a3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:31:42.515028 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb821214-3022-4e1d-a502-846664ae00de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:31:42.516792 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb821214-3022-4e1d-a502-846664ae00de admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:31:42.530696 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 782/1543] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:31:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 16:31:42.535865 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f88697-7104-49a4-a47d-85f9deeb1a3d None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:31:42.538852 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 762/1544] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Sep 9 16:31:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 16:31:42.542946 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb821214-3022-4e1d-a502-846664ae00de admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:31:42.552220 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f88697-7104-49a4-a47d-85f9deeb1a3d None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:31:42.556813 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb821214-3022-4e1d-a502-846664ae00de admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:31:42.562778 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b312f5b-4739-4c35-9561-80b2ee1a3ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:31:42.563959 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b312f5b-4739-4c35-9561-80b2ee1a3ad5 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:31:42.564466 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b312f5b-4739-4c35-9561-80b2ee1a3ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:31:42.565368 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b312f5b-4739-4c35-9561-80b2ee1a3ad5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:31:42.566283 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b312f5b-4739-4c35-9561-80b2ee1a3ad5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:31:42.566873 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b312f5b-4739-4c35-9561-80b2ee1a3ad5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:31:42.568156 dv-cinder-831247-27-smb devstack@keystone.service[81446]: WARNING py.warnings [None req-3b312f5b-4739-4c35-9561-80b2ee1a3ad5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 09 16:31:42.568156 dv-cinder-831247-27-smb devstack@keystone.service[81446]: warnings.warn(msg) Sep 09 16:31:42.568156 dv-cinder-831247-27-smb devstack@keystone.service[81446]: Sep 09 16:31:42.569745 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4cae61-7760-4170-a1ec-7728bb95fd0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:31:42.569899 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b312f5b-4739-4c35-9561-80b2ee1a3ad5 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:31:42.570388 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4cae61-7760-4170-a1ec-7728bb95fd0f admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:31:42.570665 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4cae61-7760-4170-a1ec-7728bb95fd0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:31:42.570933 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4cae61-7760-4170-a1ec-7728bb95fd0f admin admin] PATH_INFO: `/v3/projects` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:31:42.571566 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4cae61-7760-4170-a1ec-7728bb95fd0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:31:42.572844 dv-cinder-831247-27-smb devstack@keystone.service[81445]: WARNING py.warnings [None req-bb4cae61-7760-4170-a1ec-7728bb95fd0f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 09 16:31:42.572844 dv-cinder-831247-27-smb devstack@keystone.service[81445]: warnings.warn(msg) Sep 09 16:31:42.572844 dv-cinder-831247-27-smb devstack@keystone.service[81445]: Sep 09 16:31:42.573757 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4cae61-7760-4170-a1ec-7728bb95fd0f admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:31:42.600852 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 783/1545] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Sep 9 16:31:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 16:31:42.602521 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8ce77c-0cdd-47e0-9262-86fcb25f605a None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:31:42.603035 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8ce77c-0cdd-47e0-9262-86fcb25f605a None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:31:42.603525 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8ce77c-0cdd-47e0-9262-86fcb25f605a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:31:42.642668 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 763/1546] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 16:31:42 2022] POST /identity/v3/projects => generated 405 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 16:31:42.643845 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4cae61-7760-4170-a1ec-7728bb95fd0f admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:31:42.646711 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-ed8ce77c-0cdd-47e0-9262-86fcb25f605a None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:31:42.650339 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-ed8ce77c-0cdd-47e0-9262-86fcb25f605a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:31:42.728204 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4cae61-7760-4170-a1ec-7728bb95fd0f admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:31:42.740795 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c33db8-627b-43f9-862c-d2219e20a635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:31:42.741409 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c33db8-627b-43f9-862c-d2219e20a635 admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:31:42.741683 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c33db8-627b-43f9-862c-d2219e20a635 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:31:42.741948 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c33db8-627b-43f9-862c-d2219e20a635 admin admin] PATH_INFO: `/v3/projects` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:31:42.742602 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c33db8-627b-43f9-862c-d2219e20a635 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:31:42.744526 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c33db8-627b-43f9-862c-d2219e20a635 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:31:42.756343 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 784/1547] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:31:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:31:42.756961 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8ce77c-0cdd-47e0-9262-86fcb25f605a None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:31:42.770197 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8ce77c-0cdd-47e0-9262-86fcb25f605a None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:31:42.786609 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed28d70-99e9-4454-8c9c-c779a3cfe557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:31:42.787294 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed28d70-99e9-4454-8c9c-c779a3cfe557 admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:31:42.787650 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed28d70-99e9-4454-8c9c-c779a3cfe557 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:31:42.787975 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed28d70-99e9-4454-8c9c-c779a3cfe557 admin admin] PATH_INFO: `/v3/users` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:31:42.788724 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed28d70-99e9-4454-8c9c-c779a3cfe557 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:31:42.789817 dv-cinder-831247-27-smb devstack@keystone.service[81446]: WARNING py.warnings [None req-4ed28d70-99e9-4454-8c9c-c779a3cfe557 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 09 16:31:42.789817 dv-cinder-831247-27-smb devstack@keystone.service[81446]: warnings.warn(msg) Sep 09 16:31:42.789817 dv-cinder-831247-27-smb devstack@keystone.service[81446]: Sep 09 16:31:42.791158 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed28d70-99e9-4454-8c9c-c779a3cfe557 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:31:42.793224 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 764/1548] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 16:31:42 2022] POST /identity/v3/projects => generated 391 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:31:42.795139 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5231d8d3-a400-4b64-829a-bb2057d01ce3 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:31:42.795850 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5231d8d3-a400-4b64-829a-bb2057d01ce3 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:31:42.796536 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5231d8d3-a400-4b64-829a-bb2057d01ce3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:31:42.819740 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-5231d8d3-a400-4b64-829a-bb2057d01ce3 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:31:42.821021 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-5231d8d3-a400-4b64-829a-bb2057d01ce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:31:42.831309 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 785/1549] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 16:31:42 2022] POST /identity/v3/users => generated 303 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:31:42.833829 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e962f8-9cd4-4879-9335-282fd64c6640 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:31:42.834288 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e962f8-9cd4-4879-9335-282fd64c6640 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:31:42.834984 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e962f8-9cd4-4879-9335-282fd64c6640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:31:42.854628 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-b3e962f8-9cd4-4879-9335-282fd64c6640 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:31:42.855861 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-b3e962f8-9cd4-4879-9335-282fd64c6640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:31:42.891674 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 765/1550] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:31:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:31:42.893099 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1cc336-1e81-4458-8dae-ace058835af6 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:31:42.893388 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1cc336-1e81-4458-8dae-ace058835af6 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:31:42.894511 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1cc336-1e81-4458-8dae-ace058835af6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:31:42.913949 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-8c1cc336-1e81-4458-8dae-ace058835af6 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:31:42.915181 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-8c1cc336-1e81-4458-8dae-ace058835af6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:31:42.923240 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 766/1551] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:31:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:31:42.923769 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1cc336-1e81-4458-8dae-ace058835af6 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:31:42.934851 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1cc336-1e81-4458-8dae-ace058835af6 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:31:42.935540 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 786/1552] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:31:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:31:42.937458 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdd0a87-d929-437e-b070-0e4752c51e9c None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:31:42.937747 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdd0a87-d929-437e-b070-0e4752c51e9c None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:31:42.938151 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdd0a87-d929-437e-b070-0e4752c51e9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:31:42.942681 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ad7121-59b7-453c-801c-459a3f4a9e0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:31:42.943270 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ad7121-59b7-453c-801c-459a3f4a9e0b admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:31:42.943543 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ad7121-59b7-453c-801c-459a3f4a9e0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:31:42.943807 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ad7121-59b7-453c-801c-459a3f4a9e0b admin admin] PATH_INFO: `/v3/users` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:31:42.944414 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ad7121-59b7-453c-801c-459a3f4a9e0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:31:42.946391 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ad7121-59b7-453c-801c-459a3f4a9e0b admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:31:42.958682 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-9bdd0a87-d929-437e-b070-0e4752c51e9c None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:31:42.960246 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-9bdd0a87-d929-437e-b070-0e4752c51e9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:31:42.969567 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 787/1553] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:31:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:31:42.972809 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 767/1554] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 16:31:42 2022] POST /identity/v3/users => generated 296 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:31:42.972957 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84824ca-cfd3-426a-a8aa-3de02e37856d None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:31:42.973082 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ad7121-59b7-453c-801c-459a3f4a9e0b admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:31:42.973186 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84824ca-cfd3-426a-a8aa-3de02e37856d None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:31:42.973186 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84824ca-cfd3-426a-a8aa-3de02e37856d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:31:42.986074 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ad7121-59b7-453c-801c-459a3f4a9e0b admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:31:42.990983 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3ab420-0e80-425f-90dd-8a9129083761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:31:42.991652 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3ab420-0e80-425f-90dd-8a9129083761 admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:31:42.991827 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-f84824ca-cfd3-426a-a8aa-3de02e37856d None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:31:42.992055 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3ab420-0e80-425f-90dd-8a9129083761 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:31:42.992395 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3ab420-0e80-425f-90dd-8a9129083761 admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:31:42.993013 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-f84824ca-cfd3-426a-a8aa-3de02e37856d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:31:42.993158 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3ab420-0e80-425f-90dd-8a9129083761 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:31:42.994982 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3ab420-0e80-425f-90dd-8a9129083761 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:31:43.001363 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 788/1555] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:31:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:31:43.002550 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035c6ab4-c0ea-465c-b42f-bc28fbf35257 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:31:43.002833 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035c6ab4-c0ea-465c-b42f-bc28fbf35257 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:31:43.003102 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035c6ab4-c0ea-465c-b42f-bc28fbf35257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:31:43.006505 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 768/1556] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:31:42 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:31:43.007835 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dae0bd1-4b5e-4d31-85fe-3d8b87be0111 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:31:43.008126 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dae0bd1-4b5e-4d31-85fe-3d8b87be0111 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:31:43.008401 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dae0bd1-4b5e-4d31-85fe-3d8b87be0111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:31:43.016091 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:31:43.025894 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-035c6ab4-c0ea-465c-b42f-bc28fbf35257 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:31:43.027126 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-035c6ab4-c0ea-465c-b42f-bc28fbf35257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:31:43.029427 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-2dae0bd1-4b5e-4d31-85fe-3d8b87be0111 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:31:43.030743 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-2dae0bd1-4b5e-4d31-85fe-3d8b87be0111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:31:43.035195 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 789/1557] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:31:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:31:43.036170 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfa9102-264d-4884-82b9-3f261ea1a199 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:31:43.036449 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfa9102-264d-4884-82b9-3f261ea1a199 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:31:43.036720 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfa9102-264d-4884-82b9-3f261ea1a199 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:31:43.041602 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 769/1558] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:31:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:31:43.043009 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dae0bd1-4b5e-4d31-85fe-3d8b87be0111 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:31:43.053798 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dae0bd1-4b5e-4d31-85fe-3d8b87be0111 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:31:43.056966 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-edfa9102-264d-4884-82b9-3f261ea1a199 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:31:43.058148 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-edfa9102-264d-4884-82b9-3f261ea1a199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:31:43.058502 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bd2061-e163-41c8-bf64-35d2daa693f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:31:43.059096 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bd2061-e163-41c8-bf64-35d2daa693f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:31:43.059376 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bd2061-e163-41c8-bf64-35d2daa693f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:31:43.059647 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bd2061-e163-41c8-bf64-35d2daa693f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:31:43.060277 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bd2061-e163-41c8-bf64-35d2daa693f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:31:43.060581 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bd2061-e163-41c8-bf64-35d2daa693f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:31:43.062791 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bd2061-e163-41c8-bf64-35d2daa693f8 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:31:43.067119 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 790/1559] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:31:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:31:43.067943 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfa9102-264d-4884-82b9-3f261ea1a199 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:31:43.075578 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 770/1560] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Sep 9 16:31:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:31:43.075578 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896c31e2-c683-439b-8dc9-e958ae1b572c None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:31:43.082693 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfa9102-264d-4884-82b9-3f261ea1a199 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:31:43.082812 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896c31e2-c683-439b-8dc9-e958ae1b572c None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:31:43.082812 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896c31e2-c683-439b-8dc9-e958ae1b572c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:31:43.082994 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77060c4-e88a-4631-b9e1-1b609be0f266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:31:43.082994 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77060c4-e88a-4631-b9e1-1b609be0f266 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:31:43.082994 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77060c4-e88a-4631-b9e1-1b609be0f266 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:31:43.083276 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77060c4-e88a-4631-b9e1-1b609be0f266 admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:31:43.083739 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77060c4-e88a-4631-b9e1-1b609be0f266 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:31:43.085322 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77060c4-e88a-4631-b9e1-1b609be0f266 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:31:43.095392 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 791/1561] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:31:43 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:31:43.096474 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bffe78-62b4-4826-b541-da28d3fb3545 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:31:43.096755 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bffe78-62b4-4826-b541-da28d3fb3545 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:31:43.096853 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-896c31e2-c683-439b-8dc9-e958ae1b572c None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:31:43.097021 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bffe78-62b4-4826-b541-da28d3fb3545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:31:43.098213 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-896c31e2-c683-439b-8dc9-e958ae1b572c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:31:43.106144 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 771/1562] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:31:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:31:43.107016 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896c31e2-c683-439b-8dc9-e958ae1b572c None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:31:43.116050 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-f4bffe78-62b4-4826-b541-da28d3fb3545 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:31:43.116909 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896c31e2-c683-439b-8dc9-e958ae1b572c None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:31:43.117213 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-f4bffe78-62b4-4826-b541-da28d3fb3545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:31:43.121435 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a02bdd3-8485-4225-aa56-d01f954a9445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:31:43.122003 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a02bdd3-8485-4225-aa56-d01f954a9445 admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:31:43.122281 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a02bdd3-8485-4225-aa56-d01f954a9445 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:31:43.122579 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a02bdd3-8485-4225-aa56-d01f954a9445 admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:31:43.123212 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a02bdd3-8485-4225-aa56-d01f954a9445 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:31:43.124883 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a02bdd3-8485-4225-aa56-d01f954a9445 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:31:43.125291 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 792/1563] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:31:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:31:43.126503 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f634cb8-6006-4f2c-930e-7ffcbaf507b6 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:31:43.126812 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f634cb8-6006-4f2c-930e-7ffcbaf507b6 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:31:43.127084 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f634cb8-6006-4f2c-930e-7ffcbaf507b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:31:43.142008 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 772/1564] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:31:43 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:31:43.142008 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a02bdd3-8485-4225-aa56-d01f954a9445 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:31:43.148317 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-6f634cb8-6006-4f2c-930e-7ffcbaf507b6 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:31:43.149502 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-6f634cb8-6006-4f2c-930e-7ffcbaf507b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:31:43.149718 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a02bdd3-8485-4225-aa56-d01f954a9445 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:31:43.155451 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b33e26b-6b5a-45ec-8179-0002b26490d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:31:43.156029 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b33e26b-6b5a-45ec-8179-0002b26490d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:31:43.156303 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b33e26b-6b5a-45ec-8179-0002b26490d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:31:43.156571 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b33e26b-6b5a-45ec-8179-0002b26490d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:31:43.157197 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b33e26b-6b5a-45ec-8179-0002b26490d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:31:43.157492 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b33e26b-6b5a-45ec-8179-0002b26490d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:31:43.157586 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 793/1565] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:31:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:31:43.158280 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f634cb8-6006-4f2c-930e-7ffcbaf507b6 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:31:43.159310 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b33e26b-6b5a-45ec-8179-0002b26490d7 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:31:43.167797 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f634cb8-6006-4f2c-930e-7ffcbaf507b6 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:31:43.178973 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 773/1566] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Sep 9 16:31:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:31:43.179184 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a603f6-3bcd-454c-9ca7-d73a41964b74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:31:43.179319 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b33e26b-6b5a-45ec-8179-0002b26490d7 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:31:43.179402 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a603f6-3bcd-454c-9ca7-d73a41964b74 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:31:43.179402 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a603f6-3bcd-454c-9ca7-d73a41964b74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:31:43.179402 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a603f6-3bcd-454c-9ca7-d73a41964b74 admin admin] PATH_INFO: `/v3/domains` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:31:43.179402 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a603f6-3bcd-454c-9ca7-d73a41964b74 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:31:43.179402 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a603f6-3bcd-454c-9ca7-d73a41964b74 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:31:43.179402 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a603f6-3bcd-454c-9ca7-d73a41964b74 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:31:43.180407 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:31:43.183132 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b33e26b-6b5a-45ec-8179-0002b26490d7 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:31:43.187960 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ea1a32-c5d1-4801-8c39-ad26428c9ab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:31:43.188538 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ea1a32-c5d1-4801-8c39-ad26428c9ab2 admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:31:43.188823 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ea1a32-c5d1-4801-8c39-ad26428c9ab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:31:43.189092 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ea1a32-c5d1-4801-8c39-ad26428c9ab2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:31:43.189962 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ea1a32-c5d1-4801-8c39-ad26428c9ab2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:31:43.191879 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ea1a32-c5d1-4801-8c39-ad26428c9ab2 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:31:43.192489 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 794/1567] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Sep 9 16:31:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:31:43.193328 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a603f6-3bcd-454c-9ca7-d73a41964b74 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:31:43.204773 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a603f6-3bcd-454c-9ca7-d73a41964b74 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:31:43.209580 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067d06b2-02e0-4391-983a-8b4952d5134c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:31:43.210127 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067d06b2-02e0-4391-983a-8b4952d5134c admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:31:43.210447 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067d06b2-02e0-4391-983a-8b4952d5134c admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:31:43.210769 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067d06b2-02e0-4391-983a-8b4952d5134c admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:31:43.211348 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067d06b2-02e0-4391-983a-8b4952d5134c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:31:43.212935 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067d06b2-02e0-4391-983a-8b4952d5134c admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:31:43.220051 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 774/1568] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 16:31:43 2022] POST /identity/v3/projects => generated 379 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:31:43.220849 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ea1a32-c5d1-4801-8c39-ad26428c9ab2 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:31:43.224175 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 795/1569] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:31:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:31:43.224859 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067d06b2-02e0-4391-983a-8b4952d5134c admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:31:43.235132 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067d06b2-02e0-4391-983a-8b4952d5134c admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:31:43.284627 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ea1a32-c5d1-4801-8c39-ad26428c9ab2 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:31:43.290408 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84187bac-8976-4028-a4fb-9c1821d86e22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:31:43.291017 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84187bac-8976-4028-a4fb-9c1821d86e22 admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:31:43.291294 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84187bac-8976-4028-a4fb-9c1821d86e22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:31:43.291861 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84187bac-8976-4028-a4fb-9c1821d86e22 admin admin] PATH_INFO: `/v3/domains` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:31:43.292204 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84187bac-8976-4028-a4fb-9c1821d86e22 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:31:43.292504 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84187bac-8976-4028-a4fb-9c1821d86e22 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:31:43.294154 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84187bac-8976-4028-a4fb-9c1821d86e22 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:31:43.298538 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af0d3e8-1ec7-433c-8fb1-321fbf7312e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:31:43.299168 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af0d3e8-1ec7-433c-8fb1-321fbf7312e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:31:43.299442 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af0d3e8-1ec7-433c-8fb1-321fbf7312e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:31:43.299720 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af0d3e8-1ec7-433c-8fb1-321fbf7312e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:31:43.300339 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af0d3e8-1ec7-433c-8fb1-321fbf7312e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:31:43.300635 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af0d3e8-1ec7-433c-8fb1-321fbf7312e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:31:43.302204 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af0d3e8-1ec7-433c-8fb1-321fbf7312e9 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:31:43.307065 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 775/1570] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Sep 9 16:31:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:31:43.307065 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84187bac-8976-4028-a4fb-9c1821d86e22 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:31:43.314517 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 796/1571] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Sep 9 16:31:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:31:43.315539 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af0d3e8-1ec7-433c-8fb1-321fbf7312e9 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:31:43.324378 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84187bac-8976-4028-a4fb-9c1821d86e22 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:31:43.324903 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af0d3e8-1ec7-433c-8fb1-321fbf7312e9 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:31:43.329231 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e466fa7e-0309-4b05-a898-aa022e0c62ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:31:43.329383 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2c6dd9-5ced-4df6-919d-8bb76182ada7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:31:43.329952 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2c6dd9-5ced-4df6-919d-8bb76182ada7 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:31:43.330066 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e466fa7e-0309-4b05-a898-aa022e0c62ee admin admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:31:43.330226 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2c6dd9-5ced-4df6-919d-8bb76182ada7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:31:43.330478 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e466fa7e-0309-4b05-a898-aa022e0c62ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:31:43.330607 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2c6dd9-5ced-4df6-919d-8bb76182ada7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:31:43.330888 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e466fa7e-0309-4b05-a898-aa022e0c62ee admin admin] PATH_INFO: `/v3/projects/0b135393844e481f8d0cfadb7c3d41a5/users/8a162186f2ae49399fb410f2be0d822c/roles/b38e84bf077846ee802e6bb1bad83522` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:31:43.331135 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2c6dd9-5ced-4df6-919d-8bb76182ada7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:31:43.331430 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2c6dd9-5ced-4df6-919d-8bb76182ada7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:31:43.332996 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2c6dd9-5ced-4df6-919d-8bb76182ada7 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:31:43.345306 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 797/1572] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Sep 9 16:31:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:31:43.346077 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2c6dd9-5ced-4df6-919d-8bb76182ada7 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:31:43.347715 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e466fa7e-0309-4b05-a898-aa022e0c62ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b135393844e481f8d0cfadb7c3d41a5, user_id=8a162186f2ae49399fb410f2be0d822c, role_id=b38e84bf077846ee802e6bb1bad83522)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:31:43.349418 dv-cinder-831247-27-smb devstack@keystone.service[81445]: WARNING py.warnings [None req-e466fa7e-0309-4b05-a898-aa022e0c62ee admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 09 16:31:43.349418 dv-cinder-831247-27-smb devstack@keystone.service[81445]: warnings.warn(msg) Sep 09 16:31:43.349418 dv-cinder-831247-27-smb devstack@keystone.service[81445]: Sep 09 16:31:43.351430 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e466fa7e-0309-4b05-a898-aa022e0c62ee admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:31:43.357224 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2c6dd9-5ced-4df6-919d-8bb76182ada7 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:31:43.363152 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99969bb4-8591-4410-9f84-f232fd8e12ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:31:43.363742 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99969bb4-8591-4410-9f84-f232fd8e12ba admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:31:43.364013 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99969bb4-8591-4410-9f84-f232fd8e12ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:31:43.364275 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99969bb4-8591-4410-9f84-f232fd8e12ba admin admin] PATH_INFO: `/v3/projects` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:31:43.364898 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99969bb4-8591-4410-9f84-f232fd8e12ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:31:43.366825 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99969bb4-8591-4410-9f84-f232fd8e12ba admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:31:43.367000 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 776/1573] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 16:31:43 2022] PUT /identity/v3/projects/0b135393844e481f8d0cfadb7c3d41a5/users/8a162186f2ae49399fb410f2be0d822c/roles/b38e84bf077846ee802e6bb1bad83522 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:31:43.367820 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e466fa7e-0309-4b05-a898-aa022e0c62ee admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:31:43.395110 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 798/1574] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 16:31:43 2022] POST /identity/v3/projects => generated 377 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:31:43.396164 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99969bb4-8591-4410-9f84-f232fd8e12ba admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:31:43.442151 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e466fa7e-0309-4b05-a898-aa022e0c62ee admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:31:43.445960 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:31:43.458267 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99969bb4-8591-4410-9f84-f232fd8e12ba admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:31:43.462863 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ceec69-02bf-4be2-97f4-145423e690d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:31:43.463457 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ceec69-02bf-4be2-97f4-145423e690d8 admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:31:43.463734 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ceec69-02bf-4be2-97f4-145423e690d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:31:43.464002 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ceec69-02bf-4be2-97f4-145423e690d8 admin admin] PATH_INFO: `/v3/users` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:31:43.464615 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ceec69-02bf-4be2-97f4-145423e690d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:31:43.466961 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ceec69-02bf-4be2-97f4-145423e690d8 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:31:43.489502 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 799/1575] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 16:31:43 2022] POST /identity/v3/users => generated 290 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:31:43.490626 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ceec69-02bf-4be2-97f4-145423e690d8 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:31:43.500872 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ceec69-02bf-4be2-97f4-145423e690d8 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:31:43.504406 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e168ebe8-4545-48c9-a928-774b927a08e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:31:43.505168 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e168ebe8-4545-48c9-a928-774b927a08e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:31:43.505437 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662bcf3a-afa3-418c-acef-b5801406675e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:31:43.505607 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e168ebe8-4545-48c9-a928-774b927a08e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:31:43.505772 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e168ebe8-4545-48c9-a928-774b927a08e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:31:43.506064 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662bcf3a-afa3-418c-acef-b5801406675e admin admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:31:43.506377 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662bcf3a-afa3-418c-acef-b5801406675e admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:31:43.506497 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e168ebe8-4545-48c9-a928-774b927a08e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:31:43.506674 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662bcf3a-afa3-418c-acef-b5801406675e admin admin] PATH_INFO: `/v3/projects/67f04562cdbc4a5a9fc822e383c5de6a/users/c85e41cec8cc45608a3f7415884e750c/roles/b38e84bf077846ee802e6bb1bad83522` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:31:43.508391 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e168ebe8-4545-48c9-a928-774b927a08e6 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:31:43.521640 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662bcf3a-afa3-418c-acef-b5801406675e admin admin] RBAC: Authorizing `identity:create_grant(project_id=67f04562cdbc4a5a9fc822e383c5de6a, user_id=c85e41cec8cc45608a3f7415884e750c, role_id=b38e84bf077846ee802e6bb1bad83522)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:31:43.524328 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662bcf3a-afa3-418c-acef-b5801406675e admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:31:43.536789 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 777/1576] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 16:31:43 2022] POST /identity/v3/projects => generated 363 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:31:43.537644 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e168ebe8-4545-48c9-a928-774b927a08e6 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:31:43.538076 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 800/1577] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 16:31:43 2022] PUT /identity/v3/projects/67f04562cdbc4a5a9fc822e383c5de6a/users/c85e41cec8cc45608a3f7415884e750c/roles/b38e84bf077846ee802e6bb1bad83522 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:31:43.541856 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662bcf3a-afa3-418c-acef-b5801406675e admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:31:43.550149 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:31:43.602445 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e168ebe8-4545-48c9-a928-774b927a08e6 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:31:43.606007 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662bcf3a-afa3-418c-acef-b5801406675e admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:31:43.607256 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c8fe48-067c-4457-b7e3-13780d331ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:31:43.607859 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c8fe48-067c-4457-b7e3-13780d331ff7 admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:31:43.608137 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c8fe48-067c-4457-b7e3-13780d331ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:31:43.608409 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c8fe48-067c-4457-b7e3-13780d331ff7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:31:43.609115 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c8fe48-067c-4457-b7e3-13780d331ff7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:31:43.610966 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec407cd-0d73-482b-ac6d-905661d86d10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:31:43.611112 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c8fe48-067c-4457-b7e3-13780d331ff7 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:31:43.611563 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec407cd-0d73-482b-ac6d-905661d86d10 admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:31:43.611861 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec407cd-0d73-482b-ac6d-905661d86d10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:31:43.612129 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec407cd-0d73-482b-ac6d-905661d86d10 admin admin] PATH_INFO: `/v3/projects` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:31:43.612765 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec407cd-0d73-482b-ac6d-905661d86d10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:31:43.614753 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec407cd-0d73-482b-ac6d-905661d86d10 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:31:43.639071 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 778/1578] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 16:31:43 2022] POST /identity/v3/projects => generated 365 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:31:43.642803 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c8fe48-067c-4457-b7e3-13780d331ff7 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:31:43.643244 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 801/1579] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 16:31:43 2022] POST /identity/v3/projects => generated 373 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:31:43.644520 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4713834f-0e93-442d-8781-31c8df1d75a1 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:31:43.644816 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4713834f-0e93-442d-8781-31c8df1d75a1 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:31:43.645101 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4713834f-0e93-442d-8781-31c8df1d75a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:31:43.672887 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-4713834f-0e93-442d-8781-31c8df1d75a1 None None] MFA Rules not processed for user `8a162186f2ae49399fb410f2be0d822c`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:31:43.674094 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-4713834f-0e93-442d-8781-31c8df1d75a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:31:43.708099 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c8fe48-067c-4457-b7e3-13780d331ff7 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:31:43.727408 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:31:43.739565 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 802/1580] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:31:43 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:31:43.740501 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4713834f-0e93-442d-8781-31c8df1d75a1 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:31:43.770076 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8c4261-c60f-4ca1-9883-156df99b0939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:31:43.770730 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8c4261-c60f-4ca1-9883-156df99b0939 admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:31:43.771010 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8c4261-c60f-4ca1-9883-156df99b0939 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:31:43.771277 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8c4261-c60f-4ca1-9883-156df99b0939 admin admin] PATH_INFO: `/v3/projects` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:31:43.771898 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8c4261-c60f-4ca1-9883-156df99b0939 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:31:43.773855 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8c4261-c60f-4ca1-9883-156df99b0939 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:31:43.801433 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 779/1581] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 16:31:43 2022] POST /identity/v3/projects => generated 389 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:31:43.802250 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8c4261-c60f-4ca1-9883-156df99b0939 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:31:43.805536 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4713834f-0e93-442d-8781-31c8df1d75a1 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:31:43.832821 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:31:43.864242 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8c4261-c60f-4ca1-9883-156df99b0939 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:31:43.868635 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f39eb2-6355-4dec-8955-7b8b23483919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:31:43.868999 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a58b994-1408-473b-80af-7cbafdf1a511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:31:43.869242 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f39eb2-6355-4dec-8955-7b8b23483919 admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:31:43.869520 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f39eb2-6355-4dec-8955-7b8b23483919 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:31:43.869631 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a58b994-1408-473b-80af-7cbafdf1a511 admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:31:43.869845 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f39eb2-6355-4dec-8955-7b8b23483919 admin admin] PATH_INFO: `/v3/users` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:31:43.869956 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a58b994-1408-473b-80af-7cbafdf1a511 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:31:43.870151 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a58b994-1408-473b-80af-7cbafdf1a511 admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:31:43.870472 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f39eb2-6355-4dec-8955-7b8b23483919 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:31:43.870871 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a58b994-1408-473b-80af-7cbafdf1a511 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:31:43.872521 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f39eb2-6355-4dec-8955-7b8b23483919 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:31:43.872643 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a58b994-1408-473b-80af-7cbafdf1a511 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:31:43.882736 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 780/1582] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:31:43 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:31:43.883616 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a58b994-1408-473b-80af-7cbafdf1a511 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:31:43.894702 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a58b994-1408-473b-80af-7cbafdf1a511 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:31:43.897241 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 803/1583] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 16:31:43 2022] POST /identity/v3/users => generated 289 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:31:43.898689 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ef96ea-7cc8-4562-a6a8-49d1399e5b6d None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:31:43.899033 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ef96ea-7cc8-4562-a6a8-49d1399e5b6d None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:31:43.899140 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55264a2-698d-4d40-9d8b-dca7eacec321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:31:43.899412 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ef96ea-7cc8-4562-a6a8-49d1399e5b6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:31:43.899687 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55264a2-698d-4d40-9d8b-dca7eacec321 admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:31:43.899962 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55264a2-698d-4d40-9d8b-dca7eacec321 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:31:43.900574 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55264a2-698d-4d40-9d8b-dca7eacec321 admin admin] PATH_INFO: `/v3/users` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:31:43.901317 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55264a2-698d-4d40-9d8b-dca7eacec321 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:31:43.903261 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55264a2-698d-4d40-9d8b-dca7eacec321 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:31:43.919607 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-e1ef96ea-7cc8-4562-a6a8-49d1399e5b6d None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:31:43.920886 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-e1ef96ea-7cc8-4562-a6a8-49d1399e5b6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:31:43.924341 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 781/1584] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 16:31:43 2022] POST /identity/v3/users => generated 282 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:31:43.925191 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55264a2-698d-4d40-9d8b-dca7eacec321 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:31:43.928738 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 804/1585] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:31:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:31:43.929515 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ef96ea-7cc8-4562-a6a8-49d1399e5b6d None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:31:43.936181 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55264a2-698d-4d40-9d8b-dca7eacec321 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:31:43.938897 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ef96ea-7cc8-4562-a6a8-49d1399e5b6d None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:31:43.941292 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45baa57-71e3-46d2-b763-367cdb4c3e8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:31:43.941866 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45baa57-71e3-46d2-b763-367cdb4c3e8d admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:31:43.942190 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45baa57-71e3-46d2-b763-367cdb4c3e8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:31:43.942498 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45baa57-71e3-46d2-b763-367cdb4c3e8d admin admin] PATH_INFO: `/v3/users` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:31:43.943112 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45baa57-71e3-46d2-b763-367cdb4c3e8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:31:43.943925 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d6d9c0-e8d7-4de9-93f4-e53a07b3348f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:31:43.944657 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d6d9c0-e8d7-4de9-93f4-e53a07b3348f admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:31:43.944815 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d6d9c0-e8d7-4de9-93f4-e53a07b3348f admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:31:43.945014 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45baa57-71e3-46d2-b763-367cdb4c3e8d admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:31:43.945134 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d6d9c0-e8d7-4de9-93f4-e53a07b3348f admin admin] PATH_INFO: `/v3/users` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:31:43.945717 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d6d9c0-e8d7-4de9-93f4-e53a07b3348f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:31:43.947626 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d6d9c0-e8d7-4de9-93f4-e53a07b3348f admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:31:43.967741 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 782/1586] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 16:31:43 2022] POST /identity/v3/users => generated 283 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:31:43.969298 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45baa57-71e3-46d2-b763-367cdb4c3e8d admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:31:43.974061 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 805/1587] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 16:31:43 2022] POST /identity/v3/users => generated 287 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:31:43.974880 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d6d9c0-e8d7-4de9-93f4-e53a07b3348f admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:31:43.982104 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45baa57-71e3-46d2-b763-367cdb4c3e8d admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:31:43.984305 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d6d9c0-e8d7-4de9-93f4-e53a07b3348f admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:31:43.986852 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95aa9690-c903-4ec1-9507-c4fc5dc5a743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:31:43.987437 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aa9690-c903-4ec1-9507-c4fc5dc5a743 admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:31:43.987713 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aa9690-c903-4ec1-9507-c4fc5dc5a743 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:31:43.987980 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aa9690-c903-4ec1-9507-c4fc5dc5a743 admin admin] PATH_INFO: `/v3/projects` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:31:43.988586 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95aa9690-c903-4ec1-9507-c4fc5dc5a743 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:31:43.988742 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab79166-f796-49c5-a711-eafe1f65ed1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:31:43.989309 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab79166-f796-49c5-a711-eafe1f65ed1a admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:31:43.989584 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab79166-f796-49c5-a711-eafe1f65ed1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:31:43.989850 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab79166-f796-49c5-a711-eafe1f65ed1a admin admin] PATH_INFO: `/v3/users` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:31:43.990477 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab79166-f796-49c5-a711-eafe1f65ed1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:31:43.990578 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95aa9690-c903-4ec1-9507-c4fc5dc5a743 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:31:43.992373 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab79166-f796-49c5-a711-eafe1f65ed1a admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:31:44.015295 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 806/1588] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 16:31:43 2022] POST /identity/v3/users => generated 295 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:31:44.016159 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab79166-f796-49c5-a711-eafe1f65ed1a admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:31:44.018326 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 783/1589] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 16:31:43 2022] POST /identity/v3/projects => generated 403 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:31:44.019116 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95aa9690-c903-4ec1-9507-c4fc5dc5a743 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:31:44.028612 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab79166-f796-49c5-a711-eafe1f65ed1a admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:31:44.067305 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:31:44.081877 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95aa9690-c903-4ec1-9507-c4fc5dc5a743 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:31:44.086513 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd268d2f-dc08-42ff-9d11-07c26bebd9f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:31:44.087132 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd268d2f-dc08-42ff-9d11-07c26bebd9f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:31:44.087410 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd268d2f-dc08-42ff-9d11-07c26bebd9f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:31:44.087678 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd268d2f-dc08-42ff-9d11-07c26bebd9f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:31:44.087898 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f9f04b-dc64-4bac-b0c1-d77d453a7234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:31:44.088327 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd268d2f-dc08-42ff-9d11-07c26bebd9f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:31:44.088500 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f9f04b-dc64-4bac-b0c1-d77d453a7234 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:31:44.088772 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f9f04b-dc64-4bac-b0c1-d77d453a7234 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:31:44.089037 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f9f04b-dc64-4bac-b0c1-d77d453a7234 admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:31:44.089666 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f9f04b-dc64-4bac-b0c1-d77d453a7234 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:31:44.089934 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd268d2f-dc08-42ff-9d11-07c26bebd9f9 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:31:44.091274 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f9f04b-dc64-4bac-b0c1-d77d453a7234 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:31:44.099568 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 784/1590] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:31:44 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:31:44.100358 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd268d2f-dc08-42ff-9d11-07c26bebd9f9 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:31:44.104123 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 807/1591] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:31:44 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:31:44.104123 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f9f04b-dc64-4bac-b0c1-d77d453a7234 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:31:44.112946 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd268d2f-dc08-42ff-9d11-07c26bebd9f9 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:31:44.117601 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b076c7-1e81-4d60-b6bf-c3fa2b7e152f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:31:44.118175 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b076c7-1e81-4d60-b6bf-c3fa2b7e152f admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:31:44.118480 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b076c7-1e81-4d60-b6bf-c3fa2b7e152f admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:31:44.118750 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b076c7-1e81-4d60-b6bf-c3fa2b7e152f admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:31:44.119367 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b076c7-1e81-4d60-b6bf-c3fa2b7e152f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:31:44.120945 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b076c7-1e81-4d60-b6bf-c3fa2b7e152f admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:31:44.131586 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 785/1592] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:31:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:31:44.132370 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b076c7-1e81-4d60-b6bf-c3fa2b7e152f admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:31:44.141969 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b076c7-1e81-4d60-b6bf-c3fa2b7e152f admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:31:44.146723 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ecf1a2-593c-41be-849a-e745c6a10623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:31:44.147301 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ecf1a2-593c-41be-849a-e745c6a10623 admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:31:44.147582 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ecf1a2-593c-41be-849a-e745c6a10623 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:31:44.147853 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ecf1a2-593c-41be-849a-e745c6a10623 admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:31:44.148470 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ecf1a2-593c-41be-849a-e745c6a10623 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:31:44.150041 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ecf1a2-593c-41be-849a-e745c6a10623 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:31:44.160112 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 786/1593] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:31:44 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:31:44.160448 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f9f04b-dc64-4bac-b0c1-d77d453a7234 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:31:44.163223 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ecf1a2-593c-41be-849a-e745c6a10623 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:31:44.164139 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1de53d-c32c-42e2-a6f1-afdb8b55df06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f44bfdd5214e8d84a2c0a5b1fd9b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:31:44.164733 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1de53d-c32c-42e2-a6f1-afdb8b55df06 service neutron] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:31:44.165012 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1de53d-c32c-42e2-a6f1-afdb8b55df06 service neutron] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:31:44.165277 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1de53d-c32c-42e2-a6f1-afdb8b55df06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:31:44.172663 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ecf1a2-593c-41be-849a-e745c6a10623 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:31:44.174279 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1de53d-c32c-42e2-a6f1-afdb8b55df06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:31:44.175741 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1de53d-c32c-42e2-a6f1-afdb8b55df06 service neutron] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:31:44.177729 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9f7bef-0da6-4c85-9855-3b4b5381fe46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:31:44.178351 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9f7bef-0da6-4c85-9855-3b4b5381fe46 admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:31:44.178626 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9f7bef-0da6-4c85-9855-3b4b5381fe46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:31:44.178894 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9f7bef-0da6-4c85-9855-3b4b5381fe46 admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:31:44.179507 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9f7bef-0da6-4c85-9855-3b4b5381fe46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:31:44.181066 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9f7bef-0da6-4c85-9855-3b4b5381fe46 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:31:44.185355 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 808/1594] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:31:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:31:44.186138 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1de53d-c32c-42e2-a6f1-afdb8b55df06 service neutron] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:31:44.191805 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 787/1595] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:31:44 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:31:44.193267 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9f7bef-0da6-4c85-9855-3b4b5381fe46 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:31:44.197265 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1de53d-c32c-42e2-a6f1-afdb8b55df06 service neutron] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:31:44.203466 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05000d10-f1d9-47fd-a462-4cdb77a8eab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:31:44.203640 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9f7bef-0da6-4c85-9855-3b4b5381fe46 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:31:44.204057 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05000d10-f1d9-47fd-a462-4cdb77a8eab5 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:31:44.204358 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05000d10-f1d9-47fd-a462-4cdb77a8eab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:31:44.204758 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05000d10-f1d9-47fd-a462-4cdb77a8eab5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:31:44.205386 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05000d10-f1d9-47fd-a462-4cdb77a8eab5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:31:44.207188 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05000d10-f1d9-47fd-a462-4cdb77a8eab5 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:31:44.208609 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eace73bc-2aba-4da0-958c-1d278cd6d13d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:31:44.209263 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eace73bc-2aba-4da0-958c-1d278cd6d13d admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:31:44.209540 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eace73bc-2aba-4da0-958c-1d278cd6d13d admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:31:44.209808 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eace73bc-2aba-4da0-958c-1d278cd6d13d admin admin] PATH_INFO: `/v3/users` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:31:44.210458 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eace73bc-2aba-4da0-958c-1d278cd6d13d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:31:44.212350 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eace73bc-2aba-4da0-958c-1d278cd6d13d admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:31:44.218051 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 809/1596] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:31:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:31:44.218927 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05000d10-f1d9-47fd-a462-4cdb77a8eab5 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:31:44.226422 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:31:44.231104 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05000d10-f1d9-47fd-a462-4cdb77a8eab5 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:31:44.237695 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29541ff-52dc-450f-a150-92a873aef279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:31:44.240877 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 788/1597] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 16:31:44 2022] POST /identity/v3/users => generated 308 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:31:44.241010 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29541ff-52dc-450f-a150-92a873aef279 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:31:44.241112 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eace73bc-2aba-4da0-958c-1d278cd6d13d admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:31:44.241213 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29541ff-52dc-450f-a150-92a873aef279 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:31:44.241213 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29541ff-52dc-450f-a150-92a873aef279 admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:31:44.241213 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29541ff-52dc-450f-a150-92a873aef279 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:31:44.241980 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29541ff-52dc-450f-a150-92a873aef279 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:31:44.248881 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eace73bc-2aba-4da0-958c-1d278cd6d13d admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:31:44.254092 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc7ed3f-9a27-40c3-a4c1-2e6fe48d385a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:31:44.254772 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc7ed3f-9a27-40c3-a4c1-2e6fe48d385a admin admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:31:44.255049 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc7ed3f-9a27-40c3-a4c1-2e6fe48d385a admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:31:44.255300 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 810/1598] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:31:44 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:31:44.255421 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc7ed3f-9a27-40c3-a4c1-2e6fe48d385a admin admin] PATH_INFO: `/v3/projects/da49ad38515a42ecac9714c58c3666a9/users/262f8e59bf4e40648ff6c49e58dd86c9/roles/b38e84bf077846ee802e6bb1bad83522` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:31:44.256126 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29541ff-52dc-450f-a150-92a873aef279 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:31:44.268850 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29541ff-52dc-450f-a150-92a873aef279 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:31:44.273947 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f27abf3-200d-49a8-9845-736142c935c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:31:44.274577 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f27abf3-200d-49a8-9845-736142c935c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:31:44.274853 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f27abf3-200d-49a8-9845-736142c935c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:31:44.275122 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f27abf3-200d-49a8-9845-736142c935c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:31:44.275756 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f27abf3-200d-49a8-9845-736142c935c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:31:44.277357 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f27abf3-200d-49a8-9845-736142c935c3 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:31:44.278956 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc7ed3f-9a27-40c3-a4c1-2e6fe48d385a admin admin] RBAC: Authorizing `identity:create_grant(project_id=da49ad38515a42ecac9714c58c3666a9, user_id=262f8e59bf4e40648ff6c49e58dd86c9, role_id=b38e84bf077846ee802e6bb1bad83522)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:31:44.281785 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc7ed3f-9a27-40c3-a4c1-2e6fe48d385a admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:31:44.288833 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 811/1599] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:31:44 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:31:44.289682 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f27abf3-200d-49a8-9845-736142c935c3 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:31:44.296564 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 789/1600] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 16:31:44 2022] PUT /identity/v3/projects/da49ad38515a42ecac9714c58c3666a9/users/262f8e59bf4e40648ff6c49e58dd86c9/roles/b38e84bf077846ee802e6bb1bad83522 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:31:44.297743 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc7ed3f-9a27-40c3-a4c1-2e6fe48d385a admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:31:44.299839 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f27abf3-200d-49a8-9845-736142c935c3 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:31:44.367356 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206a6312-40ec-49f5-b7f8-9e28d55fcf9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:31:44.368104 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206a6312-40ec-49f5-b7f8-9e28d55fcf9d admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:31:44.368494 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206a6312-40ec-49f5-b7f8-9e28d55fcf9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:31:44.368861 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206a6312-40ec-49f5-b7f8-9e28d55fcf9d admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:31:44.369696 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206a6312-40ec-49f5-b7f8-9e28d55fcf9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:31:44.370020 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc7ed3f-9a27-40c3-a4c1-2e6fe48d385a admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:31:44.371791 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206a6312-40ec-49f5-b7f8-9e28d55fcf9d admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:31:44.376161 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bdd77c-bfe9-4c19-bc35-7eb7558a828f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:31:44.376891 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bdd77c-bfe9-4c19-bc35-7eb7558a828f admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:31:44.377268 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bdd77c-bfe9-4c19-bc35-7eb7558a828f admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:31:44.377640 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bdd77c-bfe9-4c19-bc35-7eb7558a828f admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:31:44.378674 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bdd77c-bfe9-4c19-bc35-7eb7558a828f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:31:44.380427 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bdd77c-bfe9-4c19-bc35-7eb7558a828f admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:31:44.384649 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 812/1601] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:31:44 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:31:44.385584 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206a6312-40ec-49f5-b7f8-9e28d55fcf9d admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:31:44.395821 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 790/1602] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:31:44 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:31:44.396654 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bdd77c-bfe9-4c19-bc35-7eb7558a828f admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:31:44.398854 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206a6312-40ec-49f5-b7f8-9e28d55fcf9d admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:31:44.404588 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3998f0f5-c959-4dc1-ab91-12a5fa75ca95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:31:44.405344 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3998f0f5-c959-4dc1-ab91-12a5fa75ca95 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:31:44.405628 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3998f0f5-c959-4dc1-ab91-12a5fa75ca95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:31:44.405901 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3998f0f5-c959-4dc1-ab91-12a5fa75ca95 admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:31:44.406577 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3998f0f5-c959-4dc1-ab91-12a5fa75ca95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:31:44.407920 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bdd77c-bfe9-4c19-bc35-7eb7558a828f admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:31:44.408284 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3998f0f5-c959-4dc1-ab91-12a5fa75ca95 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:31:44.412572 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49566241-a680-4746-965f-ee12d3bc63b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:31:44.413161 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49566241-a680-4746-965f-ee12d3bc63b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:31:44.413434 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49566241-a680-4746-965f-ee12d3bc63b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:31:44.413703 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49566241-a680-4746-965f-ee12d3bc63b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:31:44.414343 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49566241-a680-4746-965f-ee12d3bc63b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:31:44.416036 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49566241-a680-4746-965f-ee12d3bc63b9 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:31:44.420680 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 813/1603] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:31:44 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:31:44.421681 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3998f0f5-c959-4dc1-ab91-12a5fa75ca95 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:31:44.436389 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3998f0f5-c959-4dc1-ab91-12a5fa75ca95 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:31:44.439179 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 791/1604] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:31:44 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:31:44.440563 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49566241-a680-4746-965f-ee12d3bc63b9 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:31:44.443434 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7445f77c-07b3-4167-9a9a-79c920e243ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:31:44.444087 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7445f77c-07b3-4167-9a9a-79c920e243ed admin admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:31:44.444365 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7445f77c-07b3-4167-9a9a-79c920e243ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:31:44.444635 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7445f77c-07b3-4167-9a9a-79c920e243ed admin admin] PATH_INFO: `/v3/projects/3a0f1f8ef18546cc958d4ce96d7a0cc2/users/8c3919b9f57e4604b89d3f6a2763b0b4/roles/b38e84bf077846ee802e6bb1bad83522` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:31:44.453777 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49566241-a680-4746-965f-ee12d3bc63b9 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:31:44.460164 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e02cfc-aecf-4039-aa53-cf37a206a48a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:31:44.460913 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e02cfc-aecf-4039-aa53-cf37a206a48a admin admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:31:44.461201 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e02cfc-aecf-4039-aa53-cf37a206a48a admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:31:44.461480 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e02cfc-aecf-4039-aa53-cf37a206a48a admin admin] PATH_INFO: `/v3/projects/e1dc8391ee194cdbacc846f5bd35ea74/users/d711d4238f90414691b6459ed9a400ae/roles/b38e84bf077846ee802e6bb1bad83522` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:31:44.462139 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7445f77c-07b3-4167-9a9a-79c920e243ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a0f1f8ef18546cc958d4ce96d7a0cc2, user_id=8c3919b9f57e4604b89d3f6a2763b0b4, role_id=b38e84bf077846ee802e6bb1bad83522)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:31:44.464871 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7445f77c-07b3-4167-9a9a-79c920e243ed admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:31:44.479335 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e02cfc-aecf-4039-aa53-cf37a206a48a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1dc8391ee194cdbacc846f5bd35ea74, user_id=d711d4238f90414691b6459ed9a400ae, role_id=b38e84bf077846ee802e6bb1bad83522)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:31:44.482088 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 814/1605] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 16:31:44 2022] PUT /identity/v3/projects/3a0f1f8ef18546cc958d4ce96d7a0cc2/users/8c3919b9f57e4604b89d3f6a2763b0b4/roles/b38e84bf077846ee802e6bb1bad83522 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:31:44.482710 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e02cfc-aecf-4039-aa53-cf37a206a48a admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:31:44.484646 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad142f0f-7116-4383-bb5a-3525a0cf0c7e None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:31:44.485097 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad142f0f-7116-4383-bb5a-3525a0cf0c7e None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:31:44.485365 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad142f0f-7116-4383-bb5a-3525a0cf0c7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:31:44.509911 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 792/1606] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 16:31:44 2022] PUT /identity/v3/projects/e1dc8391ee194cdbacc846f5bd35ea74/users/d711d4238f90414691b6459ed9a400ae/roles/b38e84bf077846ee802e6bb1bad83522 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:31:44.509911 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e02cfc-aecf-4039-aa53-cf37a206a48a admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:31:44.510231 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-ad142f0f-7116-4383-bb5a-3525a0cf0c7e None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:31:44.510231 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-ad142f0f-7116-4383-bb5a-3525a0cf0c7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:31:44.545136 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:31:44.581987 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e02cfc-aecf-4039-aa53-cf37a206a48a admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:31:44.587332 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f0c2d7-d4a9-43d8-8bca-b3bf270dc0f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:31:44.588098 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f0c2d7-d4a9-43d8-8bca-b3bf270dc0f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:31:44.588938 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f0c2d7-d4a9-43d8-8bca-b3bf270dc0f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:31:44.589221 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f0c2d7-d4a9-43d8-8bca-b3bf270dc0f5 admin admin] PATH_INFO: `/v3/projects/6c8e66dbbce549b8b872fd5add915f62/users/75d0321b6e7d410d96359a9ff65ea6b1/roles/b38e84bf077846ee802e6bb1bad83522` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:31:44.603489 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 815/1607] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:31:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:31:44.604332 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad142f0f-7116-4383-bb5a-3525a0cf0c7e None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:31:44.611356 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f0c2d7-d4a9-43d8-8bca-b3bf270dc0f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c8e66dbbce549b8b872fd5add915f62, user_id=75d0321b6e7d410d96359a9ff65ea6b1, role_id=b38e84bf077846ee802e6bb1bad83522)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:31:44.614246 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f0c2d7-d4a9-43d8-8bca-b3bf270dc0f5 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:31:44.615672 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad142f0f-7116-4383-bb5a-3525a0cf0c7e None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:31:44.622512 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd90bfe-5a32-42a6-a09e-79f69c90329f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:31:44.623695 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd90bfe-5a32-42a6-a09e-79f69c90329f admin admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:31:44.624976 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd90bfe-5a32-42a6-a09e-79f69c90329f admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:31:44.625883 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd90bfe-5a32-42a6-a09e-79f69c90329f admin admin] PATH_INFO: `/v3/projects/e9cd760b270a40c689ec96680b786238/users/14b527efa0ea47319734c3df431aed4a/roles/b38e84bf077846ee802e6bb1bad83522` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:31:44.630787 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 793/1608] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 16:31:44 2022] PUT /identity/v3/projects/6c8e66dbbce549b8b872fd5add915f62/users/75d0321b6e7d410d96359a9ff65ea6b1/roles/b38e84bf077846ee802e6bb1bad83522 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:31:44.635124 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f0c2d7-d4a9-43d8-8bca-b3bf270dc0f5 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:31:44.646592 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd90bfe-5a32-42a6-a09e-79f69c90329f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9cd760b270a40c689ec96680b786238, user_id=14b527efa0ea47319734c3df431aed4a, role_id=b38e84bf077846ee802e6bb1bad83522)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:31:44.649851 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd90bfe-5a32-42a6-a09e-79f69c90329f admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:31:44.678410 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 816/1609] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 16:31:44 2022] PUT /identity/v3/projects/e9cd760b270a40c689ec96680b786238/users/14b527efa0ea47319734c3df431aed4a/roles/b38e84bf077846ee802e6bb1bad83522 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:31:44.679872 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd90bfe-5a32-42a6-a09e-79f69c90329f admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:31:44.710403 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f0c2d7-d4a9-43d8-8bca-b3bf270dc0f5 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:31:44.721691 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:31:44.782937 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd90bfe-5a32-42a6-a09e-79f69c90329f admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:31:44.788507 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88c9bca-5e5f-49d2-80bd-0e4f6f351821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:31:44.789268 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88c9bca-5e5f-49d2-80bd-0e4f6f351821 admin admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:31:44.789833 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88c9bca-5e5f-49d2-80bd-0e4f6f351821 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:31:44.790153 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88c9bca-5e5f-49d2-80bd-0e4f6f351821 admin admin] PATH_INFO: `/v3/projects/0f1749fd0dc246d3a5595133a594380d/users/bcbafefce0fc4050ade86d7f343d8c2a/roles/0a36d1be416f4089be19be979943b731` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:31:44.798168 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50a8b9d-b0a1-43c6-913c-61471669d164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:31:44.799280 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50a8b9d-b0a1-43c6-913c-61471669d164 admin admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:31:44.799794 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50a8b9d-b0a1-43c6-913c-61471669d164 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:31:44.800274 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50a8b9d-b0a1-43c6-913c-61471669d164 admin admin] PATH_INFO: `/v3/projects/cd7e1e9657704ce29893a94c0fe7bb7f/users/7ea10dd1db74490687a8be5a6f5a6f8a/roles/b38e84bf077846ee802e6bb1bad83522` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:31:44.815444 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88c9bca-5e5f-49d2-80bd-0e4f6f351821 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f1749fd0dc246d3a5595133a594380d, user_id=bcbafefce0fc4050ade86d7f343d8c2a, role_id=0a36d1be416f4089be19be979943b731)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:31:44.820963 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88c9bca-5e5f-49d2-80bd-0e4f6f351821 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:31:44.827440 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50a8b9d-b0a1-43c6-913c-61471669d164 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd7e1e9657704ce29893a94c0fe7bb7f, user_id=7ea10dd1db74490687a8be5a6f5a6f8a, role_id=b38e84bf077846ee802e6bb1bad83522)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:31:44.830536 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50a8b9d-b0a1-43c6-913c-61471669d164 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:31:44.835854 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 817/1610] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 16:31:44 2022] PUT /identity/v3/projects/0f1749fd0dc246d3a5595133a594380d/users/bcbafefce0fc4050ade86d7f343d8c2a/roles/0a36d1be416f4089be19be979943b731 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:31:44.837368 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4f86aa-a0b0-45d5-997d-65b993507af5 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:31:44.837659 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4f86aa-a0b0-45d5-997d-65b993507af5 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:31:44.837935 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4f86aa-a0b0-45d5-997d-65b993507af5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:31:44.848180 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 794/1611] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 16:31:44 2022] PUT /identity/v3/projects/cd7e1e9657704ce29893a94c0fe7bb7f/users/7ea10dd1db74490687a8be5a6f5a6f8a/roles/b38e84bf077846ee802e6bb1bad83522 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:31:44.850008 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b1dd29-836b-4bc4-8563-8d7e71b78c61 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:31:44.850574 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b1dd29-836b-4bc4-8563-8d7e71b78c61 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:31:44.851073 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b1dd29-836b-4bc4-8563-8d7e71b78c61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:31:44.859429 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-cb4f86aa-a0b0-45d5-997d-65b993507af5 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:31:44.860686 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-cb4f86aa-a0b0-45d5-997d-65b993507af5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:31:44.890978 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-c6b1dd29-836b-4bc4-8563-8d7e71b78c61 None None] MFA Rules not processed for user `d711d4238f90414691b6459ed9a400ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:31:44.892254 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-c6b1dd29-836b-4bc4-8563-8d7e71b78c61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:31:44.929081 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:31:44.938239 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 818/1612] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:31:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:31:44.938239 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4f86aa-a0b0-45d5-997d-65b993507af5 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:31:44.938239 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-cb4f86aa-a0b0-45d5-997d-65b993507af5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:31:44.975816 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 795/1613] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:31:44 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:31:44.977376 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948c5676-3515-4df8-b8f7-227c85f056e1 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:31:44.977668 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948c5676-3515-4df8-b8f7-227c85f056e1 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:31:44.977943 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948c5676-3515-4df8-b8f7-227c85f056e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:31:45.006981 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-948c5676-3515-4df8-b8f7-227c85f056e1 None None] MFA Rules not processed for user `75d0321b6e7d410d96359a9ff65ea6b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:31:45.008210 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-948c5676-3515-4df8-b8f7-227c85f056e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:31:45.010120 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4f86aa-a0b0-45d5-997d-65b993507af5 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:31:45.013871 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76abb22-4bb2-4fcd-b125-670ffab9f2b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f44bfdd5214e8d84a2c0a5b1fd9b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:31:45.014510 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76abb22-4bb2-4fcd-b125-670ffab9f2b6 service neutron] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:31:45.014894 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76abb22-4bb2-4fcd-b125-670ffab9f2b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:31:45.015167 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76abb22-4bb2-4fcd-b125-670ffab9f2b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:31:45.024744 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76abb22-4bb2-4fcd-b125-670ffab9f2b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:31:45.026243 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76abb22-4bb2-4fcd-b125-670ffab9f2b6 service neutron] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:31:45.036556 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 819/1614] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:31:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:31:45.037762 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fd80d0-e632-47da-b611-573e217d9a64 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:31:45.038036 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fd80d0-e632-47da-b611-573e217d9a64 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:31:45.038314 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fd80d0-e632-47da-b611-573e217d9a64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:31:45.068488 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-a5fd80d0-e632-47da-b611-573e217d9a64 None None] MFA Rules not processed for user `14b527efa0ea47319734c3df431aed4a`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:31:45.069764 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-a5fd80d0-e632-47da-b611-573e217d9a64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:31:45.087069 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 796/1615] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:31:44 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:31:45.088177 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948c5676-3515-4df8-b8f7-227c85f056e1 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:31:45.100146 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948c5676-3515-4df8-b8f7-227c85f056e1 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:31:45.106355 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb6609c-299f-4694-a2dc-03a9422b61d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:31:45.106995 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb6609c-299f-4694-a2dc-03a9422b61d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:31:45.107311 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb6609c-299f-4694-a2dc-03a9422b61d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:31:45.108509 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb6609c-299f-4694-a2dc-03a9422b61d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:31:45.109389 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb6609c-299f-4694-a2dc-03a9422b61d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:31:45.111099 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb6609c-299f-4694-a2dc-03a9422b61d9 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:31:45.114429 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:31:45.123447 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 797/1616] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:31:45 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:31:45.127599 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b597b4d-56e8-48b2-8dc5-fb5b586a1551 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:31:45.127884 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b597b4d-56e8-48b2-8dc5-fb5b586a1551 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:31:45.128926 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b597b4d-56e8-48b2-8dc5-fb5b586a1551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:31:45.149157 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-2b597b4d-56e8-48b2-8dc5-fb5b586a1551 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:31:45.150400 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-2b597b4d-56e8-48b2-8dc5-fb5b586a1551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:31:45.163680 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 798/1617] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:31:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:31:45.163680 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b597b4d-56e8-48b2-8dc5-fb5b586a1551 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:31:45.169701 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 820/1618] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:31:45 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:31:45.170970 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fd80d0-e632-47da-b611-573e217d9a64 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:31:45.184253 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fd80d0-e632-47da-b611-573e217d9a64 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:31:45.186361 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b597b4d-56e8-48b2-8dc5-fb5b586a1551 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:31:45.199052 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fd41ed-b222-4069-b13f-1e386abcaba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:31:45.200407 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fd41ed-b222-4069-b13f-1e386abcaba4 admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:31:45.201050 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fd41ed-b222-4069-b13f-1e386abcaba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:31:45.201336 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fd41ed-b222-4069-b13f-1e386abcaba4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:31:45.201981 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fd41ed-b222-4069-b13f-1e386abcaba4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:31:45.204059 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fd41ed-b222-4069-b13f-1e386abcaba4 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:31:45.204176 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62505fe-7748-4efd-a540-cf2f32567661 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f44bfdd5214e8d84a2c0a5b1fd9b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:31:45.204812 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62505fe-7748-4efd-a540-cf2f32567661 service neutron] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:31:45.205092 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62505fe-7748-4efd-a540-cf2f32567661 service neutron] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:31:45.205365 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62505fe-7748-4efd-a540-cf2f32567661 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:31:45.228921 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62505fe-7748-4efd-a540-cf2f32567661 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:31:45.231907 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62505fe-7748-4efd-a540-cf2f32567661 service neutron] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:31:45.245104 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 799/1619] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:31:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:31:45.245688 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62505fe-7748-4efd-a540-cf2f32567661 service neutron] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:31:45.245984 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 821/1620] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 16:31:45 2022] POST /identity/v3/projects => generated 363 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:31:45.247230 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fd41ed-b222-4069-b13f-1e386abcaba4 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:31:45.384321 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62505fe-7748-4efd-a540-cf2f32567661 service neutron] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:31:45.397944 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fd41ed-b222-4069-b13f-1e386abcaba4 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:31:45.404525 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db6a50a-8a94-4310-a778-b3e47de119ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:31:45.405902 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db6a50a-8a94-4310-a778-b3e47de119ee admin admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:31:45.406186 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db6a50a-8a94-4310-a778-b3e47de119ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:31:45.406534 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db6a50a-8a94-4310-a778-b3e47de119ee admin admin] PATH_INFO: `/v3/projects/0f1749fd0dc246d3a5595133a594380d/users/bcbafefce0fc4050ade86d7f343d8c2a/roles/0a36d1be416f4089be19be979943b731` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:31:45.409005 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db6a50a-8a94-4310-a778-b3e47de119ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f1749fd0dc246d3a5595133a594380d, user_id=bcbafefce0fc4050ade86d7f343d8c2a, role_id=0a36d1be416f4089be19be979943b731)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:31:45.413484 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db6a50a-8a94-4310-a778-b3e47de119ee admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:31:45.430621 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 822/1621] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 16:31:45 2022] PUT /identity/v3/projects/0f1749fd0dc246d3a5595133a594380d/users/bcbafefce0fc4050ade86d7f343d8c2a/roles/0a36d1be416f4089be19be979943b731 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:31:45.431813 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db6a50a-8a94-4310-a778-b3e47de119ee admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:31:45.531285 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:31:45.543594 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db6a50a-8a94-4310-a778-b3e47de119ee admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:31:45.544822 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117ed5a2-bc8f-4f95-b4cd-baa9c0c09d47 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8078e791ba68460f8b3aeafb4b79b73a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:31:45.546852 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117ed5a2-bc8f-4f95-b4cd-baa9c0c09d47 service cinder] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:31:45.549759 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117ed5a2-bc8f-4f95-b4cd-baa9c0c09d47 service cinder] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:31:45.550626 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117ed5a2-bc8f-4f95-b4cd-baa9c0c09d47 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:31:45.550769 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc46b113-0ff7-4810-89d9-7d30ae7e204c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f44bfdd5214e8d84a2c0a5b1fd9b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:31:45.551721 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc46b113-0ff7-4810-89d9-7d30ae7e204c service neutron] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:31:45.552127 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc46b113-0ff7-4810-89d9-7d30ae7e204c service neutron] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:31:45.552440 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc46b113-0ff7-4810-89d9-7d30ae7e204c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:31:45.663122 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117ed5a2-bc8f-4f95-b4cd-baa9c0c09d47 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:31:45.664903 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117ed5a2-bc8f-4f95-b4cd-baa9c0c09d47 service cinder] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:31:45.676570 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc46b113-0ff7-4810-89d9-7d30ae7e204c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:31:45.679151 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc46b113-0ff7-4810-89d9-7d30ae7e204c service neutron] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:31:45.679338 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 800/1622] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:31:45 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:31:45.680931 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111d91b7-d579-4f37-b01f-662a854c1958 None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:31:45.681509 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111d91b7-d579-4f37-b01f-662a854c1958 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:31:45.681829 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111d91b7-d579-4f37-b01f-662a854c1958 None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:31:45.687529 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:31:45.690829 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 801/1623] 10.222.0.27 () {54 vars in 962 bytes} [Fri Sep 9 16:31:45 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:31:45.692113 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111d91b7-d579-4f37-b01f-662a854c1958 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:31:45.695450 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 823/1624] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:31:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:31:45.697791 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af51d2ed-fd78-4f6d-9f03-5605f3e670db None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:31:45.698605 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af51d2ed-fd78-4f6d-9f03-5605f3e670db None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:31:45.699245 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af51d2ed-fd78-4f6d-9f03-5605f3e670db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:31:45.712673 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111d91b7-d579-4f37-b01f-662a854c1958 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:31:45.718973 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671df86a-3357-4cea-9216-37c3f7b26645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:31:45.720104 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671df86a-3357-4cea-9216-37c3f7b26645 admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:31:45.720230 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671df86a-3357-4cea-9216-37c3f7b26645 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:31:45.720430 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671df86a-3357-4cea-9216-37c3f7b26645 admin admin] PATH_INFO: `/v3/users` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:31:45.721067 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671df86a-3357-4cea-9216-37c3f7b26645 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:31:45.726255 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671df86a-3357-4cea-9216-37c3f7b26645 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:31:45.760460 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-af51d2ed-fd78-4f6d-9f03-5605f3e670db None None] MFA Rules not processed for user `bcbafefce0fc4050ade86d7f343d8c2a`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:31:45.766827 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-af51d2ed-fd78-4f6d-9f03-5605f3e670db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:31:45.792028 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 802/1625] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 16:31:45 2022] POST /identity/v3/users => generated 288 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:31:45.792514 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85965082-0641-45c8-83c7-a3f4040fe891 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:31:45.794349 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85965082-0641-45c8-83c7-a3f4040fe891 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:31:45.794514 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85965082-0641-45c8-83c7-a3f4040fe891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:31:45.899106 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-85965082-0641-45c8-83c7-a3f4040fe891 None None] MFA Rules not processed for user `a332b9b4980646a3b14633293f77b505`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:31:45.903141 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-85965082-0641-45c8-83c7-a3f4040fe891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:31:45.954637 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 824/1626] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:31:45 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:31:45.955901 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af51d2ed-fd78-4f6d-9f03-5605f3e670db None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:31:45.987597 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af51d2ed-fd78-4f6d-9f03-5605f3e670db None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:31:46.002133 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adcce8c-5249-41ca-8967-e563496bbfaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:31:46.003773 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adcce8c-5249-41ca-8967-e563496bbfaa admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:31:46.006473 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adcce8c-5249-41ca-8967-e563496bbfaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:31:46.006968 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adcce8c-5249-41ca-8967-e563496bbfaa admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:31:46.007779 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adcce8c-5249-41ca-8967-e563496bbfaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:31:46.014911 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adcce8c-5249-41ca-8967-e563496bbfaa admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:31:46.039238 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 825/1627] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:31:45 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:31:46.040888 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adcce8c-5249-41ca-8967-e563496bbfaa admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:31:46.081099 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 803/1628] 10.222.0.27 () {58 vars in 1059 bytes} [Fri Sep 9 16:31:45 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:31:46.082034 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85965082-0641-45c8-83c7-a3f4040fe891 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:31:46.094486 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85965082-0641-45c8-83c7-a3f4040fe891 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:31:46.100690 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85098a78-e860-4a68-bd00-d425149e95ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:31:46.101414 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85098a78-e860-4a68-bd00-d425149e95ef admin admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:31:46.101773 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85098a78-e860-4a68-bd00-d425149e95ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:31:46.102405 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85098a78-e860-4a68-bd00-d425149e95ef admin admin] PATH_INFO: `/v3/projects/c34ca77c3606486d957ce64cad77fd9b/users/fd4c297fe45d4436aaf5f13870ff91b1/roles/0a36d1be416f4089be19be979943b731` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:31:46.128369 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adcce8c-5249-41ca-8967-e563496bbfaa admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:31:46.129794 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85098a78-e860-4a68-bd00-d425149e95ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=c34ca77c3606486d957ce64cad77fd9b, user_id=fd4c297fe45d4436aaf5f13870ff91b1, role_id=0a36d1be416f4089be19be979943b731)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:31:46.134438 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec46a4a-2c32-479a-9bf2-d91f054a712b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8078e791ba68460f8b3aeafb4b79b73a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:31:46.135211 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85098a78-e860-4a68-bd00-d425149e95ef admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:31:46.136670 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec46a4a-2c32-479a-9bf2-d91f054a712b service cinder] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:31:46.136977 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec46a4a-2c32-479a-9bf2-d91f054a712b service cinder] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:31:46.137222 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec46a4a-2c32-479a-9bf2-d91f054a712b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:31:46.150893 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec46a4a-2c32-479a-9bf2-d91f054a712b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:31:46.152772 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec46a4a-2c32-479a-9bf2-d91f054a712b service cinder] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:31:46.164796 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 804/1629] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 16:31:46 2022] PUT /identity/v3/projects/c34ca77c3606486d957ce64cad77fd9b/users/fd4c297fe45d4436aaf5f13870ff91b1/roles/0a36d1be416f4089be19be979943b731 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:31:46.165836 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85098a78-e860-4a68-bd00-d425149e95ef admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:31:46.179121 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 826/1630] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:31:46 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:31:46.180979 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec46a4a-2c32-479a-9bf2-d91f054a712b service cinder] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:31:46.215285 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec46a4a-2c32-479a-9bf2-d91f054a712b service cinder] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:31:46.239791 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:31:46.322298 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85098a78-e860-4a68-bd00-d425149e95ef admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:31:46.344967 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab41197-a5a8-4744-bb03-30a8c360e09b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a332b9b4980646a3b14633293f77b505', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:31:46.346898 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab41197-a5a8-4744-bb03-30a8c360e09b service nova] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:31:46.348359 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab41197-a5a8-4744-bb03-30a8c360e09b service nova] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:31:46.348726 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab41197-a5a8-4744-bb03-30a8c360e09b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:31:46.354523 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa39ae79-e6e0-45ab-8ffc-36dc01ab2c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:31:46.355290 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa39ae79-e6e0-45ab-8ffc-36dc01ab2c70 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:31:46.355635 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa39ae79-e6e0-45ab-8ffc-36dc01ab2c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:31:46.356113 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa39ae79-e6e0-45ab-8ffc-36dc01ab2c70 admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:31:46.358712 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa39ae79-e6e0-45ab-8ffc-36dc01ab2c70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:31:46.360611 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa39ae79-e6e0-45ab-8ffc-36dc01ab2c70 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:31:46.376749 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 827/1631] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:31:46 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:31:46.379470 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa39ae79-e6e0-45ab-8ffc-36dc01ab2c70 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:31:46.408869 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa39ae79-e6e0-45ab-8ffc-36dc01ab2c70 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:31:46.416062 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7474f4b-cacb-45a4-b73c-692f9b642b39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:31:46.417053 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7474f4b-cacb-45a4-b73c-692f9b642b39 admin admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:31:46.417506 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7474f4b-cacb-45a4-b73c-692f9b642b39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:31:46.417919 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7474f4b-cacb-45a4-b73c-692f9b642b39 admin admin] PATH_INFO: `/v3/projects/c34ca77c3606486d957ce64cad77fd9b/users/fd4c297fe45d4436aaf5f13870ff91b1/roles/0a36d1be416f4089be19be979943b731` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:31:46.420483 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7474f4b-cacb-45a4-b73c-692f9b642b39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c34ca77c3606486d957ce64cad77fd9b, user_id=fd4c297fe45d4436aaf5f13870ff91b1, role_id=0a36d1be416f4089be19be979943b731)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:31:46.425731 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7474f4b-cacb-45a4-b73c-692f9b642b39 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:31:46.432539 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:31:46.440269 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 828/1632] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 16:31:46 2022] PUT /identity/v3/projects/c34ca77c3606486d957ce64cad77fd9b/users/fd4c297fe45d4436aaf5f13870ff91b1/roles/0a36d1be416f4089be19be979943b731 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:31:46.452989 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7474f4b-cacb-45a4-b73c-692f9b642b39 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:31:46.496283 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab41197-a5a8-4744-bb03-30a8c360e09b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:31:46.501151 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab41197-a5a8-4744-bb03-30a8c360e09b service nova] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:31:46.529574 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 805/1633] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:31:46 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:31:46.531024 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2e47e0-d4c6-4de2-acf3-6aaa0765e6fc None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:31:46.531320 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2e47e0-d4c6-4de2-acf3-6aaa0765e6fc None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:31:46.531892 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2e47e0-d4c6-4de2-acf3-6aaa0765e6fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:31:46.582337 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7474f4b-cacb-45a4-b73c-692f9b642b39 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:31:46.590290 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-3b2e47e0-d4c6-4de2-acf3-6aaa0765e6fc None None] MFA Rules not processed for user `fd4c297fe45d4436aaf5f13870ff91b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:31:46.592629 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-3b2e47e0-d4c6-4de2-acf3-6aaa0765e6fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:31:46.594777 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe1f92c-3fb6-4e55-9dab-d451c6ca7d4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:31:46.595617 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe1f92c-3fb6-4e55-9dab-d451c6ca7d4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:31:46.597129 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe1f92c-3fb6-4e55-9dab-d451c6ca7d4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:31:46.597129 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe1f92c-3fb6-4e55-9dab-d451c6ca7d4e admin admin] PATH_INFO: `/v3/users/8a162186f2ae49399fb410f2be0d822c` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:31:46.599452 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe1f92c-3fb6-4e55-9dab-d451c6ca7d4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a162186f2ae49399fb410f2be0d822c)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:31:46.606212 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe1f92c-3fb6-4e55-9dab-d451c6ca7d4e admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:31:46.732359 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-cbe1f92c-3fb6-4e55-9dab-d451c6ca7d4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a162186f2ae49399fb410f2be0d822c'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:31:46.771307 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-cbe1f92c-3fb6-4e55-9dab-d451c6ca7d4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a162186f2ae49399fb410f2be0d822c'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:31:46.816193 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-cbe1f92c-3fb6-4e55-9dab-d451c6ca7d4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a162186f2ae49399fb410f2be0d822c'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:31:46.829497 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 806/1634] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:31:46 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:31:46.836479 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2e47e0-d4c6-4de2-acf3-6aaa0765e6fc None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:31:46.845358 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-cbe1f92c-3fb6-4e55-9dab-d451c6ca7d4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a162186f2ae49399fb410f2be0d822c'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:31:46.845998 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-cbe1f92c-3fb6-4e55-9dab-d451c6ca7d4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a162186f2ae49399fb410f2be0d822c'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:31:46.860919 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 829/1635] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 16:31:46 2022] DELETE /identity/v3/users/8a162186f2ae49399fb410f2be0d822c => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:31:46.862587 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0c2c06-a54a-4e02-a9b3-e288a3030dcd None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:31:46.862873 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0c2c06-a54a-4e02-a9b3-e288a3030dcd None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:31:46.863383 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0c2c06-a54a-4e02-a9b3-e288a3030dcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:31:46.933213 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-ed0c2c06-a54a-4e02-a9b3-e288a3030dcd None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:31:46.935117 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-ed0c2c06-a54a-4e02-a9b3-e288a3030dcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:31:46.950611 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2e47e0-d4c6-4de2-acf3-6aaa0765e6fc None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:31:46.985455 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:31:47.075089 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fb595f-c1e0-4e0c-8e05-efac79e9568b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8078e791ba68460f8b3aeafb4b79b73a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:31:47.076166 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fb595f-c1e0-4e0c-8e05-efac79e9568b service cinder] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:31:47.076446 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fb595f-c1e0-4e0c-8e05-efac79e9568b service cinder] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:31:47.076924 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fb595f-c1e0-4e0c-8e05-efac79e9568b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:31:47.095520 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-37fb595f-c1e0-4e0c-8e05-efac79e9568b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:31:47.127629 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 830/1636] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:31:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:31:47.132604 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc9f7d8-6915-4be2-bc75-0748e6a5f2dc None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:31:47.132930 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc9f7d8-6915-4be2-bc75-0748e6a5f2dc None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:31:47.135046 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc9f7d8-6915-4be2-bc75-0748e6a5f2dc None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:31:47.138239 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 831/1637] 10.222.0.27 () {54 vars in 912 bytes} [Fri Sep 9 16:31:47 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:31:47.145073 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc9f7d8-6915-4be2-bc75-0748e6a5f2dc None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:31:47.149681 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-ccc9f7d8-6915-4be2-bc75-0748e6a5f2dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:31:47.188461 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:31:47.227448 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fb595f-c1e0-4e0c-8e05-efac79e9568b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:31:47.229348 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fb595f-c1e0-4e0c-8e05-efac79e9568b service cinder] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:31:47.252428 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 807/1638] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:31:46 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:31:47.253851 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476dfce7-3222-44d5-b203-05b45677ce41 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:31:47.258730 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476dfce7-3222-44d5-b203-05b45677ce41 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:31:47.258931 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476dfce7-3222-44d5-b203-05b45677ce41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:31:47.267088 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc9f7d8-6915-4be2-bc75-0748e6a5f2dc None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:31:47.290555 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc7e129-68b2-40fa-8bde-c568fd34e723 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f44bfdd5214e8d84a2c0a5b1fd9b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:31:47.292189 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc7e129-68b2-40fa-8bde-c568fd34e723 service neutron] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:31:47.292690 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc7e129-68b2-40fa-8bde-c568fd34e723 service neutron] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:31:47.293187 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc7e129-68b2-40fa-8bde-c568fd34e723 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:31:47.321811 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc7e129-68b2-40fa-8bde-c568fd34e723 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:31:47.325155 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc7e129-68b2-40fa-8bde-c568fd34e723 service neutron] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:31:47.339183 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-476dfce7-3222-44d5-b203-05b45677ce41 None None] MFA Rules not processed for user `a332b9b4980646a3b14633293f77b505`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:31:47.342871 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-476dfce7-3222-44d5-b203-05b45677ce41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:31:47.357303 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 832/1639] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:31:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:31:47.420231 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc7e129-68b2-40fa-8bde-c568fd34e723 service neutron] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:31:47.423390 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-8bc7e129-68b2-40fa-8bde-c568fd34e723 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:31:47.439538 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc7e129-68b2-40fa-8bde-c568fd34e723 service neutron] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:31:47.450454 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5af4ff-932a-4d69-b579-2a648a52c9ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8078e791ba68460f8b3aeafb4b79b73a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:31:47.451893 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5af4ff-932a-4d69-b579-2a648a52c9ba service cinder] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:31:47.452708 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5af4ff-932a-4d69-b579-2a648a52c9ba service cinder] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:31:47.453007 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5af4ff-932a-4d69-b579-2a648a52c9ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:31:47.455470 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-ca5af4ff-932a-4d69-b579-2a648a52c9ba service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:31:47.542337 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 808/1640] 10.222.0.27 () {58 vars in 1009 bytes} [Fri Sep 9 16:31:47 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:31:47.561370 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476dfce7-3222-44d5-b203-05b45677ce41 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:31:47.564194 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-476dfce7-3222-44d5-b203-05b45677ce41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:31:47.591641 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476dfce7-3222-44d5-b203-05b45677ce41 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:31:47.612029 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2113919-8439-44a5-b7ae-b870d59eeaf7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8078e791ba68460f8b3aeafb4b79b73a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:31:47.615563 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2113919-8439-44a5-b7ae-b870d59eeaf7 service cinder] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:31:47.615971 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2113919-8439-44a5-b7ae-b870d59eeaf7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:31:47.616373 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2113919-8439-44a5-b7ae-b870d59eeaf7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:31:47.640851 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2113919-8439-44a5-b7ae-b870d59eeaf7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:31:47.644560 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2113919-8439-44a5-b7ae-b870d59eeaf7 service cinder] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:31:47.673149 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5af4ff-932a-4d69-b579-2a648a52c9ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:31:47.675589 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5af4ff-932a-4d69-b579-2a648a52c9ba service cinder] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:31:47.680530 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 809/1641] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:31:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:31:47.690636 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 833/1642] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:31:47 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 16:31:48.800426 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f87667-3bd4-4388-8fd3-6a0d962d7c1d None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:31:48.800921 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f87667-3bd4-4388-8fd3-6a0d962d7c1d None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:31:48.800921 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f87667-3bd4-4388-8fd3-6a0d962d7c1d None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:31:48.802626 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 810/1643] 10.222.0.27 () {54 vars in 962 bytes} [Fri Sep 9 16:31:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:31:48.809988 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5296cc-a7db-4476-ad7f-3612f3175796 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:31:48.810461 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5296cc-a7db-4476-ad7f-3612f3175796 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:31:48.810554 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5296cc-a7db-4476-ad7f-3612f3175796 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:31:48.885863 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-8f5296cc-a7db-4476-ad7f-3612f3175796 None None] MFA Rules not processed for user `a332b9b4980646a3b14633293f77b505`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:31:48.893993 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-8f5296cc-a7db-4476-ad7f-3612f3175796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:31:48.967809 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631f6d20-fcb0-44aa-9165-cadb666e5386 None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:31:48.967809 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631f6d20-fcb0-44aa-9165-cadb666e5386 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:31:48.968066 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 834/1644] 10.222.0.27 () {58 vars in 1059 bytes} [Fri Sep 9 16:31:48 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:31:48.968651 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631f6d20-fcb0-44aa-9165-cadb666e5386 None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:31:48.969923 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 811/1645] 10.222.0.27 () {54 vars in 912 bytes} [Fri Sep 9 16:31:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:31:48.975255 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ea4264-c8c5-4453-b292-4f696bd0640f None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:31:48.975537 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ea4264-c8c5-4453-b292-4f696bd0640f None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:31:48.975812 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ea4264-c8c5-4453-b292-4f696bd0640f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:31:49.100223 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-50ea4264-c8c5-4453-b292-4f696bd0640f None None] MFA Rules not processed for user `a332b9b4980646a3b14633293f77b505`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:31:49.100223 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-50ea4264-c8c5-4453-b292-4f696bd0640f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:31:49.153830 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 835/1646] 10.222.0.27 () {58 vars in 1009 bytes} [Fri Sep 9 16:31:48 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:31:49.238504 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631f6d20-fcb0-44aa-9165-cadb666e5386 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:31:49.240435 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-631f6d20-fcb0-44aa-9165-cadb666e5386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:31:49.302294 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631f6d20-fcb0-44aa-9165-cadb666e5386 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:31:49.338212 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63daa97-dff1-4393-a961-a12e97209181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:31:49.339112 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63daa97-dff1-4393-a961-a12e97209181 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:31:49.339324 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63daa97-dff1-4393-a961-a12e97209181 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:31:49.339593 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63daa97-dff1-4393-a961-a12e97209181 admin admin] PATH_INFO: `/v3/projects/0b135393844e481f8d0cfadb7c3d41a5` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:31:49.347220 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63daa97-dff1-4393-a961-a12e97209181 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b135393844e481f8d0cfadb7c3d41a5)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:31:49.349351 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63daa97-dff1-4393-a961-a12e97209181 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:31:49.362518 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ea4264-c8c5-4453-b292-4f696bd0640f None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:31:49.381054 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ea4264-c8c5-4453-b292-4f696bd0640f None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:31:49.394519 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958e0e51-c468-4ea4-9b9a-79e30db8d12f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8078e791ba68460f8b3aeafb4b79b73a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:31:49.398685 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958e0e51-c468-4ea4-9b9a-79e30db8d12f service cinder] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:31:49.398996 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958e0e51-c468-4ea4-9b9a-79e30db8d12f service cinder] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:31:49.400379 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958e0e51-c468-4ea4-9b9a-79e30db8d12f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:31:49.452016 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958e0e51-c468-4ea4-9b9a-79e30db8d12f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:31:49.456037 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958e0e51-c468-4ea4-9b9a-79e30db8d12f service cinder] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:31:49.501587 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 836/1647] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:31:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:31:49.567058 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:31:49.587302 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-a63daa97-dff1-4393-a961-a12e97209181 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b135393844e481f8d0cfadb7c3d41a5', 'request_id': 'req-a63daa97-dff1-4393-a961-a12e97209181'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:31:49.603055 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-a63daa97-dff1-4393-a961-a12e97209181 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b135393844e481f8d0cfadb7c3d41a5', 'request_id': 'req-a63daa97-dff1-4393-a961-a12e97209181'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:31:49.629913 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-a63daa97-dff1-4393-a961-a12e97209181 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b135393844e481f8d0cfadb7c3d41a5', 'request_id': 'req-a63daa97-dff1-4393-a961-a12e97209181'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:31:49.673865 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-a63daa97-dff1-4393-a961-a12e97209181 admin admin] The token cache is being invalidate because project 0b135393844e481f8d0cfadb7c3d41a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81445) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 16:31:49.674211 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-a63daa97-dff1-4393-a961-a12e97209181 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:31:49.674968 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-a63daa97-dff1-4393-a961-a12e97209181 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:31:49.681204 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 812/1648] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 16:31:49 2022] DELETE /identity/v3/projects/0b135393844e481f8d0cfadb7c3d41a5 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:31:49.682082 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958e0e51-c468-4ea4-9b9a-79e30db8d12f service cinder] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:31:49.695540 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958e0e51-c468-4ea4-9b9a-79e30db8d12f service cinder] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:31:49.904490 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961ab55e-c8ff-4cec-abaf-b9d9859b762c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:31:49.905315 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961ab55e-c8ff-4cec-abaf-b9d9859b762c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:31:49.905806 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961ab55e-c8ff-4cec-abaf-b9d9859b762c admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:31:49.906284 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961ab55e-c8ff-4cec-abaf-b9d9859b762c admin admin] PATH_INFO: `/v3/users/bcbafefce0fc4050ade86d7f343d8c2a` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:31:49.910509 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961ab55e-c8ff-4cec-abaf-b9d9859b762c admin admin] RBAC: Authorizing `identity:delete_user(user_id=bcbafefce0fc4050ade86d7f343d8c2a)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:31:49.912717 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961ab55e-c8ff-4cec-abaf-b9d9859b762c admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:31:50.009724 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:31:50.036316 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-961ab55e-c8ff-4cec-abaf-b9d9859b762c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bcbafefce0fc4050ade86d7f343d8c2a'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:31:50.052865 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-961ab55e-c8ff-4cec-abaf-b9d9859b762c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bcbafefce0fc4050ade86d7f343d8c2a'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:31:50.099574 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-961ab55e-c8ff-4cec-abaf-b9d9859b762c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bcbafefce0fc4050ade86d7f343d8c2a'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:31:50.115668 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-961ab55e-c8ff-4cec-abaf-b9d9859b762c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bcbafefce0fc4050ade86d7f343d8c2a'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:31:50.125205 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-961ab55e-c8ff-4cec-abaf-b9d9859b762c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bcbafefce0fc4050ade86d7f343d8c2a'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:31:50.134166 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 837/1649] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 16:31:49 2022] DELETE /identity/v3/users/bcbafefce0fc4050ade86d7f343d8c2a => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:31:52.351541 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63daa97-dff1-4393-a961-a12e97209181 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:31:52.351541 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-a63daa97-dff1-4393-a961-a12e97209181 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:31:52.370848 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63daa97-dff1-4393-a961-a12e97209181 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:31:52.489441 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ec24e3-f6eb-482b-8df7-a2ddd5cd3f5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:31:52.492892 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ec24e3-f6eb-482b-8df7-a2ddd5cd3f5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:31:52.493236 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ec24e3-f6eb-482b-8df7-a2ddd5cd3f5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:31:52.493563 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ec24e3-f6eb-482b-8df7-a2ddd5cd3f5e admin admin] PATH_INFO: `/v3/users/14b527efa0ea47319734c3df431aed4a` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:31:52.494996 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ec24e3-f6eb-482b-8df7-a2ddd5cd3f5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=14b527efa0ea47319734c3df431aed4a)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:31:52.496499 dv-cinder-831247-27-smb devstack@keystone.service[81445]: WARNING py.warnings [None req-66ec24e3-f6eb-482b-8df7-a2ddd5cd3f5e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 09 16:31:52.496499 dv-cinder-831247-27-smb devstack@keystone.service[81445]: warnings.warn(msg) Sep 09 16:31:52.496499 dv-cinder-831247-27-smb devstack@keystone.service[81445]: Sep 09 16:31:52.497807 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ec24e3-f6eb-482b-8df7-a2ddd5cd3f5e admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:31:52.575408 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961ab55e-c8ff-4cec-abaf-b9d9859b762c admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:31:52.576846 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-961ab55e-c8ff-4cec-abaf-b9d9859b762c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:31:52.603921 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961ab55e-c8ff-4cec-abaf-b9d9859b762c admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:31:52.609303 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-66ec24e3-f6eb-482b-8df7-a2ddd5cd3f5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14b527efa0ea47319734c3df431aed4a'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:31:52.619376 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684bd34e-fd20-49bf-aed8-afe7ec043f12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:31:52.619949 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684bd34e-fd20-49bf-aed8-afe7ec043f12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:31:52.620131 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-66ec24e3-f6eb-482b-8df7-a2ddd5cd3f5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14b527efa0ea47319734c3df431aed4a'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:31:52.620241 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684bd34e-fd20-49bf-aed8-afe7ec043f12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:31:52.620651 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684bd34e-fd20-49bf-aed8-afe7ec043f12 admin admin] PATH_INFO: `/v3/projects/0f1749fd0dc246d3a5595133a594380d` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:31:52.621838 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-66ec24e3-f6eb-482b-8df7-a2ddd5cd3f5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14b527efa0ea47319734c3df431aed4a'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:31:52.628141 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684bd34e-fd20-49bf-aed8-afe7ec043f12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f1749fd0dc246d3a5595133a594380d)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:31:52.628502 dv-cinder-831247-27-smb devstack@keystone.service[81446]: WARNING py.warnings [None req-684bd34e-fd20-49bf-aed8-afe7ec043f12 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 09 16:31:52.628502 dv-cinder-831247-27-smb devstack@keystone.service[81446]: warnings.warn(msg) Sep 09 16:31:52.628502 dv-cinder-831247-27-smb devstack@keystone.service[81446]: Sep 09 16:31:52.629964 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684bd34e-fd20-49bf-aed8-afe7ec043f12 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:31:52.641263 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-66ec24e3-f6eb-482b-8df7-a2ddd5cd3f5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14b527efa0ea47319734c3df431aed4a'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:31:52.667037 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-66ec24e3-f6eb-482b-8df7-a2ddd5cd3f5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14b527efa0ea47319734c3df431aed4a'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:31:52.679888 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 813/1650] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 16:31:52 2022] DELETE /identity/v3/users/14b527efa0ea47319734c3df431aed4a => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:31:52.681428 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4091a629-103e-4e0a-af5f-ada5cab0fc0a None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:31:52.682444 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4091a629-103e-4e0a-af5f-ada5cab0fc0a None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:31:52.683021 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4091a629-103e-4e0a-af5f-ada5cab0fc0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:31:52.711993 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-4091a629-103e-4e0a-af5f-ada5cab0fc0a None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:31:52.713959 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-4091a629-103e-4e0a-af5f-ada5cab0fc0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:31:52.745077 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-684bd34e-fd20-49bf-aed8-afe7ec043f12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f1749fd0dc246d3a5595133a594380d', 'request_id': 'req-684bd34e-fd20-49bf-aed8-afe7ec043f12'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:31:52.763314 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-684bd34e-fd20-49bf-aed8-afe7ec043f12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f1749fd0dc246d3a5595133a594380d', 'request_id': 'req-684bd34e-fd20-49bf-aed8-afe7ec043f12'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:31:52.777921 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:31:52.778870 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-684bd34e-fd20-49bf-aed8-afe7ec043f12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f1749fd0dc246d3a5595133a594380d', 'request_id': 'req-684bd34e-fd20-49bf-aed8-afe7ec043f12'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:31:52.807356 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 814/1651] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:31:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:31:52.823945 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-684bd34e-fd20-49bf-aed8-afe7ec043f12 admin admin] The token cache is being invalidate because project 0f1749fd0dc246d3a5595133a594380d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81446) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 16:31:52.824243 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-684bd34e-fd20-49bf-aed8-afe7ec043f12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:31:52.825003 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-684bd34e-fd20-49bf-aed8-afe7ec043f12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:31:52.829146 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 838/1652] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 16:31:52 2022] DELETE /identity/v3/projects/0f1749fd0dc246d3a5595133a594380d => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 16:31:52.837129 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684bd34e-fd20-49bf-aed8-afe7ec043f12 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:31:52.839617 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-684bd34e-fd20-49bf-aed8-afe7ec043f12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:31:52.844401 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf4673a-0d73-44dd-b0fc-736000c65c78 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:31:52.844697 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf4673a-0d73-44dd-b0fc-736000c65c78 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:31:52.844979 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf4673a-0d73-44dd-b0fc-736000c65c78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:31:52.955222 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-2cf4673a-0d73-44dd-b0fc-736000c65c78 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:31:52.956627 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-2cf4673a-0d73-44dd-b0fc-736000c65c78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:31:52.980843 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 815/1653] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:31:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:31:52.990720 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2e61d2-ca36-473c-9158-3897993aaebd None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:31:52.991076 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2e61d2-ca36-473c-9158-3897993aaebd None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:31:52.991857 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2e61d2-ca36-473c-9158-3897993aaebd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:31:53.039799 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-1d2e61d2-ca36-473c-9158-3897993aaebd None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:31:53.041160 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-1d2e61d2-ca36-473c-9158-3897993aaebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:31:53.055964 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 816/1654] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:31:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:31:53.060396 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2e61d2-ca36-473c-9158-3897993aaebd None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:31:53.086785 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2e61d2-ca36-473c-9158-3897993aaebd None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:31:53.098137 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858f36a8-c652-4a3d-b2d9-413d0acc46d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:31:53.098881 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858f36a8-c652-4a3d-b2d9-413d0acc46d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:31:53.099831 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858f36a8-c652-4a3d-b2d9-413d0acc46d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:31:53.100230 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858f36a8-c652-4a3d-b2d9-413d0acc46d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:31:53.100900 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858f36a8-c652-4a3d-b2d9-413d0acc46d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:31:53.101265 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858f36a8-c652-4a3d-b2d9-413d0acc46d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:31:53.103449 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858f36a8-c652-4a3d-b2d9-413d0acc46d6 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:31:53.119368 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 817/1655] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Sep 9 16:31:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:31:53.124845 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684bd34e-fd20-49bf-aed8-afe7ec043f12 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:31:53.125021 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858f36a8-c652-4a3d-b2d9-413d0acc46d6 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:31:53.147255 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32aa284-e0e7-4897-8a8e-965be1a08d68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f44bfdd5214e8d84a2c0a5b1fd9b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:31:53.148483 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32aa284-e0e7-4897-8a8e-965be1a08d68 service neutron] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:31:53.148775 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32aa284-e0e7-4897-8a8e-965be1a08d68 service neutron] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:31:53.149051 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32aa284-e0e7-4897-8a8e-965be1a08d68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:31:53.154092 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-c32aa284-e0e7-4897-8a8e-965be1a08d68 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:31:53.170346 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858f36a8-c652-4a3d-b2d9-413d0acc46d6 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:31:53.184717 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0964a909-42a9-42d1-abf8-1069e57fdfeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:31:53.189336 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0964a909-42a9-42d1-abf8-1069e57fdfeb admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:31:53.190904 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0964a909-42a9-42d1-abf8-1069e57fdfeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:31:53.191505 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0964a909-42a9-42d1-abf8-1069e57fdfeb admin admin] PATH_INFO: `/v3/projects` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:31:53.195055 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0964a909-42a9-42d1-abf8-1069e57fdfeb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:31:53.196459 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32aa284-e0e7-4897-8a8e-965be1a08d68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:31:53.198381 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32aa284-e0e7-4897-8a8e-965be1a08d68 service neutron] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:31:53.212177 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0964a909-42a9-42d1-abf8-1069e57fdfeb admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:31:53.280584 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 839/1656] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:31:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:31:53.376298 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 818/1657] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 16:31:53 2022] POST /identity/v3/projects => generated 387 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:31:53.378401 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32aa284-e0e7-4897-8a8e-965be1a08d68 service neutron] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:31:53.393165 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32aa284-e0e7-4897-8a8e-965be1a08d68 service neutron] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:31:53.516343 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:31:53.573690 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6409fd43-4ec3-4371-a3db-0174323f511c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:31:53.574700 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6409fd43-4ec3-4371-a3db-0174323f511c admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:31:53.575078 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6409fd43-4ec3-4371-a3db-0174323f511c admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:31:53.575446 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6409fd43-4ec3-4371-a3db-0174323f511c admin admin] PATH_INFO: `/v3/users` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:31:53.576202 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6409fd43-4ec3-4371-a3db-0174323f511c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:31:53.578978 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6409fd43-4ec3-4371-a3db-0174323f511c admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:31:53.639185 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0964a909-42a9-42d1-abf8-1069e57fdfeb admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:31:53.640694 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 840/1658] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 16:31:53 2022] POST /identity/v3/users => generated 294 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:31:53.660899 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0964a909-42a9-42d1-abf8-1069e57fdfeb admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:31:53.680733 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ae2894-4a67-463e-9c76-d2c7be31b218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:31:53.681359 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ae2894-4a67-463e-9c76-d2c7be31b218 admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:31:53.681649 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ae2894-4a67-463e-9c76-d2c7be31b218 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:31:53.681914 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ae2894-4a67-463e-9c76-d2c7be31b218 admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:31:53.683070 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ae2894-4a67-463e-9c76-d2c7be31b218 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:31:53.685210 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ae2894-4a67-463e-9c76-d2c7be31b218 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:31:53.730209 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 819/1659] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:31:53 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:31:53.732853 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6409fd43-4ec3-4371-a3db-0174323f511c admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:31:53.749542 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6409fd43-4ec3-4371-a3db-0174323f511c admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:31:53.761172 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8882553-e690-4c57-abd6-c792e7622132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:31:53.762060 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8882553-e690-4c57-abd6-c792e7622132 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:31:53.762714 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8882553-e690-4c57-abd6-c792e7622132 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:31:53.763197 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8882553-e690-4c57-abd6-c792e7622132 admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:31:53.764049 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8882553-e690-4c57-abd6-c792e7622132 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:31:53.767169 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8882553-e690-4c57-abd6-c792e7622132 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:31:53.795916 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 841/1660] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:31:53 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:31:53.796680 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ae2894-4a67-463e-9c76-d2c7be31b218 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:31:53.810148 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ae2894-4a67-463e-9c76-d2c7be31b218 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:31:53.820845 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92f291e-22e9-4a34-a793-bd9af7ef5924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:31:53.821532 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92f291e-22e9-4a34-a793-bd9af7ef5924 admin admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:31:53.821894 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92f291e-22e9-4a34-a793-bd9af7ef5924 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:31:53.822071 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92f291e-22e9-4a34-a793-bd9af7ef5924 admin admin] PATH_INFO: `/v3/projects/a6be2130c4ab4c828f8c350f2df7b833/users/d995d72b0e304df6accb62a1dd689e1e/roles/b38e84bf077846ee802e6bb1bad83522` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:31:53.894294 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92f291e-22e9-4a34-a793-bd9af7ef5924 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6be2130c4ab4c828f8c350f2df7b833, user_id=d995d72b0e304df6accb62a1dd689e1e, role_id=b38e84bf077846ee802e6bb1bad83522)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:31:53.902637 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92f291e-22e9-4a34-a793-bd9af7ef5924 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:31:53.967292 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 820/1661] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 16:31:53 2022] PUT /identity/v3/projects/a6be2130c4ab4c828f8c350f2df7b833/users/d995d72b0e304df6accb62a1dd689e1e/roles/b38e84bf077846ee802e6bb1bad83522 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 16:31:53.979771 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70a8783-ea1b-4705-9ea6-a454949247d2 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:31:53.980174 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70a8783-ea1b-4705-9ea6-a454949247d2 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:31:53.980539 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70a8783-ea1b-4705-9ea6-a454949247d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:31:54.076324 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-f70a8783-ea1b-4705-9ea6-a454949247d2 None None] MFA Rules not processed for user `d995d72b0e304df6accb62a1dd689e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:31:54.079864 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-f70a8783-ea1b-4705-9ea6-a454949247d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:31:54.292156 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 842/1662] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:31:53 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:31:54.297747 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92f291e-22e9-4a34-a793-bd9af7ef5924 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:31:54.456865 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92f291e-22e9-4a34-a793-bd9af7ef5924 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:31:54.464972 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668d66f0-d5bf-4568-bcb7-442fac39c371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:31:54.465821 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668d66f0-d5bf-4568-bcb7-442fac39c371 admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:31:54.466249 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668d66f0-d5bf-4568-bcb7-442fac39c371 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:31:54.467287 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668d66f0-d5bf-4568-bcb7-442fac39c371 admin admin] PATH_INFO: `/v3/projects` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:31:54.468118 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668d66f0-d5bf-4568-bcb7-442fac39c371 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:31:54.470255 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668d66f0-d5bf-4568-bcb7-442fac39c371 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:31:54.529694 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 821/1663] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 16:31:54 2022] POST /identity/v3/projects => generated 387 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:31:54.534183 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70a8783-ea1b-4705-9ea6-a454949247d2 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:31:54.554393 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70a8783-ea1b-4705-9ea6-a454949247d2 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:31:54.662645 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87ed2dd-6ecd-4822-a46c-d9e704a12eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:31:54.664252 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87ed2dd-6ecd-4822-a46c-d9e704a12eec admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:31:54.664684 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87ed2dd-6ecd-4822-a46c-d9e704a12eec admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:31:54.665157 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87ed2dd-6ecd-4822-a46c-d9e704a12eec admin admin] PATH_INFO: `/v3/users` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:31:54.666104 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87ed2dd-6ecd-4822-a46c-d9e704a12eec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:31:54.668861 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87ed2dd-6ecd-4822-a46c-d9e704a12eec admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:31:54.712390 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 843/1664] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 16:31:54 2022] POST /identity/v3/users => generated 294 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:31:54.716194 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668d66f0-d5bf-4568-bcb7-442fac39c371 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:31:54.729387 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668d66f0-d5bf-4568-bcb7-442fac39c371 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:31:54.740312 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ba7ad5-0b57-4b2c-9368-1fbcc0c3efcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:31:54.742207 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ba7ad5-0b57-4b2c-9368-1fbcc0c3efcc admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:31:54.744372 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ba7ad5-0b57-4b2c-9368-1fbcc0c3efcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:31:54.744931 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ba7ad5-0b57-4b2c-9368-1fbcc0c3efcc admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:31:54.745751 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ba7ad5-0b57-4b2c-9368-1fbcc0c3efcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:31:54.749997 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ba7ad5-0b57-4b2c-9368-1fbcc0c3efcc admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:31:54.777459 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 822/1665] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:31:54 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:31:54.782016 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87ed2dd-6ecd-4822-a46c-d9e704a12eec admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:31:54.798437 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87ed2dd-6ecd-4822-a46c-d9e704a12eec admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:31:54.817169 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85bd164-af55-4098-af08-1d1e36a3baef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:31:54.818037 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85bd164-af55-4098-af08-1d1e36a3baef admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:31:54.818544 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85bd164-af55-4098-af08-1d1e36a3baef admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:31:54.819014 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85bd164-af55-4098-af08-1d1e36a3baef admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:31:54.819861 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85bd164-af55-4098-af08-1d1e36a3baef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:31:54.822006 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85bd164-af55-4098-af08-1d1e36a3baef admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:31:54.863139 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 844/1666] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:31:54 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:31:54.869636 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ba7ad5-0b57-4b2c-9368-1fbcc0c3efcc admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:31:54.892573 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ba7ad5-0b57-4b2c-9368-1fbcc0c3efcc admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:31:54.908203 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c32cda0-8769-41de-821f-963b13c39591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:31:54.908909 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c32cda0-8769-41de-821f-963b13c39591 admin admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:31:54.909191 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c32cda0-8769-41de-821f-963b13c39591 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:31:54.909466 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c32cda0-8769-41de-821f-963b13c39591 admin admin] PATH_INFO: `/v3/projects/5eb3d18404e04d9895e5f487c3d2e658/users/233a6371d6724a8eaddd39de4b0e5ba5/roles/b38e84bf077846ee802e6bb1bad83522` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:31:54.942180 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c32cda0-8769-41de-821f-963b13c39591 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5eb3d18404e04d9895e5f487c3d2e658, user_id=233a6371d6724a8eaddd39de4b0e5ba5, role_id=b38e84bf077846ee802e6bb1bad83522)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:31:54.944900 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c32cda0-8769-41de-821f-963b13c39591 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:31:54.970215 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 823/1667] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 16:31:54 2022] PUT /identity/v3/projects/5eb3d18404e04d9895e5f487c3d2e658/users/233a6371d6724a8eaddd39de4b0e5ba5/roles/b38e84bf077846ee802e6bb1bad83522 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:31:54.985718 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2cca3d-150d-4106-9a8b-dec350c5ddcd None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:31:54.986113 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2cca3d-150d-4106-9a8b-dec350c5ddcd None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:31:54.986995 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2cca3d-150d-4106-9a8b-dec350c5ddcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:31:55.057036 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-4a2cca3d-150d-4106-9a8b-dec350c5ddcd None None] MFA Rules not processed for user `233a6371d6724a8eaddd39de4b0e5ba5`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:31:55.060438 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-4a2cca3d-150d-4106-9a8b-dec350c5ddcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:31:55.096675 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:31:55.237831 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c32cda0-8769-41de-821f-963b13c39591 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:31:55.239819 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 845/1668] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:31:54 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:31:55.274011 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:31:55.380408 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c32cda0-8769-41de-821f-963b13c39591 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:31:55.388571 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208e877a-b32f-4fd8-923c-371c4ba6ffc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:31:55.390049 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208e877a-b32f-4fd8-923c-371c4ba6ffc5 admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:31:55.390719 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208e877a-b32f-4fd8-923c-371c4ba6ffc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:31:55.391303 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208e877a-b32f-4fd8-923c-371c4ba6ffc5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:31:55.392127 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208e877a-b32f-4fd8-923c-371c4ba6ffc5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:31:55.395769 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208e877a-b32f-4fd8-923c-371c4ba6ffc5 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:31:55.463441 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2cca3d-150d-4106-9a8b-dec350c5ddcd None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:31:55.474331 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 824/1669] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 16:31:55 2022] POST /identity/v3/projects => generated 387 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 16:31:55.480882 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2cca3d-150d-4106-9a8b-dec350c5ddcd None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:31:55.602154 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208e877a-b32f-4fd8-923c-371c4ba6ffc5 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:31:55.604268 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-208e877a-b32f-4fd8-923c-371c4ba6ffc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:31:55.699322 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be1fcfc-e59e-4366-9507-79f2e1fc2c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:31:55.708366 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be1fcfc-e59e-4366-9507-79f2e1fc2c44 admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:31:55.711003 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be1fcfc-e59e-4366-9507-79f2e1fc2c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:31:55.711412 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be1fcfc-e59e-4366-9507-79f2e1fc2c44 admin admin] PATH_INFO: `/v3/users` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:31:55.717055 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be1fcfc-e59e-4366-9507-79f2e1fc2c44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:31:55.730868 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be1fcfc-e59e-4366-9507-79f2e1fc2c44 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:31:55.799398 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 846/1670] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 16:31:55 2022] POST /identity/v3/users => generated 300 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:31:55.802940 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be1fcfc-e59e-4366-9507-79f2e1fc2c44 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:31:55.833545 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be1fcfc-e59e-4366-9507-79f2e1fc2c44 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:31:55.837062 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208e877a-b32f-4fd8-923c-371c4ba6ffc5 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:31:55.844529 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b76bf4-ac59-4389-9b35-742e88663dca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:31:55.845458 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b76bf4-ac59-4389-9b35-742e88663dca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:31:55.845894 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b76bf4-ac59-4389-9b35-742e88663dca admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:31:55.846364 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b76bf4-ac59-4389-9b35-742e88663dca admin admin] PATH_INFO: `/v3/users/d711d4238f90414691b6459ed9a400ae` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:31:55.848108 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b76bf4-ac59-4389-9b35-742e88663dca admin admin] RBAC: Authorizing `identity:delete_user(user_id=d711d4238f90414691b6459ed9a400ae)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:31:55.850341 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b76bf4-ac59-4389-9b35-742e88663dca admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:31:55.856635 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d2f4c7-e989-4c61-bd58-a5954ab84bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:31:55.857262 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d2f4c7-e989-4c61-bd58-a5954ab84bf8 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:31:55.857543 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d2f4c7-e989-4c61-bd58-a5954ab84bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:31:55.857808 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d2f4c7-e989-4c61-bd58-a5954ab84bf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:31:55.858615 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d2f4c7-e989-4c61-bd58-a5954ab84bf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:31:55.861247 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d2f4c7-e989-4c61-bd58-a5954ab84bf8 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:31:55.890344 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 847/1671] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:31:55 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:31:55.897167 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d2f4c7-e989-4c61-bd58-a5954ab84bf8 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:31:55.919302 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d2f4c7-e989-4c61-bd58-a5954ab84bf8 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:31:55.931983 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f034fc-8586-4889-9f22-c13f9617b830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:31:55.933124 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f034fc-8586-4889-9f22-c13f9617b830 admin admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:31:55.933611 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f034fc-8586-4889-9f22-c13f9617b830 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:31:55.934097 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f034fc-8586-4889-9f22-c13f9617b830 admin admin] PATH_INFO: `/v3/projects/6ae6d6bd13db46ce81caf55bf259f327/users/b8cc844c8c994a80a7f3b9d0ae60cdb0/roles/0a36d1be416f4089be19be979943b731` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:31:55.966109 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f034fc-8586-4889-9f22-c13f9617b830 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ae6d6bd13db46ce81caf55bf259f327, user_id=b8cc844c8c994a80a7f3b9d0ae60cdb0, role_id=0a36d1be416f4089be19be979943b731)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:31:55.969094 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f034fc-8586-4889-9f22-c13f9617b830 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:31:55.973426 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-69b76bf4-ac59-4389-9b35-742e88663dca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd711d4238f90414691b6459ed9a400ae'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:31:55.994386 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 848/1672] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 16:31:55 2022] PUT /identity/v3/projects/6ae6d6bd13db46ce81caf55bf259f327/users/b8cc844c8c994a80a7f3b9d0ae60cdb0/roles/0a36d1be416f4089be19be979943b731 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:31:56.000599 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-69b76bf4-ac59-4389-9b35-742e88663dca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd711d4238f90414691b6459ed9a400ae'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:31:56.003236 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f034fc-8586-4889-9f22-c13f9617b830 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:31:56.003775 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-69b76bf4-ac59-4389-9b35-742e88663dca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd711d4238f90414691b6459ed9a400ae'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:31:56.020048 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-69b76bf4-ac59-4389-9b35-742e88663dca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd711d4238f90414691b6459ed9a400ae'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:31:56.034563 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-69b76bf4-ac59-4389-9b35-742e88663dca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd711d4238f90414691b6459ed9a400ae'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:31:56.046351 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 825/1673] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 16:31:55 2022] DELETE /identity/v3/users/d711d4238f90414691b6459ed9a400ae => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:31:56.048683 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc683b4-6d67-4701-93a5-aa43cd9f0426 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:31:56.049087 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc683b4-6d67-4701-93a5-aa43cd9f0426 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:31:56.049743 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc683b4-6d67-4701-93a5-aa43cd9f0426 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:31:56.076190 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-cdc683b4-6d67-4701-93a5-aa43cd9f0426 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:31:56.078011 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-cdc683b4-6d67-4701-93a5-aa43cd9f0426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:31:56.116255 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:31:56.117368 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f034fc-8586-4889-9f22-c13f9617b830 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:31:56.146802 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:31:56.251864 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 826/1674] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:31:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:31:56.298397 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc683b4-6d67-4701-93a5-aa43cd9f0426 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:31:56.301073 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-cdc683b4-6d67-4701-93a5-aa43cd9f0426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:31:56.318527 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d52cb55-5863-4f53-8e93-addd0afba9fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:31:56.319151 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d52cb55-5863-4f53-8e93-addd0afba9fe admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:31:56.319431 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d52cb55-5863-4f53-8e93-addd0afba9fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:31:56.319701 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d52cb55-5863-4f53-8e93-addd0afba9fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:31:56.320342 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d52cb55-5863-4f53-8e93-addd0afba9fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:31:56.322615 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d52cb55-5863-4f53-8e93-addd0afba9fe admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:31:56.350893 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 849/1675] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:31:55 2022] GET /identity/v3/roles => generated 1420 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:31:56.353634 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d52cb55-5863-4f53-8e93-addd0afba9fe admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:31:56.360358 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-3d52cb55-5863-4f53-8e93-addd0afba9fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:31:56.406380 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d52cb55-5863-4f53-8e93-addd0afba9fe admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:31:56.428349 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9741476-86d3-4c18-82e9-221ac622c40e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:31:56.429155 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9741476-86d3-4c18-82e9-221ac622c40e admin admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:31:56.429373 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9741476-86d3-4c18-82e9-221ac622c40e admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:31:56.429628 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9741476-86d3-4c18-82e9-221ac622c40e admin admin] PATH_INFO: `/v3/projects/6ae6d6bd13db46ce81caf55bf259f327/users/b8cc844c8c994a80a7f3b9d0ae60cdb0/roles/0a36d1be416f4089be19be979943b731` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:31:56.468623 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9741476-86d3-4c18-82e9-221ac622c40e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ae6d6bd13db46ce81caf55bf259f327, user_id=b8cc844c8c994a80a7f3b9d0ae60cdb0, role_id=0a36d1be416f4089be19be979943b731)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:31:56.482555 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9741476-86d3-4c18-82e9-221ac622c40e admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:31:56.489685 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc683b4-6d67-4701-93a5-aa43cd9f0426 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:31:56.504630 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220faccc-80bc-4a11-b854-bec71a6bf0c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f44bfdd5214e8d84a2c0a5b1fd9b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:31:56.512383 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 850/1676] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 16:31:56 2022] PUT /identity/v3/projects/6ae6d6bd13db46ce81caf55bf259f327/users/b8cc844c8c994a80a7f3b9d0ae60cdb0/roles/0a36d1be416f4089be19be979943b731 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:31:56.514164 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9741476-86d3-4c18-82e9-221ac622c40e admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:31:56.527795 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220faccc-80bc-4a11-b854-bec71a6bf0c5 service neutron] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:31:56.529189 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220faccc-80bc-4a11-b854-bec71a6bf0c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:31:56.530856 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220faccc-80bc-4a11-b854-bec71a6bf0c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:31:56.535381 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-b9741476-86d3-4c18-82e9-221ac622c40e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:31:56.584719 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220faccc-80bc-4a11-b854-bec71a6bf0c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:31:56.586970 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220faccc-80bc-4a11-b854-bec71a6bf0c5 service neutron] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:31:56.631149 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 827/1677] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:31:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 16:31:56.634082 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3523522-c7b5-418c-b9bb-3ee2d8f447ee None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:31:56.634773 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3523522-c7b5-418c-b9bb-3ee2d8f447ee None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:31:56.635498 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3523522-c7b5-418c-b9bb-3ee2d8f447ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:31:56.755066 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9741476-86d3-4c18-82e9-221ac622c40e admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:31:56.767762 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1e0322-30ac-47c5-b4cd-5d7ef2c5e36c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:31:56.768423 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1e0322-30ac-47c5-b4cd-5d7ef2c5e36c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:31:56.768841 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1e0322-30ac-47c5-b4cd-5d7ef2c5e36c admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:31:56.769111 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1e0322-30ac-47c5-b4cd-5d7ef2c5e36c admin admin] PATH_INFO: `/v3/projects/e9cd760b270a40c689ec96680b786238` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:31:56.771125 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1e0322-30ac-47c5-b4cd-5d7ef2c5e36c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9cd760b270a40c689ec96680b786238)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:31:56.771771 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-e3523522-c7b5-418c-b9bb-3ee2d8f447ee None None] MFA Rules not processed for user `b8cc844c8c994a80a7f3b9d0ae60cdb0`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:31:56.773264 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1e0322-30ac-47c5-b4cd-5d7ef2c5e36c admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:31:56.774820 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-e3523522-c7b5-418c-b9bb-3ee2d8f447ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:31:56.953549 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-ad1e0322-30ac-47c5-b4cd-5d7ef2c5e36c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9cd760b270a40c689ec96680b786238', 'request_id': 'req-ad1e0322-30ac-47c5-b4cd-5d7ef2c5e36c'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:31:56.964098 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 828/1678] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:31:56 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:31:56.977889 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-ad1e0322-30ac-47c5-b4cd-5d7ef2c5e36c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9cd760b270a40c689ec96680b786238', 'request_id': 'req-ad1e0322-30ac-47c5-b4cd-5d7ef2c5e36c'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:31:56.979353 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3523522-c7b5-418c-b9bb-3ee2d8f447ee None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:31:56.992000 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-e3523522-c7b5-418c-b9bb-3ee2d8f447ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:31:56.995492 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-ad1e0322-30ac-47c5-b4cd-5d7ef2c5e36c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9cd760b270a40c689ec96680b786238', 'request_id': 'req-ad1e0322-30ac-47c5-b4cd-5d7ef2c5e36c'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:31:57.018635 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-ad1e0322-30ac-47c5-b4cd-5d7ef2c5e36c admin admin] The token cache is being invalidate because project e9cd760b270a40c689ec96680b786238 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81446) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 16:31:57.018928 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-ad1e0322-30ac-47c5-b4cd-5d7ef2c5e36c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:31:57.021244 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-ad1e0322-30ac-47c5-b4cd-5d7ef2c5e36c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:31:57.023097 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 851/1679] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 16:31:56 2022] DELETE /identity/v3/projects/e9cd760b270a40c689ec96680b786238 => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:31:57.027787 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baca2817-1f2b-4387-a82a-ac354c1268f1 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:31:57.028140 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baca2817-1f2b-4387-a82a-ac354c1268f1 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:31:57.028609 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baca2817-1f2b-4387-a82a-ac354c1268f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:31:57.070224 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-baca2817-1f2b-4387-a82a-ac354c1268f1 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:31:57.072153 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-baca2817-1f2b-4387-a82a-ac354c1268f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:31:57.134459 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:31:57.177073 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:31:57.192640 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3523522-c7b5-418c-b9bb-3ee2d8f447ee None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:31:57.230270 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 852/1680] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:31:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 16:31:57.238409 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b05c286-2f94-47af-b202-6aaca8c94b02 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:31:57.238765 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b05c286-2f94-47af-b202-6aaca8c94b02 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:31:57.239037 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b05c286-2f94-47af-b202-6aaca8c94b02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:31:57.275058 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-7b05c286-2f94-47af-b202-6aaca8c94b02 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:31:57.279343 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-7b05c286-2f94-47af-b202-6aaca8c94b02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:31:57.298389 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 853/1681] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:31:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 16:31:57.302616 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b05c286-2f94-47af-b202-6aaca8c94b02 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:31:57.316976 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b05c286-2f94-47af-b202-6aaca8c94b02 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:31:57.325787 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7045f7-f96c-4386-b2c6-2cdd996add3f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8078e791ba68460f8b3aeafb4b79b73a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:31:57.327004 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7045f7-f96c-4386-b2c6-2cdd996add3f service cinder] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:31:57.328355 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7045f7-f96c-4386-b2c6-2cdd996add3f service cinder] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:31:57.328650 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7045f7-f96c-4386-b2c6-2cdd996add3f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:31:57.334221 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-1a7045f7-f96c-4386-b2c6-2cdd996add3f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:31:57.335049 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfa5c9e-151c-438b-817d-2dd333730912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:31:57.335681 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfa5c9e-151c-438b-817d-2dd333730912 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:31:57.335958 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfa5c9e-151c-438b-817d-2dd333730912 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:31:57.336425 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfa5c9e-151c-438b-817d-2dd333730912 admin admin] PATH_INFO: `/v3/domains` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:31:57.336870 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfa5c9e-151c-438b-817d-2dd333730912 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:31:57.337166 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfa5c9e-151c-438b-817d-2dd333730912 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:31:57.338810 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfa5c9e-151c-438b-817d-2dd333730912 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:31:57.358452 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 854/1682] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Sep 9 16:31:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:31:57.362065 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfa5c9e-151c-438b-817d-2dd333730912 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:31:57.389069 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfa5c9e-151c-438b-817d-2dd333730912 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:31:57.395478 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42afc19a-0053-45a1-be59-bce6f02cfa6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:31:57.396155 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42afc19a-0053-45a1-be59-bce6f02cfa6b admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:31:57.396436 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42afc19a-0053-45a1-be59-bce6f02cfa6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:31:57.396975 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42afc19a-0053-45a1-be59-bce6f02cfa6b admin admin] PATH_INFO: `/v3/projects` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:31:57.397684 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42afc19a-0053-45a1-be59-bce6f02cfa6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:31:57.399743 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42afc19a-0053-45a1-be59-bce6f02cfa6b admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:31:57.451232 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 855/1683] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 16:31:57 2022] POST /identity/v3/projects => generated 375 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:31:57.455168 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efdb1ed-635c-46d2-ad5c-8ad202560cc2 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:31:57.457359 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efdb1ed-635c-46d2-ad5c-8ad202560cc2 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:31:57.457781 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efdb1ed-635c-46d2-ad5c-8ad202560cc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:31:57.495379 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7045f7-f96c-4386-b2c6-2cdd996add3f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:31:57.496869 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7045f7-f96c-4386-b2c6-2cdd996add3f service cinder] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:31:57.523459 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-4efdb1ed-635c-46d2-ad5c-8ad202560cc2 None None] MFA Rules not processed for user `262f8e59bf4e40648ff6c49e58dd86c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:31:57.524827 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-4efdb1ed-635c-46d2-ad5c-8ad202560cc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:31:57.562388 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 829/1684] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:31:56 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 582 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:31:57.563582 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7045f7-f96c-4386-b2c6-2cdd996add3f service cinder] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:31:57.608058 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7045f7-f96c-4386-b2c6-2cdd996add3f service cinder] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:31:57.722629 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 856/1685] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:31:57 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:31:57.724100 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efdb1ed-635c-46d2-ad5c-8ad202560cc2 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:31:57.727436 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-4efdb1ed-635c-46d2-ad5c-8ad202560cc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:31:57.846607 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb1a5ac-743f-4778-9938-984aab5e83ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:31:57.848542 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb1a5ac-743f-4778-9938-984aab5e83ee admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:31:57.849209 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb1a5ac-743f-4778-9938-984aab5e83ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:31:57.850458 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb1a5ac-743f-4778-9938-984aab5e83ee admin admin] PATH_INFO: `/v3/users` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:31:57.852438 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb1a5ac-743f-4778-9938-984aab5e83ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:31:57.855941 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb1a5ac-743f-4778-9938-984aab5e83ee admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:31:57.913306 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 830/1686] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 16:31:57 2022] POST /identity/v3/users => generated 288 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:31:57.913306 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df647cfe-2d13-43f8-9da3-623b97abb7ce None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:31:57.914601 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df647cfe-2d13-43f8-9da3-623b97abb7ce None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:31:57.914601 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df647cfe-2d13-43f8-9da3-623b97abb7ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:31:57.916768 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efdb1ed-635c-46d2-ad5c-8ad202560cc2 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:31:57.932398 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac159db-25a5-4f7e-a833-bfb2747da4b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:31:57.933098 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac159db-25a5-4f7e-a833-bfb2747da4b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:31:57.935433 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac159db-25a5-4f7e-a833-bfb2747da4b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:31:57.935712 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac159db-25a5-4f7e-a833-bfb2747da4b2 admin admin] PATH_INFO: `/v3/projects/e1dc8391ee194cdbacc846f5bd35ea74` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:31:57.949239 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac159db-25a5-4f7e-a833-bfb2747da4b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1dc8391ee194cdbacc846f5bd35ea74)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:31:57.951277 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac159db-25a5-4f7e-a833-bfb2747da4b2 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:31:57.976101 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-df647cfe-2d13-43f8-9da3-623b97abb7ce None None] MFA Rules not processed for user `262f8e59bf4e40648ff6c49e58dd86c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:31:57.982893 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-df647cfe-2d13-43f8-9da3-623b97abb7ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:31:57.998266 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:31:58.027735 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 831/1687] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:31:57 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:31:58.027735 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df647cfe-2d13-43f8-9da3-623b97abb7ce None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:31:58.054340 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-7ac159db-25a5-4f7e-a833-bfb2747da4b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1dc8391ee194cdbacc846f5bd35ea74', 'request_id': 'req-7ac159db-25a5-4f7e-a833-bfb2747da4b2'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:31:58.061405 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-7ac159db-25a5-4f7e-a833-bfb2747da4b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1dc8391ee194cdbacc846f5bd35ea74', 'request_id': 'req-7ac159db-25a5-4f7e-a833-bfb2747da4b2'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:31:58.065328 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df647cfe-2d13-43f8-9da3-623b97abb7ce None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:31:58.094334 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-7ac159db-25a5-4f7e-a833-bfb2747da4b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1dc8391ee194cdbacc846f5bd35ea74', 'request_id': 'req-7ac159db-25a5-4f7e-a833-bfb2747da4b2'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:31:58.119589 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-7ac159db-25a5-4f7e-a833-bfb2747da4b2 admin admin] The token cache is being invalidate because project e1dc8391ee194cdbacc846f5bd35ea74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81446) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 16:31:58.122178 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-7ac159db-25a5-4f7e-a833-bfb2747da4b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:31:58.124525 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-7ac159db-25a5-4f7e-a833-bfb2747da4b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:31:58.131136 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 857/1688] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 16:31:57 2022] DELETE /identity/v3/projects/e1dc8391ee194cdbacc846f5bd35ea74 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:31:58.132043 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac159db-25a5-4f7e-a833-bfb2747da4b2 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:31:58.133532 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-7ac159db-25a5-4f7e-a833-bfb2747da4b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:31:58.167572 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:31:58.214831 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72ce447-8aa2-4cd5-9f96-055329c691c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:31:58.215846 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72ce447-8aa2-4cd5-9f96-055329c691c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:31:58.216212 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72ce447-8aa2-4cd5-9f96-055329c691c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:31:58.216762 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72ce447-8aa2-4cd5-9f96-055329c691c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:31:58.219046 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72ce447-8aa2-4cd5-9f96-055329c691c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:31:58.223477 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72ce447-8aa2-4cd5-9f96-055329c691c0 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:31:58.249971 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 832/1689] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:31:58 2022] GET /identity/v3/roles => generated 1420 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:31:58.252088 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72ce447-8aa2-4cd5-9f96-055329c691c0 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:31:58.256712 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-e72ce447-8aa2-4cd5-9f96-055329c691c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:31:58.286676 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72ce447-8aa2-4cd5-9f96-055329c691c0 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:31:58.300775 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a506190-91af-4167-81c6-96d8e0b7959e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:31:58.301520 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a506190-91af-4167-81c6-96d8e0b7959e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:31:58.301875 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a506190-91af-4167-81c6-96d8e0b7959e admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:31:58.302158 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a506190-91af-4167-81c6-96d8e0b7959e admin admin] PATH_INFO: `/v3/users/fd4c297fe45d4436aaf5f13870ff91b1` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:31:58.303623 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a506190-91af-4167-81c6-96d8e0b7959e admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd4c297fe45d4436aaf5f13870ff91b1)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:31:58.305606 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a506190-91af-4167-81c6-96d8e0b7959e admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:31:58.321928 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac159db-25a5-4f7e-a833-bfb2747da4b2 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:31:58.328799 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a57207-53d9-40b7-b04e-57075ce55b9b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a332b9b4980646a3b14633293f77b505', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:31:58.329421 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a57207-53d9-40b7-b04e-57075ce55b9b service nova] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:31:58.329792 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a57207-53d9-40b7-b04e-57075ce55b9b service nova] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:31:58.330075 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a57207-53d9-40b7-b04e-57075ce55b9b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:31:58.332062 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-c0a57207-53d9-40b7-b04e-57075ce55b9b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:31:58.435754 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-3a506190-91af-4167-81c6-96d8e0b7959e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd4c297fe45d4436aaf5f13870ff91b1'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:31:58.454029 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-3a506190-91af-4167-81c6-96d8e0b7959e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd4c297fe45d4436aaf5f13870ff91b1'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:31:58.454701 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-3a506190-91af-4167-81c6-96d8e0b7959e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd4c297fe45d4436aaf5f13870ff91b1'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:31:58.463633 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-3a506190-91af-4167-81c6-96d8e0b7959e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd4c297fe45d4436aaf5f13870ff91b1'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:31:58.482967 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-3a506190-91af-4167-81c6-96d8e0b7959e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd4c297fe45d4436aaf5f13870ff91b1'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:31:58.489306 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a57207-53d9-40b7-b04e-57075ce55b9b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:31:58.492447 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a57207-53d9-40b7-b04e-57075ce55b9b service nova] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:31:58.494554 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 833/1690] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 16:31:58 2022] DELETE /identity/v3/users/fd4c297fe45d4436aaf5f13870ff91b1 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:31:58.495508 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a506190-91af-4167-81c6-96d8e0b7959e admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:31:58.511868 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-3a506190-91af-4167-81c6-96d8e0b7959e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:31:58.526181 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 858/1691] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:31:58 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:31:58.731977 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a506190-91af-4167-81c6-96d8e0b7959e admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:31:58.759982 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaf6b2f-b2b7-46fc-9fc9-e0473af4e313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:31:58.760909 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaf6b2f-b2b7-46fc-9fc9-e0473af4e313 admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:31:58.761408 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaf6b2f-b2b7-46fc-9fc9-e0473af4e313 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:31:58.761785 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaf6b2f-b2b7-46fc-9fc9-e0473af4e313 admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:31:58.763239 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaf6b2f-b2b7-46fc-9fc9-e0473af4e313 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:31:58.765609 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaf6b2f-b2b7-46fc-9fc9-e0473af4e313 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:31:58.783637 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a57207-53d9-40b7-b04e-57075ce55b9b service nova] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:31:58.785444 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-c0a57207-53d9-40b7-b04e-57075ce55b9b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:31:58.785590 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 834/1692] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:31:58 2022] GET /identity/v3/roles => generated 1420 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:31:58.788396 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaf6b2f-b2b7-46fc-9fc9-e0473af4e313 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:31:58.807188 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaf6b2f-b2b7-46fc-9fc9-e0473af4e313 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:31:58.814034 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344c1ec1-aedc-4ee9-a927-aaaeedd95734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:31:58.814647 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344c1ec1-aedc-4ee9-a927-aaaeedd95734 admin admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:31:58.815444 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344c1ec1-aedc-4ee9-a927-aaaeedd95734 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:31:58.816067 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344c1ec1-aedc-4ee9-a927-aaaeedd95734 admin admin] PATH_INFO: `/v3/projects/65e3cfdfbbe1436e86b4cc522b7a1519/users/92f4dadfc05044928fb7065770f72109/roles/b38e84bf077846ee802e6bb1bad83522` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:31:58.864301 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344c1ec1-aedc-4ee9-a927-aaaeedd95734 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65e3cfdfbbe1436e86b4cc522b7a1519, user_id=92f4dadfc05044928fb7065770f72109, role_id=b38e84bf077846ee802e6bb1bad83522)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:31:58.874902 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344c1ec1-aedc-4ee9-a927-aaaeedd95734 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:31:58.899544 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:31:58.909647 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 835/1693] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 16:31:58 2022] PUT /identity/v3/projects/65e3cfdfbbe1436e86b4cc522b7a1519/users/92f4dadfc05044928fb7065770f72109/roles/b38e84bf077846ee802e6bb1bad83522 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:31:58.924237 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344c1ec1-aedc-4ee9-a927-aaaeedd95734 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:31:58.927832 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-344c1ec1-aedc-4ee9-a927-aaaeedd95734 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:31:58.932352 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a57207-53d9-40b7-b04e-57075ce55b9b service nova] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:31:58.961839 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:31:59.020737 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f629dfd-578b-499d-9bc8-65773e919ac4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8078e791ba68460f8b3aeafb4b79b73a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:31:59.021279 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f629dfd-578b-499d-9bc8-65773e919ac4 service cinder] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:31:59.021558 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f629dfd-578b-499d-9bc8-65773e919ac4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:31:59.021829 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f629dfd-578b-499d-9bc8-65773e919ac4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:31:59.027740 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-9f629dfd-578b-499d-9bc8-65773e919ac4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:31:59.044043 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344c1ec1-aedc-4ee9-a927-aaaeedd95734 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:31:59.054061 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce64805f-c843-4d8b-a071-c5c97390a809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:31:59.056231 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce64805f-c843-4d8b-a071-c5c97390a809 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:31:59.057099 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce64805f-c843-4d8b-a071-c5c97390a809 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:31:59.058843 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce64805f-c843-4d8b-a071-c5c97390a809 admin admin] PATH_INFO: `/v3/users/75d0321b6e7d410d96359a9ff65ea6b1` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:31:59.061577 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce64805f-c843-4d8b-a071-c5c97390a809 admin admin] RBAC: Authorizing `identity:delete_user(user_id=75d0321b6e7d410d96359a9ff65ea6b1)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:31:59.065431 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce64805f-c843-4d8b-a071-c5c97390a809 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:31:59.176980 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-ce64805f-c843-4d8b-a071-c5c97390a809 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75d0321b6e7d410d96359a9ff65ea6b1'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:31:59.191917 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-ce64805f-c843-4d8b-a071-c5c97390a809 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75d0321b6e7d410d96359a9ff65ea6b1'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:31:59.193740 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f629dfd-578b-499d-9bc8-65773e919ac4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:31:59.194057 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-ce64805f-c843-4d8b-a071-c5c97390a809 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75d0321b6e7d410d96359a9ff65ea6b1'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:31:59.198049 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f629dfd-578b-499d-9bc8-65773e919ac4 service cinder] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:31:59.225275 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-ce64805f-c843-4d8b-a071-c5c97390a809 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75d0321b6e7d410d96359a9ff65ea6b1'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:31:59.257525 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 859/1694] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:31:58 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:31:59.261409 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084fc32f-b338-4fa1-9dc8-3edab64366db None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:31:59.266702 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084fc32f-b338-4fa1-9dc8-3edab64366db None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:31:59.267298 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084fc32f-b338-4fa1-9dc8-3edab64366db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:31:59.273576 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-ce64805f-c843-4d8b-a071-c5c97390a809 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75d0321b6e7d410d96359a9ff65ea6b1'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:31:59.295202 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 836/1695] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 16:31:58 2022] DELETE /identity/v3/users/75d0321b6e7d410d96359a9ff65ea6b1 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:31:59.303042 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454f244b-87f8-4dcc-bc5d-560566c0dc67 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:31:59.311406 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454f244b-87f8-4dcc-bc5d-560566c0dc67 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:31:59.312325 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454f244b-87f8-4dcc-bc5d-560566c0dc67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:31:59.357947 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-084fc32f-b338-4fa1-9dc8-3edab64366db None None] MFA Rules not processed for user `92f4dadfc05044928fb7065770f72109`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:31:59.359261 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-084fc32f-b338-4fa1-9dc8-3edab64366db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:31:59.385168 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-454f244b-87f8-4dcc-bc5d-560566c0dc67 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:31:59.389129 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-454f244b-87f8-4dcc-bc5d-560566c0dc67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:31:59.508145 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 837/1696] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:31:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:31:59.532161 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 860/1697] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:31:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:31:59.546592 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454f244b-87f8-4dcc-bc5d-560566c0dc67 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:31:59.548899 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-454f244b-87f8-4dcc-bc5d-560566c0dc67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:31:59.623772 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084fc32f-b338-4fa1-9dc8-3edab64366db None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:31:59.625232 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-084fc32f-b338-4fa1-9dc8-3edab64366db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:31:59.709404 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:31:59.792923 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:31:59.802604 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454f244b-87f8-4dcc-bc5d-560566c0dc67 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:31:59.819871 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040936dd-f560-4917-8de8-e67a9bc65c0e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a332b9b4980646a3b14633293f77b505', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:31:59.820258 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040936dd-f560-4917-8de8-e67a9bc65c0e service nova] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:31:59.820429 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040936dd-f560-4917-8de8-e67a9bc65c0e service nova] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:31:59.822481 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040936dd-f560-4917-8de8-e67a9bc65c0e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:31:59.833430 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084fc32f-b338-4fa1-9dc8-3edab64366db None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:31:59.841777 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cc33ad-1559-4c70-b2ac-6a1e40cfcc6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f44bfdd5214e8d84a2c0a5b1fd9b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:31:59.843079 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cc33ad-1559-4c70-b2ac-6a1e40cfcc6b service neutron] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:31:59.843377 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cc33ad-1559-4c70-b2ac-6a1e40cfcc6b service neutron] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:31:59.843724 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cc33ad-1559-4c70-b2ac-6a1e40cfcc6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:31:59.850357 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040936dd-f560-4917-8de8-e67a9bc65c0e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:31:59.859880 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040936dd-f560-4917-8de8-e67a9bc65c0e service nova] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:31:59.883596 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cc33ad-1559-4c70-b2ac-6a1e40cfcc6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:31:59.885175 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cc33ad-1559-4c70-b2ac-6a1e40cfcc6b service neutron] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:31:59.902337 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 861/1698] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:31:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 16:31:59.904212 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 838/1699] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:31:59 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:31:59.909530 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040936dd-f560-4917-8de8-e67a9bc65c0e service nova] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:31:59.910479 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b327c8-7dce-43b5-a743-5fa75c194ae9 None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:31:59.910859 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b327c8-7dce-43b5-a743-5fa75c194ae9 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:31:59.911137 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b327c8-7dce-43b5-a743-5fa75c194ae9 None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:31:59.913433 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-040936dd-f560-4917-8de8-e67a9bc65c0e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:31:59.916935 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 862/1700] 10.222.0.27 () {54 vars in 912 bytes} [Fri Sep 9 16:31:59 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:31:59.918359 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45096f13-75a9-4630-a985-5bbf47c8e4d2 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:31:59.918490 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45096f13-75a9-4630-a985-5bbf47c8e4d2 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:31:59.918700 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45096f13-75a9-4630-a985-5bbf47c8e4d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:31:59.978726 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040936dd-f560-4917-8de8-e67a9bc65c0e service nova] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:00.007368 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb512de-afce-49fc-9bce-b8240a8d06f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:00.008364 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb512de-afce-49fc-9bce-b8240a8d06f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:00.008804 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb512de-afce-49fc-9bce-b8240a8d06f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:00.009216 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb512de-afce-49fc-9bce-b8240a8d06f1 admin admin] PATH_INFO: `/v3/projects/c34ca77c3606486d957ce64cad77fd9b` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:00.011020 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb512de-afce-49fc-9bce-b8240a8d06f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c34ca77c3606486d957ce64cad77fd9b)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:00.013131 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb512de-afce-49fc-9bce-b8240a8d06f1 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:00.084809 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-45096f13-75a9-4630-a985-5bbf47c8e4d2 None None] MFA Rules not processed for user `d5f44bfdd5214e8d84a2c0a5b1fd9b84`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:32:00.086059 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-45096f13-75a9-4630-a985-5bbf47c8e4d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:00.134574 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 863/1701] 10.222.0.27 () {58 vars in 1009 bytes} [Fri Sep 9 16:31:59 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:32:00.168065 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45096f13-75a9-4630-a985-5bbf47c8e4d2 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:00.184654 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45096f13-75a9-4630-a985-5bbf47c8e4d2 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:00.214727 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-8cb512de-afce-49fc-9bce-b8240a8d06f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c34ca77c3606486d957ce64cad77fd9b', 'request_id': 'req-8cb512de-afce-49fc-9bce-b8240a8d06f1'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:00.242634 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-8cb512de-afce-49fc-9bce-b8240a8d06f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c34ca77c3606486d957ce64cad77fd9b', 'request_id': 'req-8cb512de-afce-49fc-9bce-b8240a8d06f1'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:00.276543 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-8cb512de-afce-49fc-9bce-b8240a8d06f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c34ca77c3606486d957ce64cad77fd9b', 'request_id': 'req-8cb512de-afce-49fc-9bce-b8240a8d06f1'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:00.315565 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-8cb512de-afce-49fc-9bce-b8240a8d06f1 admin admin] The token cache is being invalidate because project c34ca77c3606486d957ce64cad77fd9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81445) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 16:32:00.315858 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-8cb512de-afce-49fc-9bce-b8240a8d06f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:00.318108 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-8cb512de-afce-49fc-9bce-b8240a8d06f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:00.327672 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 839/1702] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 16:31:59 2022] DELETE /identity/v3/projects/c34ca77c3606486d957ce64cad77fd9b => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:32:00.337947 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7370c73c-f962-42c0-8848-97ec1440a736 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:00.338239 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7370c73c-f962-42c0-8848-97ec1440a736 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:00.338533 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7370c73c-f962-42c0-8848-97ec1440a736 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:00.421984 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-7370c73c-f962-42c0-8848-97ec1440a736 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:32:00.423324 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-7370c73c-f962-42c0-8848-97ec1440a736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:00.469831 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5c8951-c9e9-4f68-9c15-f3c26698d183 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f44bfdd5214e8d84a2c0a5b1fd9b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:00.470910 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5c8951-c9e9-4f68-9c15-f3c26698d183 service neutron] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:00.471376 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5c8951-c9e9-4f68-9c15-f3c26698d183 service neutron] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:00.472026 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5c8951-c9e9-4f68-9c15-f3c26698d183 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:00.502794 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-1a5c8951-c9e9-4f68-9c15-f3c26698d183 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:00.535001 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5c8951-c9e9-4f68-9c15-f3c26698d183 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:00.536636 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5c8951-c9e9-4f68-9c15-f3c26698d183 service neutron] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:00.554390 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 864/1703] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:32:00 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:32:00.555410 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5c8951-c9e9-4f68-9c15-f3c26698d183 service neutron] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:00.560163 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-1a5c8951-c9e9-4f68-9c15-f3c26698d183 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:00.655372 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 840/1704] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:32:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:32:00.656923 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdbba40-2119-4db2-bd2e-502b459c88f0 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:00.657214 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdbba40-2119-4db2-bd2e-502b459c88f0 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:00.657490 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdbba40-2119-4db2-bd2e-502b459c88f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:00.710340 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-6cdbba40-2119-4db2-bd2e-502b459c88f0 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:32:00.713314 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-6cdbba40-2119-4db2-bd2e-502b459c88f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:00.753022 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 841/1705] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:32:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:32:00.755803 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdbba40-2119-4db2-bd2e-502b459c88f0 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:00.773704 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdbba40-2119-4db2-bd2e-502b459c88f0 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:00.775762 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5c8951-c9e9-4f68-9c15-f3c26698d183 service neutron] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:00.788201 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47396d4a-7637-4ef2-ad89-9f8bb30d87d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:00.788550 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47396d4a-7637-4ef2-ad89-9f8bb30d87d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:00.788834 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47396d4a-7637-4ef2-ad89-9f8bb30d87d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:00.789091 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47396d4a-7637-4ef2-ad89-9f8bb30d87d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:00.789931 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47396d4a-7637-4ef2-ad89-9f8bb30d87d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:32:00.790042 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47396d4a-7637-4ef2-ad89-9f8bb30d87d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:00.792494 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31e8e67-f2fe-4a20-b013-675ecedabc3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:00.793360 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31e8e67-f2fe-4a20-b013-675ecedabc3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:00.793641 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31e8e67-f2fe-4a20-b013-675ecedabc3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:00.793913 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31e8e67-f2fe-4a20-b013-675ecedabc3b admin admin] PATH_INFO: `/v3/users/92f4dadfc05044928fb7065770f72109` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:00.796555 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47396d4a-7637-4ef2-ad89-9f8bb30d87d6 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:00.798841 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31e8e67-f2fe-4a20-b013-675ecedabc3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=92f4dadfc05044928fb7065770f72109)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:00.800789 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31e8e67-f2fe-4a20-b013-675ecedabc3b admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:00.830217 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 842/1706] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Sep 9 16:32:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:32:00.835953 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47396d4a-7637-4ef2-ad89-9f8bb30d87d6 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:00.861474 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47396d4a-7637-4ef2-ad89-9f8bb30d87d6 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:00.868843 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b7576b-c872-402a-b38f-26d85c38548c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:00.869549 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b7576b-c872-402a-b38f-26d85c38548c admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:00.869804 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b7576b-c872-402a-b38f-26d85c38548c admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:00.870076 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b7576b-c872-402a-b38f-26d85c38548c admin admin] PATH_INFO: `/v3/projects` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:00.870792 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b7576b-c872-402a-b38f-26d85c38548c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:00.873265 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b7576b-c872-402a-b38f-26d85c38548c admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:00.935043 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-f31e8e67-f2fe-4a20-b013-675ecedabc3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92f4dadfc05044928fb7065770f72109'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:00.957596 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-f31e8e67-f2fe-4a20-b013-675ecedabc3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92f4dadfc05044928fb7065770f72109'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:00.974214 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 843/1707] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 16:32:00 2022] POST /identity/v3/projects => generated 363 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:32:00.975276 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b7576b-c872-402a-b38f-26d85c38548c admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:00.993801 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:32:00.994240 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:32:01.005287 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-f31e8e67-f2fe-4a20-b013-675ecedabc3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92f4dadfc05044928fb7065770f72109'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:01.022428 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-f31e8e67-f2fe-4a20-b013-675ecedabc3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92f4dadfc05044928fb7065770f72109'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:01.023053 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-f31e8e67-f2fe-4a20-b013-675ecedabc3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92f4dadfc05044928fb7065770f72109'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:01.036492 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 865/1708] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 16:32:00 2022] DELETE /identity/v3/users/92f4dadfc05044928fb7065770f72109 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:32:01.039408 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d097091-906a-4d8a-a479-0389af759deb None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:01.039698 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d097091-906a-4d8a-a479-0389af759deb None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:01.040031 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d097091-906a-4d8a-a479-0389af759deb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:01.098165 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-9d097091-906a-4d8a-a479-0389af759deb None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:32:01.099439 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-9d097091-906a-4d8a-a479-0389af759deb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:01.193168 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b7576b-c872-402a-b38f-26d85c38548c admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:01.347022 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 866/1709] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:32:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 16:32:01.375778 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee1ed98-0bdc-44d4-850a-d27c0f9bbaeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:01.377585 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee1ed98-0bdc-44d4-850a-d27c0f9bbaeb admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:01.377880 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee1ed98-0bdc-44d4-850a-d27c0f9bbaeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:01.378158 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee1ed98-0bdc-44d4-850a-d27c0f9bbaeb admin admin] PATH_INFO: `/v3/users` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:01.378836 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee1ed98-0bdc-44d4-850a-d27c0f9bbaeb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:01.380792 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee1ed98-0bdc-44d4-850a-d27c0f9bbaeb admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:01.427080 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 844/1710] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 16:32:00 2022] POST /identity/v3/users => generated 282 bytes in 452 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:32:01.431322 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d097091-906a-4d8a-a479-0389af759deb None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:01.433985 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-9d097091-906a-4d8a-a479-0389af759deb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:01.462362 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d097091-906a-4d8a-a479-0389af759deb None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:01.467872 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee1ed98-0bdc-44d4-850a-d27c0f9bbaeb admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:01.469965 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-8ee1ed98-0bdc-44d4-850a-d27c0f9bbaeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:01.477936 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef921f0d-8360-4892-81fe-ce4a773ca360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:01.478985 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef921f0d-8360-4892-81fe-ce4a773ca360 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:01.479471 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef921f0d-8360-4892-81fe-ce4a773ca360 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:01.479874 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef921f0d-8360-4892-81fe-ce4a773ca360 admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:01.481255 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef921f0d-8360-4892-81fe-ce4a773ca360 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:01.486414 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef921f0d-8360-4892-81fe-ce4a773ca360 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:01.517673 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 867/1711] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:32:01 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:32:01.520275 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef921f0d-8360-4892-81fe-ce4a773ca360 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:01.547744 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef921f0d-8360-4892-81fe-ce4a773ca360 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:01.561008 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70acb850-c758-4fd7-9e78-331864ece37e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:01.562227 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70acb850-c758-4fd7-9e78-331864ece37e admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:01.563534 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70acb850-c758-4fd7-9e78-331864ece37e admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:01.563825 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70acb850-c758-4fd7-9e78-331864ece37e admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:01.564488 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70acb850-c758-4fd7-9e78-331864ece37e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:01.570182 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70acb850-c758-4fd7-9e78-331864ece37e admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:01.598832 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 868/1712] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:32:01 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:32:01.603131 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70acb850-c758-4fd7-9e78-331864ece37e admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:01.621168 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70acb850-c758-4fd7-9e78-331864ece37e admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:01.641358 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4c5369-df2c-43e2-8956-6fbf04484042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:01.642624 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4c5369-df2c-43e2-8956-6fbf04484042 admin admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:01.643721 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4c5369-df2c-43e2-8956-6fbf04484042 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:01.644246 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4c5369-df2c-43e2-8956-6fbf04484042 admin admin] PATH_INFO: `/v3/projects/03f0739227664ee0b6c91fd867b1cc4c/users/c6d1535a7e0847ccbbbde1df20a4a334/roles/b38e84bf077846ee802e6bb1bad83522` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:01.677605 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4c5369-df2c-43e2-8956-6fbf04484042 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03f0739227664ee0b6c91fd867b1cc4c, user_id=c6d1535a7e0847ccbbbde1df20a4a334, role_id=b38e84bf077846ee802e6bb1bad83522)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:01.681167 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4c5369-df2c-43e2-8956-6fbf04484042 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:01.704223 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 869/1713] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 16:32:01 2022] PUT /identity/v3/projects/03f0739227664ee0b6c91fd867b1cc4c/users/c6d1535a7e0847ccbbbde1df20a4a334/roles/b38e84bf077846ee802e6bb1bad83522 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:32:01.714794 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de68d7a6-ee06-4229-92c9-299cb58196f4 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:01.715000 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee1ed98-0bdc-44d4-850a-d27c0f9bbaeb admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:01.715535 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de68d7a6-ee06-4229-92c9-299cb58196f4 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:01.716137 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de68d7a6-ee06-4229-92c9-299cb58196f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:01.803116 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-de68d7a6-ee06-4229-92c9-299cb58196f4 None None] MFA Rules not processed for user `c6d1535a7e0847ccbbbde1df20a4a334`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:32:01.804060 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-de68d7a6-ee06-4229-92c9-299cb58196f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:01.866988 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2232f86-7491-47e8-807b-196fb5f2429f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f44bfdd5214e8d84a2c0a5b1fd9b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:01.869948 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2232f86-7491-47e8-807b-196fb5f2429f service neutron] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:01.870651 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2232f86-7491-47e8-807b-196fb5f2429f service neutron] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:01.873598 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2232f86-7491-47e8-807b-196fb5f2429f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:01.939374 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:32:02.118894 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 870/1714] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:32:01 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 404 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:32:02.121163 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de68d7a6-ee06-4229-92c9-299cb58196f4 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:02.131776 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-de68d7a6-ee06-4229-92c9-299cb58196f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:02.192890 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2232f86-7491-47e8-807b-196fb5f2429f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:02.200883 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2232f86-7491-47e8-807b-196fb5f2429f service neutron] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:02.256113 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 845/1715] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:32:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 789 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 16:32:02.259764 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2232f86-7491-47e8-807b-196fb5f2429f service neutron] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:02.311474 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2232f86-7491-47e8-807b-196fb5f2429f service neutron] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:02.316878 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:32:02.387724 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32fd423-04f7-42f6-94cd-b71edb224950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:02.388534 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32fd423-04f7-42f6-94cd-b71edb224950 admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:02.388911 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32fd423-04f7-42f6-94cd-b71edb224950 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:02.389922 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32fd423-04f7-42f6-94cd-b71edb224950 admin admin] PATH_INFO: `/v3/projects` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:02.390755 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32fd423-04f7-42f6-94cd-b71edb224950 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:02.393669 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32fd423-04f7-42f6-94cd-b71edb224950 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:02.430254 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de68d7a6-ee06-4229-92c9-299cb58196f4 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:02.466361 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bca6f0d-eb51-4115-bdc2-dc4f859939fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:02.480274 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bca6f0d-eb51-4115-bdc2-dc4f859939fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:02.480668 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bca6f0d-eb51-4115-bdc2-dc4f859939fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:02.481156 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 846/1716] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 16:32:02 2022] POST /identity/v3/projects => generated 363 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:32:02.482162 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bca6f0d-eb51-4115-bdc2-dc4f859939fe admin admin] PATH_INFO: `/v3/projects/6c8e66dbbce549b8b872fd5add915f62` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:02.482564 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32fd423-04f7-42f6-94cd-b71edb224950 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:02.491658 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bca6f0d-eb51-4115-bdc2-dc4f859939fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c8e66dbbce549b8b872fd5add915f62)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:02.495106 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bca6f0d-eb51-4115-bdc2-dc4f859939fe admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:02.619141 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-0bca6f0d-eb51-4115-bdc2-dc4f859939fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c8e66dbbce549b8b872fd5add915f62', 'request_id': 'req-0bca6f0d-eb51-4115-bdc2-dc4f859939fe'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:02.659521 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-0bca6f0d-eb51-4115-bdc2-dc4f859939fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c8e66dbbce549b8b872fd5add915f62', 'request_id': 'req-0bca6f0d-eb51-4115-bdc2-dc4f859939fe'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:02.681204 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32fd423-04f7-42f6-94cd-b71edb224950 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:02.689199 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-0bca6f0d-eb51-4115-bdc2-dc4f859939fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c8e66dbbce549b8b872fd5add915f62', 'request_id': 'req-0bca6f0d-eb51-4115-bdc2-dc4f859939fe'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:02.709508 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-0bca6f0d-eb51-4115-bdc2-dc4f859939fe admin admin] The token cache is being invalidate because project 6c8e66dbbce549b8b872fd5add915f62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81446) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 16:32:02.709809 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-0bca6f0d-eb51-4115-bdc2-dc4f859939fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:02.714504 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-0bca6f0d-eb51-4115-bdc2-dc4f859939fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:02.721109 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 871/1717] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 16:32:02 2022] DELETE /identity/v3/projects/6c8e66dbbce549b8b872fd5add915f62 => generated 0 bytes in 598 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:32:02.721109 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bca6f0d-eb51-4115-bdc2-dc4f859939fe admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:02.725274 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-0bca6f0d-eb51-4115-bdc2-dc4f859939fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:02.812766 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d3661a-ef02-49df-becc-f6e442746e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:02.813539 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d3661a-ef02-49df-becc-f6e442746e24 admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:02.813920 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d3661a-ef02-49df-becc-f6e442746e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:02.814414 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d3661a-ef02-49df-becc-f6e442746e24 admin admin] PATH_INFO: `/v3/users` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:02.815426 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d3661a-ef02-49df-becc-f6e442746e24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:02.819672 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d3661a-ef02-49df-becc-f6e442746e24 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:02.859721 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bca6f0d-eb51-4115-bdc2-dc4f859939fe admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:02.865589 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 847/1718] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 16:32:02 2022] POST /identity/v3/users => generated 288 bytes in 384 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:32:02.867821 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8260732d-847b-4011-9a7c-013cedb181b4 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:02.868818 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8260732d-847b-4011-9a7c-013cedb181b4 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:02.869302 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8260732d-847b-4011-9a7c-013cedb181b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:02.881643 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c735a6-62af-4d4e-be58-bb07dd0b3ac5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d73df92393c43b2b5ccc32a2d43d952', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:02.882465 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c735a6-62af-4d4e-be58-bb07dd0b3ac5 service placement] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:02.883346 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c735a6-62af-4d4e-be58-bb07dd0b3ac5 service placement] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:02.883632 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c735a6-62af-4d4e-be58-bb07dd0b3ac5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:02.885818 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-71c735a6-62af-4d4e-be58-bb07dd0b3ac5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:02.900513 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c735a6-62af-4d4e-be58-bb07dd0b3ac5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:02.902927 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c735a6-62af-4d4e-be58-bb07dd0b3ac5 service placement] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:02.917035 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 872/1719] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:32:02 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:32:02.918188 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3466a5fe-bc49-4806-8a63-04ce2def6992 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:02.918543 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3466a5fe-bc49-4806-8a63-04ce2def6992 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:02.918818 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3466a5fe-bc49-4806-8a63-04ce2def6992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:02.939023 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-8260732d-847b-4011-9a7c-013cedb181b4 None None] MFA Rules not processed for user `c85e41cec8cc45608a3f7415884e750c`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:32:02.943200 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-8260732d-847b-4011-9a7c-013cedb181b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:02.964256 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-3466a5fe-bc49-4806-8a63-04ce2def6992 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:32:02.972964 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-3466a5fe-bc49-4806-8a63-04ce2def6992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:02.973291 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:32:02.992206 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 873/1720] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:32:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:32:02.993282 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3466a5fe-bc49-4806-8a63-04ce2def6992 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:02.995345 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-3466a5fe-bc49-4806-8a63-04ce2def6992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:03.056524 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3466a5fe-bc49-4806-8a63-04ce2def6992 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:03.068566 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cabefa-250a-42f1-a6d1-06dec6ae9e7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:03.072600 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cabefa-250a-42f1-a6d1-06dec6ae9e7e admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:03.073068 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cabefa-250a-42f1-a6d1-06dec6ae9e7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:03.073490 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cabefa-250a-42f1-a6d1-06dec6ae9e7e admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:03.075089 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cabefa-250a-42f1-a6d1-06dec6ae9e7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:03.079998 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cabefa-250a-42f1-a6d1-06dec6ae9e7e admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:03.098338 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 874/1721] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:32:02 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:32:03.104273 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba61698-19fe-4baa-91d1-cce2e8c57411 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:03.106277 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba61698-19fe-4baa-91d1-cce2e8c57411 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:03.107002 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba61698-19fe-4baa-91d1-cce2e8c57411 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:03.150947 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 848/1722] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:32:02 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:32:03.152192 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8260732d-847b-4011-9a7c-013cedb181b4 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:03.156210 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-8ba61698-19fe-4baa-91d1-cce2e8c57411 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:32:03.160899 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-8ba61698-19fe-4baa-91d1-cce2e8c57411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:03.183364 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8260732d-847b-4011-9a7c-013cedb181b4 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:03.195011 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 875/1723] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:32:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:32:03.199589 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38cc01d-c313-45b4-aa17-4f931a5ec096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:03.200579 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15f2642-47e1-4062-884b-01a7ce783097 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:03.200579 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15f2642-47e1-4062-884b-01a7ce783097 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:03.204425 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38cc01d-c313-45b4-aa17-4f931a5ec096 admin admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:03.204425 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38cc01d-c313-45b4-aa17-4f931a5ec096 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:03.204425 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38cc01d-c313-45b4-aa17-4f931a5ec096 admin admin] PATH_INFO: `/v3/projects/f39a52ac47b44d4a8ea8f198c16ae2d7/users/ce5f33aa7add400e85187b53c4918c02/roles/0a36d1be416f4089be19be979943b731` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:03.204791 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15f2642-47e1-4062-884b-01a7ce783097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:03.258961 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38cc01d-c313-45b4-aa17-4f931a5ec096 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f39a52ac47b44d4a8ea8f198c16ae2d7, user_id=ce5f33aa7add400e85187b53c4918c02, role_id=0a36d1be416f4089be19be979943b731)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:03.262207 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38cc01d-c313-45b4-aa17-4f931a5ec096 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:03.275014 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-c15f2642-47e1-4062-884b-01a7ce783097 None None] MFA Rules not processed for user `c85e41cec8cc45608a3f7415884e750c`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:32:03.283766 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-c15f2642-47e1-4062-884b-01a7ce783097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:03.308796 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 849/1724] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 16:32:03 2022] PUT /identity/v3/projects/f39a52ac47b44d4a8ea8f198c16ae2d7/users/ce5f33aa7add400e85187b53c4918c02/roles/0a36d1be416f4089be19be979943b731 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:32:03.310041 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38cc01d-c313-45b4-aa17-4f931a5ec096 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:03.328727 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 876/1725] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:32:03 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:32:03.328727 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15f2642-47e1-4062-884b-01a7ce783097 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:03.334570 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-c15f2642-47e1-4062-884b-01a7ce783097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:03.386347 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15f2642-47e1-4062-884b-01a7ce783097 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:03.437589 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:32:03.548692 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38cc01d-c313-45b4-aa17-4f931a5ec096 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:03.549926 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e2e110-16f7-46a3-ba38-f8ec4550eb79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:03.550636 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e2e110-16f7-46a3-ba38-f8ec4550eb79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:03.550915 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e2e110-16f7-46a3-ba38-f8ec4550eb79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:03.551376 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e2e110-16f7-46a3-ba38-f8ec4550eb79 admin admin] PATH_INFO: `/v3/projects/65e3cfdfbbe1436e86b4cc522b7a1519` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:03.553119 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e2e110-16f7-46a3-ba38-f8ec4550eb79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=65e3cfdfbbe1436e86b4cc522b7a1519)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:03.555065 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e2e110-16f7-46a3-ba38-f8ec4550eb79 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:03.561873 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8c3544-8a13-406a-92a5-6d1016c8feed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:03.563287 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8c3544-8a13-406a-92a5-6d1016c8feed admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:03.563581 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8c3544-8a13-406a-92a5-6d1016c8feed admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:03.563864 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8c3544-8a13-406a-92a5-6d1016c8feed admin admin] PATH_INFO: `/v3/domains` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:03.565419 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8c3544-8a13-406a-92a5-6d1016c8feed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:32:03.565736 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8c3544-8a13-406a-92a5-6d1016c8feed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:03.567454 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8c3544-8a13-406a-92a5-6d1016c8feed admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:03.594252 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 850/1726] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Sep 9 16:32:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:32:03.595325 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8c3544-8a13-406a-92a5-6d1016c8feed admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:03.622013 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8c3544-8a13-406a-92a5-6d1016c8feed admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:03.635756 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3062b2-e29a-4560-bf29-d4eb720f42a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:03.636378 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3062b2-e29a-4560-bf29-d4eb720f42a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:03.636704 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3062b2-e29a-4560-bf29-d4eb720f42a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:03.644553 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3062b2-e29a-4560-bf29-d4eb720f42a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:03.656199 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3062b2-e29a-4560-bf29-d4eb720f42a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:03.659325 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3062b2-e29a-4560-bf29-d4eb720f42a9 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:03.663654 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-17e2e110-16f7-46a3-ba38-f8ec4550eb79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65e3cfdfbbe1436e86b4cc522b7a1519', 'request_id': 'req-17e2e110-16f7-46a3-ba38-f8ec4550eb79'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:03.685613 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-17e2e110-16f7-46a3-ba38-f8ec4550eb79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65e3cfdfbbe1436e86b4cc522b7a1519', 'request_id': 'req-17e2e110-16f7-46a3-ba38-f8ec4550eb79'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:03.718078 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 851/1727] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:32:03 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:32:03.723300 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3062b2-e29a-4560-bf29-d4eb720f42a9 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:03.724020 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-17e2e110-16f7-46a3-ba38-f8ec4550eb79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65e3cfdfbbe1436e86b4cc522b7a1519', 'request_id': 'req-17e2e110-16f7-46a3-ba38-f8ec4550eb79'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:03.735043 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-de3062b2-e29a-4560-bf29-d4eb720f42a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:03.756297 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-17e2e110-16f7-46a3-ba38-f8ec4550eb79 admin admin] The token cache is being invalidate because project 65e3cfdfbbe1436e86b4cc522b7a1519 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81446) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 16:32:03.756601 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-17e2e110-16f7-46a3-ba38-f8ec4550eb79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:03.761551 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-17e2e110-16f7-46a3-ba38-f8ec4550eb79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:03.763320 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 877/1728] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 16:32:03 2022] DELETE /identity/v3/projects/65e3cfdfbbe1436e86b4cc522b7a1519 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:32:03.767367 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e2e110-16f7-46a3-ba38-f8ec4550eb79 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:03.767367 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-17e2e110-16f7-46a3-ba38-f8ec4550eb79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:03.946869 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e2e110-16f7-46a3-ba38-f8ec4550eb79 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:03.953791 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899f8d17-a128-44b3-b4cc-bcf4432d3178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:03.954618 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899f8d17-a128-44b3-b4cc-bcf4432d3178 admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:03.954995 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899f8d17-a128-44b3-b4cc-bcf4432d3178 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:03.955176 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899f8d17-a128-44b3-b4cc-bcf4432d3178 admin admin] PATH_INFO: `/v3/projects` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:03.955980 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899f8d17-a128-44b3-b4cc-bcf4432d3178 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:03.958232 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899f8d17-a128-44b3-b4cc-bcf4432d3178 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:04.018686 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 878/1729] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 16:32:03 2022] POST /identity/v3/projects => generated 373 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:32:04.019655 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899f8d17-a128-44b3-b4cc-bcf4432d3178 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:04.021536 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-899f8d17-a128-44b3-b4cc-bcf4432d3178 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:04.045909 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3062b2-e29a-4560-bf29-d4eb720f42a9 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:04.058933 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:32:04.131076 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:32:04.195198 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899f8d17-a128-44b3-b4cc-bcf4432d3178 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:04.203745 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c936e72-3f20-4e9c-8fec-91debf29439d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a332b9b4980646a3b14633293f77b505', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:04.204884 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c936e72-3f20-4e9c-8fec-91debf29439d service nova] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:04.205318 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c936e72-3f20-4e9c-8fec-91debf29439d service nova] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:04.205901 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c936e72-3f20-4e9c-8fec-91debf29439d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:04.208206 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-3c936e72-3f20-4e9c-8fec-91debf29439d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:04.211176 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79231c69-2fb5-431c-99c0-74cc42277fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:04.211860 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79231c69-2fb5-431c-99c0-74cc42277fa3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:04.212137 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79231c69-2fb5-431c-99c0-74cc42277fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:04.212418 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79231c69-2fb5-431c-99c0-74cc42277fa3 admin admin] PATH_INFO: `/v3/projects/f39a52ac47b44d4a8ea8f198c16ae2d7/users/ce5f33aa7add400e85187b53c4918c02/roles/0a36d1be416f4089be19be979943b731` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:04.215868 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79231c69-2fb5-431c-99c0-74cc42277fa3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f39a52ac47b44d4a8ea8f198c16ae2d7, user_id=ce5f33aa7add400e85187b53c4918c02, role_id=0a36d1be416f4089be19be979943b731)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:04.222722 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79231c69-2fb5-431c-99c0-74cc42277fa3 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:04.265684 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 879/1730] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 16:32:04 2022] PUT /identity/v3/projects/f39a52ac47b44d4a8ea8f198c16ae2d7/users/ce5f33aa7add400e85187b53c4918c02/roles/0a36d1be416f4089be19be979943b731 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:32:04.268343 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a803497-c958-417d-a297-5afae79024fb None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:04.268634 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a803497-c958-417d-a297-5afae79024fb None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:04.268936 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a803497-c958-417d-a297-5afae79024fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:04.308708 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-9a803497-c958-417d-a297-5afae79024fb None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:32:04.310161 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-9a803497-c958-417d-a297-5afae79024fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:04.336428 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c936e72-3f20-4e9c-8fec-91debf29439d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:04.338162 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c936e72-3f20-4e9c-8fec-91debf29439d service nova] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:04.373503 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 852/1731] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:32:03 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 656 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:32:04.376193 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c936e72-3f20-4e9c-8fec-91debf29439d service nova] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:04.411316 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c936e72-3f20-4e9c-8fec-91debf29439d service nova] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:04.501137 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 880/1732] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:32:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:32:04.502535 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b5e446-d469-4c0e-a080-4fa42c34dd09 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:04.502821 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b5e446-d469-4c0e-a080-4fa42c34dd09 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:04.503131 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b5e446-d469-4c0e-a080-4fa42c34dd09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:04.577770 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-f8b5e446-d469-4c0e-a080-4fa42c34dd09 None None] MFA Rules not processed for user `ce5f33aa7add400e85187b53c4918c02`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:32:04.587136 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-f8b5e446-d469-4c0e-a080-4fa42c34dd09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:04.746636 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd20323-deb5-412d-a626-0c8a7a44d906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:04.747455 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd20323-deb5-412d-a626-0c8a7a44d906 admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:04.749520 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd20323-deb5-412d-a626-0c8a7a44d906 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:04.749913 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd20323-deb5-412d-a626-0c8a7a44d906 admin admin] PATH_INFO: `/v3/users` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:04.750703 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd20323-deb5-412d-a626-0c8a7a44d906 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:04.756795 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd20323-deb5-412d-a626-0c8a7a44d906 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:04.821261 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 881/1733] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:32:04 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:32:04.822805 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33359b9d-f30b-4512-93ad-988c1f37cbc7 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:04.823162 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33359b9d-f30b-4512-93ad-988c1f37cbc7 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:04.823393 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33359b9d-f30b-4512-93ad-988c1f37cbc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:04.837760 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 853/1734] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 16:32:04 2022] POST /identity/v3/users => generated 287 bytes in 462 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:32:04.838915 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd20323-deb5-412d-a626-0c8a7a44d906 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:04.844193 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-fbd20323-deb5-412d-a626-0c8a7a44d906 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:04.874119 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-33359b9d-f30b-4512-93ad-988c1f37cbc7 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:32:04.879883 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-33359b9d-f30b-4512-93ad-988c1f37cbc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:04.890381 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 882/1735] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:32:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:32:04.891359 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33359b9d-f30b-4512-93ad-988c1f37cbc7 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:04.902178 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33359b9d-f30b-4512-93ad-988c1f37cbc7 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:04.907775 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d61271-2b0a-41ac-a1bb-dbcdd4b84d5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:04.908401 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d61271-2b0a-41ac-a1bb-dbcdd4b84d5d admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:04.908674 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d61271-2b0a-41ac-a1bb-dbcdd4b84d5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:04.908948 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d61271-2b0a-41ac-a1bb-dbcdd4b84d5d admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:04.909595 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d61271-2b0a-41ac-a1bb-dbcdd4b84d5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:04.911625 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d61271-2b0a-41ac-a1bb-dbcdd4b84d5d admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:04.924742 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 883/1736] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:32:04 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:32:04.925686 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d61271-2b0a-41ac-a1bb-dbcdd4b84d5d admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:04.989318 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d61271-2b0a-41ac-a1bb-dbcdd4b84d5d admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:05.010456 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b17ad3-470f-4ed9-8862-559368dafee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:05.011097 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b17ad3-470f-4ed9-8862-559368dafee9 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:05.011363 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b17ad3-470f-4ed9-8862-559368dafee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:05.013996 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b17ad3-470f-4ed9-8862-559368dafee9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:05.014842 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b17ad3-470f-4ed9-8862-559368dafee9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:32:05.015152 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b17ad3-470f-4ed9-8862-559368dafee9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:05.016801 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b17ad3-470f-4ed9-8862-559368dafee9 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:05.038717 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:32:05.086603 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 884/1737] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Sep 9 16:32:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:32:05.086603 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b17ad3-470f-4ed9-8862-559368dafee9 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:05.140970 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd20323-deb5-412d-a626-0c8a7a44d906 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:05.147240 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b17ad3-470f-4ed9-8862-559368dafee9 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:05.159418 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bdf6fa-1667-4dc4-b162-edc0389ece04 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8078e791ba68460f8b3aeafb4b79b73a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:05.162291 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bdf6fa-1667-4dc4-b162-edc0389ece04 service cinder] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:05.162594 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bdf6fa-1667-4dc4-b162-edc0389ece04 service cinder] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:05.162864 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bdf6fa-1667-4dc4-b162-edc0389ece04 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:05.167995 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfddf56e-275a-4894-8be6-4a7ba936c964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:05.168468 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfddf56e-275a-4894-8be6-4a7ba936c964 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:05.168740 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfddf56e-275a-4894-8be6-4a7ba936c964 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:05.169007 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfddf56e-275a-4894-8be6-4a7ba936c964 admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:05.169648 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfddf56e-275a-4894-8be6-4a7ba936c964 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:05.176194 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfddf56e-275a-4894-8be6-4a7ba936c964 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:05.197773 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bdf6fa-1667-4dc4-b162-edc0389ece04 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:05.199637 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bdf6fa-1667-4dc4-b162-edc0389ece04 service cinder] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:05.218446 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 885/1738] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:32:05 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:32:05.223137 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545f4186-f10f-411e-a508-b4b0394ca03c None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:05.223447 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545f4186-f10f-411e-a508-b4b0394ca03c None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:05.223778 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545f4186-f10f-411e-a508-b4b0394ca03c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:05.247298 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 854/1739] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:32:04 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:32:05.250263 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bdf6fa-1667-4dc4-b162-edc0389ece04 service cinder] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:05.272485 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bdf6fa-1667-4dc4-b162-edc0389ece04 service cinder] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:05.299555 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a5a062-d928-4dab-900e-22c4f2643cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:05.300173 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a5a062-d928-4dab-900e-22c4f2643cf1 admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:05.300449 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a5a062-d928-4dab-900e-22c4f2643cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:05.300736 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a5a062-d928-4dab-900e-22c4f2643cf1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:05.301492 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a5a062-d928-4dab-900e-22c4f2643cf1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:05.311371 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a5a062-d928-4dab-900e-22c4f2643cf1 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:05.321958 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-545f4186-f10f-411e-a508-b4b0394ca03c None None] MFA Rules not processed for user `8c3919b9f57e4604b89d3f6a2763b0b4`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:32:05.323376 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-545f4186-f10f-411e-a508-b4b0394ca03c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:05.338664 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:32:05.430742 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 855/1740] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 16:32:05 2022] POST /identity/v3/projects => generated 373 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:32:05.431721 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a5a062-d928-4dab-900e-22c4f2643cf1 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:05.435310 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-b2a5a062-d928-4dab-900e-22c4f2643cf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:05.523933 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a5a062-d928-4dab-900e-22c4f2643cf1 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:05.528699 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90b1f00-7a72-40ec-84ce-a9590d6d05bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8078e791ba68460f8b3aeafb4b79b73a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:05.529368 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90b1f00-7a72-40ec-84ce-a9590d6d05bb service cinder] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:05.533227 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90b1f00-7a72-40ec-84ce-a9590d6d05bb service cinder] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:05.533627 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90b1f00-7a72-40ec-84ce-a9590d6d05bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:05.535866 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-d90b1f00-7a72-40ec-84ce-a9590d6d05bb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:05.559335 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 886/1741] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:32:05 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:32:05.560888 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545f4186-f10f-411e-a508-b4b0394ca03c None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:05.591505 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545f4186-f10f-411e-a508-b4b0394ca03c None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:05.621197 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90b1f00-7a72-40ec-84ce-a9590d6d05bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:05.625522 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90b1f00-7a72-40ec-84ce-a9590d6d05bb service cinder] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:05.638102 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 856/1742] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:32:05 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:32:05.640773 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90b1f00-7a72-40ec-84ce-a9590d6d05bb service cinder] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:05.725578 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90b1f00-7a72-40ec-84ce-a9590d6d05bb service cinder] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:05.737626 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dfd121-b1f1-4acb-81e4-54bcb4097a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:05.739276 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dfd121-b1f1-4acb-81e4-54bcb4097a1a admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:05.739664 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dfd121-b1f1-4acb-81e4-54bcb4097a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:05.740664 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dfd121-b1f1-4acb-81e4-54bcb4097a1a admin admin] PATH_INFO: `/v3/users` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:05.741545 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dfd121-b1f1-4acb-81e4-54bcb4097a1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:05.745633 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dfd121-b1f1-4acb-81e4-54bcb4097a1a admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:05.748486 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce586663-dd06-46a7-8517-92e0c6d8e9a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:05.751158 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce586663-dd06-46a7-8517-92e0c6d8e9a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:05.751520 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce586663-dd06-46a7-8517-92e0c6d8e9a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:05.752338 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce586663-dd06-46a7-8517-92e0c6d8e9a5 admin admin] PATH_INFO: `/v3/projects/7127f3eee794408da348af6775ef5c9f/users/9181f67552d841abbb4ab9b2c3c36971/roles/b38e84bf077846ee802e6bb1bad83522` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:05.787139 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce586663-dd06-46a7-8517-92e0c6d8e9a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7127f3eee794408da348af6775ef5c9f, user_id=9181f67552d841abbb4ab9b2c3c36971, role_id=b38e84bf077846ee802e6bb1bad83522)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:05.790334 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:32:05.802191 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 857/1743] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 16:32:05 2022] POST /identity/v3/users => generated 287 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:32:05.803396 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dfd121-b1f1-4acb-81e4-54bcb4097a1a admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:05.803727 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce586663-dd06-46a7-8517-92e0c6d8e9a5 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:05.829037 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 887/1744] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 16:32:05 2022] PUT /identity/v3/projects/7127f3eee794408da348af6775ef5c9f/users/9181f67552d841abbb4ab9b2c3c36971/roles/b38e84bf077846ee802e6bb1bad83522 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:32:05.829894 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce586663-dd06-46a7-8517-92e0c6d8e9a5 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:05.831604 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dfd121-b1f1-4acb-81e4-54bcb4097a1a admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:05.844337 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-ce586663-dd06-46a7-8517-92e0c6d8e9a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:05.967503 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0a2fde-3f41-4b44-abbe-91922b7081c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8078e791ba68460f8b3aeafb4b79b73a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:05.968145 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0a2fde-3f41-4b44-abbe-91922b7081c8 service cinder] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:05.968408 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0a2fde-3f41-4b44-abbe-91922b7081c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:05.968676 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0a2fde-3f41-4b44-abbe-91922b7081c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:05.976371 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-9b0a2fde-3f41-4b44-abbe-91922b7081c8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:06.157272 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce586663-dd06-46a7-8517-92e0c6d8e9a5 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:06.163289 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0a2fde-3f41-4b44-abbe-91922b7081c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:06.164774 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0a2fde-3f41-4b44-abbe-91922b7081c8 service cinder] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:06.179948 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703e2025-5b5a-4403-acdb-f2dbca54f973 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a332b9b4980646a3b14633293f77b505', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:06.180656 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703e2025-5b5a-4403-acdb-f2dbca54f973 service nova] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:06.180936 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703e2025-5b5a-4403-acdb-f2dbca54f973 service nova] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:06.181236 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703e2025-5b5a-4403-acdb-f2dbca54f973 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:06.201767 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 858/1745] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:32:05 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:32:06.202677 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0a2fde-3f41-4b44-abbe-91922b7081c8 service cinder] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:06.267630 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:32:06.360732 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703e2025-5b5a-4403-acdb-f2dbca54f973 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:06.364457 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703e2025-5b5a-4403-acdb-f2dbca54f973 service nova] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:06.393738 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 888/1746] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:32:05 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 564 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:32:06.398629 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa62f9ac-4cc5-44c1-b30b-bbea0cb93f5b None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:06.399103 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa62f9ac-4cc5-44c1-b30b-bbea0cb93f5b None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:06.399478 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa62f9ac-4cc5-44c1-b30b-bbea0cb93f5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:06.413377 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0a2fde-3f41-4b44-abbe-91922b7081c8 service cinder] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:06.426927 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e84f10-e5f6-4ff5-8867-ae756bd0651f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:06.427468 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e84f10-e5f6-4ff5-8867-ae756bd0651f admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:06.444221 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e84f10-e5f6-4ff5-8867-ae756bd0651f admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:06.444659 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e84f10-e5f6-4ff5-8867-ae756bd0651f admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:06.445372 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e84f10-e5f6-4ff5-8867-ae756bd0651f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:06.451909 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e84f10-e5f6-4ff5-8867-ae756bd0651f admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:06.492766 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 859/1747] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:32:06 2022] GET /identity/v3/roles => generated 1420 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:32:06.495067 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e84f10-e5f6-4ff5-8867-ae756bd0651f admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:06.532567 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e84f10-e5f6-4ff5-8867-ae756bd0651f admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:06.538286 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-aa62f9ac-4cc5-44c1-b30b-bbea0cb93f5b None None] MFA Rules not processed for user `9181f67552d841abbb4ab9b2c3c36971`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:32:06.542738 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-aa62f9ac-4cc5-44c1-b30b-bbea0cb93f5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:06.567132 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dcef51-46df-4cf0-b110-8fd925183ee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:06.568007 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dcef51-46df-4cf0-b110-8fd925183ee2 admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:06.568499 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dcef51-46df-4cf0-b110-8fd925183ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:06.568917 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dcef51-46df-4cf0-b110-8fd925183ee2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:06.569707 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dcef51-46df-4cf0-b110-8fd925183ee2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:06.577231 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dcef51-46df-4cf0-b110-8fd925183ee2 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:06.648965 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 860/1748] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:32:06 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:32:06.662528 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8539a8b-de5f-4e81-bca7-40f5efcfd23d None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:06.663208 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8539a8b-de5f-4e81-bca7-40f5efcfd23d None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:06.663494 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8539a8b-de5f-4e81-bca7-40f5efcfd23d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:06.734506 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-f8539a8b-de5f-4e81-bca7-40f5efcfd23d None None] MFA Rules not processed for user `c85e41cec8cc45608a3f7415884e750c`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:32:06.737291 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-f8539a8b-de5f-4e81-bca7-40f5efcfd23d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:06.752400 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 889/1749] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:32:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 357 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:32:06.753927 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa62f9ac-4cc5-44c1-b30b-bbea0cb93f5b None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:06.784822 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa62f9ac-4cc5-44c1-b30b-bbea0cb93f5b None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:06.796957 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a0fef0-9b43-49f5-9af3-f3b90cbc5378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:06.801319 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a0fef0-9b43-49f5-9af3-f3b90cbc5378 admin admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:06.801756 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a0fef0-9b43-49f5-9af3-f3b90cbc5378 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:06.802334 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a0fef0-9b43-49f5-9af3-f3b90cbc5378 admin admin] PATH_INFO: `/v3/projects/2cf9674599f74a14bbda1e75d5bcb77e/users/d73862fa25564450a5841678df6555cc/roles/b38e84bf077846ee802e6bb1bad83522` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:06.837305 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:32:06.849994 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a0fef0-9b43-49f5-9af3-f3b90cbc5378 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cf9674599f74a14bbda1e75d5bcb77e, user_id=d73862fa25564450a5841678df6555cc, role_id=b38e84bf077846ee802e6bb1bad83522)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:06.859539 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a0fef0-9b43-49f5-9af3-f3b90cbc5378 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:06.900601 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 861/1750] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:32:06 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:32:06.901839 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8539a8b-de5f-4e81-bca7-40f5efcfd23d None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:06.907665 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 890/1751] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 16:32:06 2022] PUT /identity/v3/projects/2cf9674599f74a14bbda1e75d5bcb77e/users/d73862fa25564450a5841678df6555cc/roles/b38e84bf077846ee802e6bb1bad83522 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:32:06.920252 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19243fd9-e8c3-4cc7-be0f-1bc0fe034bf7 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:06.920854 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19243fd9-e8c3-4cc7-be0f-1bc0fe034bf7 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:06.921278 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19243fd9-e8c3-4cc7-be0f-1bc0fe034bf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:06.944317 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8539a8b-de5f-4e81-bca7-40f5efcfd23d None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:07.018230 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-19243fd9-e8c3-4cc7-be0f-1bc0fe034bf7 None None] MFA Rules not processed for user `d73862fa25564450a5841678df6555cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:32:07.027434 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-19243fd9-e8c3-4cc7-be0f-1bc0fe034bf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:07.193880 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edce2e78-799d-41b2-8232-466cfac53ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:07.194391 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edce2e78-799d-41b2-8232-466cfac53ae8 admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:07.194776 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edce2e78-799d-41b2-8232-466cfac53ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:07.195109 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edce2e78-799d-41b2-8232-466cfac53ae8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:07.197129 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edce2e78-799d-41b2-8232-466cfac53ae8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:07.201483 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edce2e78-799d-41b2-8232-466cfac53ae8 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:07.280298 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 891/1752] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:32:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 361 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:32:07.283812 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19243fd9-e8c3-4cc7-be0f-1bc0fe034bf7 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:07.296180 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 862/1753] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 16:32:06 2022] POST /identity/v3/projects => generated 371 bytes in 392 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:32:07.298007 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edce2e78-799d-41b2-8232-466cfac53ae8 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:07.308128 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19243fd9-e8c3-4cc7-be0f-1bc0fe034bf7 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:07.373431 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:32:07.490658 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34040cc2-9c7a-4500-9b7a-4866aaa883ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:07.491571 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34040cc2-9c7a-4500-9b7a-4866aaa883ad admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:07.492008 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34040cc2-9c7a-4500-9b7a-4866aaa883ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:07.492426 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34040cc2-9c7a-4500-9b7a-4866aaa883ad admin admin] PATH_INFO: `/v3/projects` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:07.493265 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34040cc2-9c7a-4500-9b7a-4866aaa883ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:07.495740 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34040cc2-9c7a-4500-9b7a-4866aaa883ad admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:07.541754 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edce2e78-799d-41b2-8232-466cfac53ae8 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:07.556084 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 892/1754] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 16:32:07 2022] POST /identity/v3/projects => generated 371 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:32:07.560775 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bee5f3-59d1-40ad-86c8-1ecbc03ed07a None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:07.561886 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45beacce-c26f-400d-8155-660471b7a606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:07.562923 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45beacce-c26f-400d-8155-660471b7a606 admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:07.562923 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45beacce-c26f-400d-8155-660471b7a606 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:07.563312 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bee5f3-59d1-40ad-86c8-1ecbc03ed07a None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:07.564030 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bee5f3-59d1-40ad-86c8-1ecbc03ed07a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:07.564635 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45beacce-c26f-400d-8155-660471b7a606 admin admin] PATH_INFO: `/v3/users` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:07.571672 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45beacce-c26f-400d-8155-660471b7a606 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:07.575107 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45beacce-c26f-400d-8155-660471b7a606 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:07.643906 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 863/1755] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 16:32:07 2022] POST /identity/v3/users => generated 292 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 16:32:07.645829 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45beacce-c26f-400d-8155-660471b7a606 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:07.661731 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-e0bee5f3-59d1-40ad-86c8-1ecbc03ed07a None None] MFA Rules not processed for user `7ea10dd1db74490687a8be5a6f5a6f8a`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:32:07.666920 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-e0bee5f3-59d1-40ad-86c8-1ecbc03ed07a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:07.695381 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45beacce-c26f-400d-8155-660471b7a606 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:07.983929 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ffb1eb-890c-4274-86a2-733232018d39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:07.984461 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ffb1eb-890c-4274-86a2-733232018d39 admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:07.984646 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ffb1eb-890c-4274-86a2-733232018d39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:07.984920 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ffb1eb-890c-4274-86a2-733232018d39 admin admin] PATH_INFO: `/v3/users` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:07.985557 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ffb1eb-890c-4274-86a2-733232018d39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:07.987518 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ffb1eb-890c-4274-86a2-733232018d39 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:07.999980 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 893/1756] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:32:07 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 443 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:32:08.001088 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bee5f3-59d1-40ad-86c8-1ecbc03ed07a None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:08.021477 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:32:08.031828 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bee5f3-59d1-40ad-86c8-1ecbc03ed07a None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:08.050216 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ef96c0-a24e-4d43-bfe9-2036d6fbbe3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:08.054432 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ef96c0-a24e-4d43-bfe9-2036d6fbbe3c admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:08.054787 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ef96c0-a24e-4d43-bfe9-2036d6fbbe3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:08.055070 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ef96c0-a24e-4d43-bfe9-2036d6fbbe3c admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:08.058669 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 864/1757] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 16:32:07 2022] POST /identity/v3/users => generated 292 bytes in 417 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:32:08.060396 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ef96c0-a24e-4d43-bfe9-2036d6fbbe3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:08.062671 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ef96c0-a24e-4d43-bfe9-2036d6fbbe3c admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:08.064147 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6e9af6-8ce9-43e9-a2e3-0b0c6d445b4f None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:08.064446 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6e9af6-8ce9-43e9-a2e3-0b0c6d445b4f None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:08.064711 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6e9af6-8ce9-43e9-a2e3-0b0c6d445b4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:08.125803 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 894/1758] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:32:08 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:32:08.130073 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ef96c0-a24e-4d43-bfe9-2036d6fbbe3c admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:08.142134 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-c2ef96c0-a24e-4d43-bfe9-2036d6fbbe3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:08.210516 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-fa6e9af6-8ce9-43e9-a2e3-0b0c6d445b4f None None] MFA Rules not processed for user `b9d05f3782d24127aa613c8d7ac8041b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:32:08.213988 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-fa6e9af6-8ce9-43e9-a2e3-0b0c6d445b4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:08.437123 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 865/1759] 10.222.0.27 () {58 vars in 1009 bytes} [Fri Sep 9 16:32:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 378 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:32:08.439277 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6e9af6-8ce9-43e9-a2e3-0b0c6d445b4f None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:08.458945 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6e9af6-8ce9-43e9-a2e3-0b0c6d445b4f None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:08.459840 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ef96c0-a24e-4d43-bfe9-2036d6fbbe3c admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:08.466834 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff371b69-7719-4c46-8248-5689380a88a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:08.468851 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff371b69-7719-4c46-8248-5689380a88a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:08.477049 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff371b69-7719-4c46-8248-5689380a88a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:08.477644 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff371b69-7719-4c46-8248-5689380a88a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:08.478467 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b0239f-5a19-43f6-9236-9c806c6fe65c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a332b9b4980646a3b14633293f77b505', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:08.479141 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b0239f-5a19-43f6-9236-9c806c6fe65c service nova] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:08.479427 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b0239f-5a19-43f6-9236-9c806c6fe65c service nova] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:08.479694 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b0239f-5a19-43f6-9236-9c806c6fe65c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:08.486085 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff371b69-7719-4c46-8248-5689380a88a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:08.488612 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff371b69-7719-4c46-8248-5689380a88a0 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:08.516255 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 866/1760] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:32:08 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:32:08.517648 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff371b69-7719-4c46-8248-5689380a88a0 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:08.534810 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff371b69-7719-4c46-8248-5689380a88a0 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:08.542214 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8a47b4-07ad-43fe-9661-e530da5de904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:08.542993 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8a47b4-07ad-43fe-9661-e530da5de904 admin admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:08.543267 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8a47b4-07ad-43fe-9661-e530da5de904 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:08.543533 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8a47b4-07ad-43fe-9661-e530da5de904 admin admin] PATH_INFO: `/v3/projects/9eb29ac2ae5e406fbedc2a1cb7f9ea72/users/3b9fabe829be4f9c8ad0e2dd11170bfc/roles/0a36d1be416f4089be19be979943b731` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:08.561591 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b0239f-5a19-43f6-9236-9c806c6fe65c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:08.571077 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b0239f-5a19-43f6-9236-9c806c6fe65c service nova] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:08.581984 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8a47b4-07ad-43fe-9661-e530da5de904 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9eb29ac2ae5e406fbedc2a1cb7f9ea72, user_id=3b9fabe829be4f9c8ad0e2dd11170bfc, role_id=0a36d1be416f4089be19be979943b731)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:08.600953 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8a47b4-07ad-43fe-9661-e530da5de904 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:08.605222 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 895/1761] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:32:08 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:32:08.606260 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b0239f-5a19-43f6-9236-9c806c6fe65c service nova] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:08.638027 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b0239f-5a19-43f6-9236-9c806c6fe65c service nova] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:08.663325 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:32:08.699189 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 867/1762] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 16:32:08 2022] PUT /identity/v3/projects/9eb29ac2ae5e406fbedc2a1cb7f9ea72/users/3b9fabe829be4f9c8ad0e2dd11170bfc/roles/0a36d1be416f4089be19be979943b731 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:32:08.700469 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8a47b4-07ad-43fe-9661-e530da5de904 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:08.873998 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab33658-ae37-4e10-83d2-23f34b29a54c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:08.875063 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab33658-ae37-4e10-83d2-23f34b29a54c admin admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:08.875496 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab33658-ae37-4e10-83d2-23f34b29a54c admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:08.878425 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab33658-ae37-4e10-83d2-23f34b29a54c admin admin] PATH_INFO: `/v3/projects/4d90b179256044cf8593b400807df2a2/users/737c38fb3eb54f268b82c280019daea3/roles/0a36d1be416f4089be19be979943b731` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:08.939576 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab33658-ae37-4e10-83d2-23f34b29a54c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d90b179256044cf8593b400807df2a2, user_id=737c38fb3eb54f268b82c280019daea3, role_id=0a36d1be416f4089be19be979943b731)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:08.948678 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab33658-ae37-4e10-83d2-23f34b29a54c admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:08.988956 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 896/1763] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 16:32:08 2022] PUT /identity/v3/projects/4d90b179256044cf8593b400807df2a2/users/737c38fb3eb54f268b82c280019daea3/roles/0a36d1be416f4089be19be979943b731 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:32:08.990067 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab33658-ae37-4e10-83d2-23f34b29a54c admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:08.999548 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-1ab33658-ae37-4e10-83d2-23f34b29a54c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:09.055614 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8a47b4-07ad-43fe-9661-e530da5de904 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:09.178442 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:32:09.289596 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a30d718-f62b-4b03-ac81-66ac3d618aed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:09.292965 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a30d718-f62b-4b03-ac81-66ac3d618aed admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:09.293371 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a30d718-f62b-4b03-ac81-66ac3d618aed admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:09.294531 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a30d718-f62b-4b03-ac81-66ac3d618aed admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:09.296376 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a30d718-f62b-4b03-ac81-66ac3d618aed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:09.304097 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a30d718-f62b-4b03-ac81-66ac3d618aed admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:09.335198 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 868/1764] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:32:08 2022] GET /identity/v3/roles => generated 1420 bytes in 635 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:32:09.336829 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a063cb-fbe2-416a-94bb-95c64ba74455 None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:09.337181 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a063cb-fbe2-416a-94bb-95c64ba74455 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:09.337760 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a063cb-fbe2-416a-94bb-95c64ba74455 None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:09.339328 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 869/1765] 10.222.0.27 () {54 vars in 912 bytes} [Fri Sep 9 16:32:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:32:09.341533 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a063cb-fbe2-416a-94bb-95c64ba74455 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:09.350798 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab33658-ae37-4e10-83d2-23f34b29a54c admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:09.371994 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a063cb-fbe2-416a-94bb-95c64ba74455 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:09.380435 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d533288c-f0d6-4947-bb6c-eee051207fcf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2350bbc4a194c2dab2e3be830fd0eba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:09.383540 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d533288c-f0d6-4947-bb6c-eee051207fcf service swift] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:09.384060 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a5b27b-87dc-4cd9-887f-5af30614cb59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:09.384769 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a5b27b-87dc-4cd9-887f-5af30614cb59 admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:09.385260 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d533288c-f0d6-4947-bb6c-eee051207fcf service swift] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:09.386400 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a5b27b-87dc-4cd9-887f-5af30614cb59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:09.386761 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a5b27b-87dc-4cd9-887f-5af30614cb59 admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:09.387104 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d533288c-f0d6-4947-bb6c-eee051207fcf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:09.387557 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a5b27b-87dc-4cd9-887f-5af30614cb59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:09.393729 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a5b27b-87dc-4cd9-887f-5af30614cb59 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:09.426750 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 870/1766] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:32:09 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:32:09.427433 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a5b27b-87dc-4cd9-887f-5af30614cb59 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:09.434892 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-b9a5b27b-87dc-4cd9-887f-5af30614cb59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:09.461950 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a5b27b-87dc-4cd9-887f-5af30614cb59 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:09.479032 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1ff60b-d164-40e6-9c19-c011c914fd95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:09.479679 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1ff60b-d164-40e6-9c19-c011c914fd95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:09.480071 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1ff60b-d164-40e6-9c19-c011c914fd95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:09.480351 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1ff60b-d164-40e6-9c19-c011c914fd95 admin admin] PATH_INFO: `/v3/users/d995d72b0e304df6accb62a1dd689e1e` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:09.481772 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1ff60b-d164-40e6-9c19-c011c914fd95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d995d72b0e304df6accb62a1dd689e1e)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:09.485740 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1ff60b-d164-40e6-9c19-c011c914fd95 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:09.544575 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d533288c-f0d6-4947-bb6c-eee051207fcf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:09.546333 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d533288c-f0d6-4947-bb6c-eee051207fcf service swift] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:09.612535 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 897/1767] 10.222.0.27 () {60 vars in 1384 bytes} [Fri Sep 9 16:32:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 623 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 09 16:32:09.613559 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d533288c-f0d6-4947-bb6c-eee051207fcf service swift] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:09.654516 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d533288c-f0d6-4947-bb6c-eee051207fcf service swift] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:09.679158 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc2d667-bae2-4da1-baa0-9f4f08a001fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:09.679937 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc2d667-bae2-4da1-baa0-9f4f08a001fd admin admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:09.680225 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc2d667-bae2-4da1-baa0-9f4f08a001fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:09.680509 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc2d667-bae2-4da1-baa0-9f4f08a001fd admin admin] PATH_INFO: `/v3/projects/9eb29ac2ae5e406fbedc2a1cb7f9ea72/users/3b9fabe829be4f9c8ad0e2dd11170bfc/roles/0a36d1be416f4089be19be979943b731` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:09.691746 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc2d667-bae2-4da1-baa0-9f4f08a001fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=9eb29ac2ae5e406fbedc2a1cb7f9ea72, user_id=3b9fabe829be4f9c8ad0e2dd11170bfc, role_id=0a36d1be416f4089be19be979943b731)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:09.694816 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-7e1ff60b-d164-40e6-9c19-c011c914fd95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd995d72b0e304df6accb62a1dd689e1e'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:09.705138 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc2d667-bae2-4da1-baa0-9f4f08a001fd admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:09.726198 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-7e1ff60b-d164-40e6-9c19-c011c914fd95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd995d72b0e304df6accb62a1dd689e1e'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:09.731121 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-7e1ff60b-d164-40e6-9c19-c011c914fd95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd995d72b0e304df6accb62a1dd689e1e'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:09.737460 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:32:09.750256 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 898/1768] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 16:32:09 2022] PUT /identity/v3/projects/9eb29ac2ae5e406fbedc2a1cb7f9ea72/users/3b9fabe829be4f9c8ad0e2dd11170bfc/roles/0a36d1be416f4089be19be979943b731 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:32:09.753352 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-7e1ff60b-d164-40e6-9c19-c011c914fd95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd995d72b0e304df6accb62a1dd689e1e'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:09.753614 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f322de0-4209-4b82-9f22-c3b35ff3e51e None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:09.753902 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f322de0-4209-4b82-9f22-c3b35ff3e51e None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:09.754487 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f322de0-4209-4b82-9f22-c3b35ff3e51e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:09.798180 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-7e1ff60b-d164-40e6-9c19-c011c914fd95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd995d72b0e304df6accb62a1dd689e1e'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:09.825776 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 871/1769] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 16:32:09 2022] DELETE /identity/v3/users/d995d72b0e304df6accb62a1dd689e1e => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:32:09.825984 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-3f322de0-4209-4b82-9f22-c3b35ff3e51e None None] MFA Rules not processed for user `d5f44bfdd5214e8d84a2c0a5b1fd9b84`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:32:09.826510 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1ff60b-d164-40e6-9c19-c011c914fd95 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:09.827506 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-3f322de0-4209-4b82-9f22-c3b35ff3e51e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:09.831494 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-7e1ff60b-d164-40e6-9c19-c011c914fd95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:10.031210 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 899/1770] 10.222.0.27 () {58 vars in 1009 bytes} [Fri Sep 9 16:32:09 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:32:10.032998 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e7cfd8-33b2-4608-9781-5efe6cfd1398 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:10.039053 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e7cfd8-33b2-4608-9781-5efe6cfd1398 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:10.039445 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e7cfd8-33b2-4608-9781-5efe6cfd1398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:10.122741 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1ff60b-d164-40e6-9c19-c011c914fd95 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:10.141015 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-51e7cfd8-33b2-4608-9781-5efe6cfd1398 None None] MFA Rules not processed for user `3b9fabe829be4f9c8ad0e2dd11170bfc`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:32:10.146594 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-51e7cfd8-33b2-4608-9781-5efe6cfd1398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:10.162656 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07bb8d9-2590-421a-bfcb-5af2d2459353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:10.163438 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07bb8d9-2590-421a-bfcb-5af2d2459353 admin admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:10.163886 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07bb8d9-2590-421a-bfcb-5af2d2459353 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:10.164032 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07bb8d9-2590-421a-bfcb-5af2d2459353 admin admin] PATH_INFO: `/v3/projects/4d90b179256044cf8593b400807df2a2/users/737c38fb3eb54f268b82c280019daea3/roles/0a36d1be416f4089be19be979943b731` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:10.180461 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07bb8d9-2590-421a-bfcb-5af2d2459353 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d90b179256044cf8593b400807df2a2, user_id=737c38fb3eb54f268b82c280019daea3, role_id=0a36d1be416f4089be19be979943b731)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:10.187508 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07bb8d9-2590-421a-bfcb-5af2d2459353 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:10.227546 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 872/1771] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 16:32:09 2022] PUT /identity/v3/projects/4d90b179256044cf8593b400807df2a2/users/737c38fb3eb54f268b82c280019daea3/roles/0a36d1be416f4089be19be979943b731 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:32:10.229071 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7505ca5c-8a4d-4a87-808b-9ba27ae0777b None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:10.229207 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7505ca5c-8a4d-4a87-808b-9ba27ae0777b None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:10.229420 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7505ca5c-8a4d-4a87-808b-9ba27ae0777b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:10.292409 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-7505ca5c-8a4d-4a87-808b-9ba27ae0777b None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:32:10.294229 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-7505ca5c-8a4d-4a87-808b-9ba27ae0777b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:10.347116 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:32:10.392674 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 900/1772] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:32:10 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 360 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:32:10.394113 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b91b4ac-b137-46c1-b392-b00e1e23169b None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:10.394459 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b91b4ac-b137-46c1-b392-b00e1e23169b None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:10.394739 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b91b4ac-b137-46c1-b392-b00e1e23169b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:10.529579 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-1b91b4ac-b137-46c1-b392-b00e1e23169b None None] MFA Rules not processed for user `737c38fb3eb54f268b82c280019daea3`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:32:10.531981 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-1b91b4ac-b137-46c1-b392-b00e1e23169b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:10.551324 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 873/1773] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:32:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:32:10.552001 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7505ca5c-8a4d-4a87-808b-9ba27ae0777b None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:10.560857 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-7505ca5c-8a4d-4a87-808b-9ba27ae0777b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:10.731877 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7505ca5c-8a4d-4a87-808b-9ba27ae0777b None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:10.741846 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99739758-6dd9-4e74-8809-6af90d9f9000 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8078e791ba68460f8b3aeafb4b79b73a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:10.742534 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99739758-6dd9-4e74-8809-6af90d9f9000 service cinder] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:10.742816 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99739758-6dd9-4e74-8809-6af90d9f9000 service cinder] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:10.744369 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99739758-6dd9-4e74-8809-6af90d9f9000 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:10.894387 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 901/1774] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:32:10 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 501 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:32:10.909299 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b91b4ac-b137-46c1-b392-b00e1e23169b None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:10.914665 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-1b91b4ac-b137-46c1-b392-b00e1e23169b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:10.981021 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99739758-6dd9-4e74-8809-6af90d9f9000 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:10.984055 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99739758-6dd9-4e74-8809-6af90d9f9000 service cinder] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:11.014928 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:32:11.042460 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 874/1775] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:32:10 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 491 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:32:11.048175 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99739758-6dd9-4e74-8809-6af90d9f9000 service cinder] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:11.058492 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-99739758-6dd9-4e74-8809-6af90d9f9000 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:11.188006 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b91b4ac-b137-46c1-b392-b00e1e23169b None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:11.196262 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcb83cd-9dc2-44df-b3fa-74f0d1de61fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f44bfdd5214e8d84a2c0a5b1fd9b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:11.199066 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcb83cd-9dc2-44df-b3fa-74f0d1de61fd service neutron] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:11.200077 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcb83cd-9dc2-44df-b3fa-74f0d1de61fd service neutron] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:11.204242 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcb83cd-9dc2-44df-b3fa-74f0d1de61fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:11.240739 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcb83cd-9dc2-44df-b3fa-74f0d1de61fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:11.247051 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcb83cd-9dc2-44df-b3fa-74f0d1de61fd service neutron] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:11.252611 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99739758-6dd9-4e74-8809-6af90d9f9000 service cinder] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:11.264879 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c33438-6aa8-49ee-b892-a8f0c3988273 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f44bfdd5214e8d84a2c0a5b1fd9b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:11.265370 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c33438-6aa8-49ee-b892-a8f0c3988273 service neutron] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:11.265905 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c33438-6aa8-49ee-b892-a8f0c3988273 service neutron] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:11.266224 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c33438-6aa8-49ee-b892-a8f0c3988273 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:11.290271 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c33438-6aa8-49ee-b892-a8f0c3988273 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:11.291040 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 902/1776] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:32:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:32:11.291974 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcb83cd-9dc2-44df-b3fa-74f0d1de61fd service neutron] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:11.294771 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c33438-6aa8-49ee-b892-a8f0c3988273 service neutron] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:11.303968 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-9fcb83cd-9dc2-44df-b3fa-74f0d1de61fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:11.330945 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 875/1777] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:32:11 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:32:11.333781 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c33438-6aa8-49ee-b892-a8f0c3988273 service neutron] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:11.336172 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-96c33438-6aa8-49ee-b892-a8f0c3988273 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:11.348270 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcb83cd-9dc2-44df-b3fa-74f0d1de61fd service neutron] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:11.363313 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e75086-69f3-424a-a8ab-1249630546cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:11.364088 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e75086-69f3-424a-a8ab-1249630546cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:11.364826 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e75086-69f3-424a-a8ab-1249630546cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:11.365114 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e75086-69f3-424a-a8ab-1249630546cc admin admin] PATH_INFO: `/v3/users/c6d1535a7e0847ccbbbde1df20a4a334` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:11.366973 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e75086-69f3-424a-a8ab-1249630546cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6d1535a7e0847ccbbbde1df20a4a334)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:11.371082 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c33438-6aa8-49ee-b892-a8f0c3988273 service neutron] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:11.373755 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e75086-69f3-424a-a8ab-1249630546cc admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:11.385631 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6688c033-1624-4508-8c99-eb51323a03b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8078e791ba68460f8b3aeafb4b79b73a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:11.386206 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6688c033-1624-4508-8c99-eb51323a03b4 service cinder] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:11.388205 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6688c033-1624-4508-8c99-eb51323a03b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:11.388958 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6688c033-1624-4508-8c99-eb51323a03b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:11.414512 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6688c033-1624-4508-8c99-eb51323a03b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:11.425886 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6688c033-1624-4508-8c99-eb51323a03b4 service cinder] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:11.461089 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 876/1778] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:32:11 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:32:11.483953 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-99e75086-69f3-424a-a8ab-1249630546cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6d1535a7e0847ccbbbde1df20a4a334'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:11.505196 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-99e75086-69f3-424a-a8ab-1249630546cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6d1535a7e0847ccbbbde1df20a4a334'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:11.584320 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-99e75086-69f3-424a-a8ab-1249630546cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6d1535a7e0847ccbbbde1df20a4a334'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:11.609634 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-99e75086-69f3-424a-a8ab-1249630546cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6d1535a7e0847ccbbbde1df20a4a334'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:11.611546 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-99e75086-69f3-424a-a8ab-1249630546cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6d1535a7e0847ccbbbde1df20a4a334'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:11.640487 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 903/1779] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 16:32:11 2022] DELETE /identity/v3/users/c6d1535a7e0847ccbbbde1df20a4a334 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:32:11.642334 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc51d351-c962-402f-ae74-719b32a3e1ec None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:11.642927 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc51d351-c962-402f-ae74-719b32a3e1ec None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:11.643042 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc51d351-c962-402f-ae74-719b32a3e1ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:11.657072 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:32:11.669124 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e75086-69f3-424a-a8ab-1249630546cc admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:11.671062 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-99e75086-69f3-424a-a8ab-1249630546cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:11.718354 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-dc51d351-c962-402f-ae74-719b32a3e1ec None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:32:11.720096 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-dc51d351-c962-402f-ae74-719b32a3e1ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:11.907518 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 877/1780] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:32:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:32:11.953012 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19dea18-add7-468a-9e18-b561b99377be None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:11.953303 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19dea18-add7-468a-9e18-b561b99377be None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:11.953803 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19dea18-add7-468a-9e18-b561b99377be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:11.961193 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e75086-69f3-424a-a8ab-1249630546cc admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:11.973160 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71946fb8-1286-4863-86fa-c050bacc902f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8078e791ba68460f8b3aeafb4b79b73a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:11.973724 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71946fb8-1286-4863-86fa-c050bacc902f service cinder] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:11.974003 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71946fb8-1286-4863-86fa-c050bacc902f service cinder] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:11.974274 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71946fb8-1286-4863-86fa-c050bacc902f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:11.976265 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-71946fb8-1286-4863-86fa-c050bacc902f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:12.010940 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-b19dea18-add7-468a-9e18-b561b99377be None None] MFA Rules not processed for user `d5f44bfdd5214e8d84a2c0a5b1fd9b84`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:32:12.013114 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-b19dea18-add7-468a-9e18-b561b99377be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:12.178569 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:32:12.213462 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71946fb8-1286-4863-86fa-c050bacc902f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:12.216710 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71946fb8-1286-4863-86fa-c050bacc902f service cinder] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:12.241400 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 878/1781] 10.222.0.20 () {58 vars in 1015 bytes} [Fri Sep 9 16:32:11 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 16:32:12.245543 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19dea18-add7-468a-9e18-b561b99377be None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:12.249614 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-b19dea18-add7-468a-9e18-b561b99377be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:12.267033 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 904/1782] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:32:11 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 598 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:32:12.268279 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71946fb8-1286-4863-86fa-c050bacc902f service cinder] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:12.272293 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-71946fb8-1286-4863-86fa-c050bacc902f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:12.303455 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19dea18-add7-468a-9e18-b561b99377be None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:12.320489 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daeaed90-f72b-4894-bc91-f26e5c32cca2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f44bfdd5214e8d84a2c0a5b1fd9b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:12.322358 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeaed90-f72b-4894-bc91-f26e5c32cca2 service neutron] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:12.322608 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeaed90-f72b-4894-bc91-f26e5c32cca2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:12.322887 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeaed90-f72b-4894-bc91-f26e5c32cca2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:12.340792 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71946fb8-1286-4863-86fa-c050bacc902f service cinder] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:12.360999 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25befb5f-ec9a-4820-8ab7-a4410fb91a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:12.365695 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25befb5f-ec9a-4820-8ab7-a4410fb91a48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:12.365695 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25befb5f-ec9a-4820-8ab7-a4410fb91a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:12.365963 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25befb5f-ec9a-4820-8ab7-a4410fb91a48 admin admin] PATH_INFO: `/v3/users/9181f67552d841abbb4ab9b2c3c36971` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:12.367586 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daeaed90-f72b-4894-bc91-f26e5c32cca2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:12.370893 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daeaed90-f72b-4894-bc91-f26e5c32cca2 service neutron] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:12.372205 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25befb5f-ec9a-4820-8ab7-a4410fb91a48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9181f67552d841abbb4ab9b2c3c36971)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:12.383094 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25befb5f-ec9a-4820-8ab7-a4410fb91a48 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:12.403691 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 879/1783] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:32:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:32:12.406020 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daeaed90-f72b-4894-bc91-f26e5c32cca2 service neutron] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:12.410102 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-daeaed90-f72b-4894-bc91-f26e5c32cca2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:12.442779 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daeaed90-f72b-4894-bc91-f26e5c32cca2 service neutron] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:12.447186 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5c3a56-7df3-449c-8980-a24bca36370a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f44bfdd5214e8d84a2c0a5b1fd9b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:12.447982 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5c3a56-7df3-449c-8980-a24bca36370a service neutron] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:12.448358 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5c3a56-7df3-449c-8980-a24bca36370a service neutron] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:12.448779 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5c3a56-7df3-449c-8980-a24bca36370a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:12.460371 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5c3a56-7df3-449c-8980-a24bca36370a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:12.462874 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5c3a56-7df3-449c-8980-a24bca36370a service neutron] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:12.478756 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 880/1784] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:32:12 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:32:12.554965 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-25befb5f-ec9a-4820-8ab7-a4410fb91a48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9181f67552d841abbb4ab9b2c3c36971'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:12.579157 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-25befb5f-ec9a-4820-8ab7-a4410fb91a48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9181f67552d841abbb4ab9b2c3c36971'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:12.614787 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-25befb5f-ec9a-4820-8ab7-a4410fb91a48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9181f67552d841abbb4ab9b2c3c36971'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:12.631179 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-25befb5f-ec9a-4820-8ab7-a4410fb91a48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9181f67552d841abbb4ab9b2c3c36971'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:12.632438 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-25befb5f-ec9a-4820-8ab7-a4410fb91a48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9181f67552d841abbb4ab9b2c3c36971'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:12.646378 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 905/1785] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 16:32:12 2022] DELETE /identity/v3/users/9181f67552d841abbb4ab9b2c3c36971 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:32:12.651376 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15004a9-2307-4242-8001-2d1ef93e105d None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:12.651689 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15004a9-2307-4242-8001-2d1ef93e105d None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:12.652118 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15004a9-2307-4242-8001-2d1ef93e105d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:12.706775 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-b15004a9-2307-4242-8001-2d1ef93e105d None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:32:12.711885 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-b15004a9-2307-4242-8001-2d1ef93e105d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:12.993975 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 881/1786] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:32:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 344 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:32:13.244245 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25befb5f-ec9a-4820-8ab7-a4410fb91a48 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:13.246101 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-25befb5f-ec9a-4820-8ab7-a4410fb91a48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:13.521097 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25befb5f-ec9a-4820-8ab7-a4410fb91a48 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:13.549279 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fc5d76-0fd5-45e3-a0f2-45a38801604a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f44bfdd5214e8d84a2c0a5b1fd9b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:13.549905 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fc5d76-0fd5-45e3-a0f2-45a38801604a service neutron] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:13.550180 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fc5d76-0fd5-45e3-a0f2-45a38801604a service neutron] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:13.556858 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fc5d76-0fd5-45e3-a0f2-45a38801604a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:13.647159 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fc5d76-0fd5-45e3-a0f2-45a38801604a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:13.655504 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fc5d76-0fd5-45e3-a0f2-45a38801604a service neutron] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:13.698052 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 906/1787] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:32:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:32:14.691250 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15004a9-2307-4242-8001-2d1ef93e105d None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:14.692689 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-b15004a9-2307-4242-8001-2d1ef93e105d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:14.733057 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15004a9-2307-4242-8001-2d1ef93e105d None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:14.758903 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c001f277-8a3c-4c12-9bfb-c09e3b65bf92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:14.759568 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c001f277-8a3c-4c12-9bfb-c09e3b65bf92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:14.759849 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c001f277-8a3c-4c12-9bfb-c09e3b65bf92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:14.760124 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c001f277-8a3c-4c12-9bfb-c09e3b65bf92 admin admin] PATH_INFO: `/v3/projects/a6be2130c4ab4c828f8c350f2df7b833` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:14.762463 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c001f277-8a3c-4c12-9bfb-c09e3b65bf92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6be2130c4ab4c828f8c350f2df7b833)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:14.771501 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c001f277-8a3c-4c12-9bfb-c09e3b65bf92 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:14.841538 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:32:14.909321 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-c001f277-8a3c-4c12-9bfb-c09e3b65bf92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6be2130c4ab4c828f8c350f2df7b833', 'request_id': 'req-c001f277-8a3c-4c12-9bfb-c09e3b65bf92'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:14.929330 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-c001f277-8a3c-4c12-9bfb-c09e3b65bf92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6be2130c4ab4c828f8c350f2df7b833', 'request_id': 'req-c001f277-8a3c-4c12-9bfb-c09e3b65bf92'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:14.951059 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-c001f277-8a3c-4c12-9bfb-c09e3b65bf92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6be2130c4ab4c828f8c350f2df7b833', 'request_id': 'req-c001f277-8a3c-4c12-9bfb-c09e3b65bf92'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:14.979692 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-c001f277-8a3c-4c12-9bfb-c09e3b65bf92 admin admin] The token cache is being invalidate because project a6be2130c4ab4c828f8c350f2df7b833 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81445) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 16:32:14.980010 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-c001f277-8a3c-4c12-9bfb-c09e3b65bf92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:14.983711 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-c001f277-8a3c-4c12-9bfb-c09e3b65bf92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:14.987519 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 882/1788] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 16:32:14 2022] DELETE /identity/v3/projects/a6be2130c4ab4c828f8c350f2df7b833 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:32:14.991719 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fc5d76-0fd5-45e3-a0f2-45a38801604a service neutron] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:15.015711 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fc5d76-0fd5-45e3-a0f2-45a38801604a service neutron] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:15.186804 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce40fc61-59c8-487f-b0de-1bee3818f9c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:15.187453 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce40fc61-59c8-487f-b0de-1bee3818f9c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:15.187839 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce40fc61-59c8-487f-b0de-1bee3818f9c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:15.188114 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce40fc61-59c8-487f-b0de-1bee3818f9c5 admin admin] PATH_INFO: `/v3/users/233a6371d6724a8eaddd39de4b0e5ba5` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:15.192835 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce40fc61-59c8-487f-b0de-1bee3818f9c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=233a6371d6724a8eaddd39de4b0e5ba5)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:15.194823 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce40fc61-59c8-487f-b0de-1bee3818f9c5 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:15.214359 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:32:15.333025 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-ce40fc61-59c8-487f-b0de-1bee3818f9c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '233a6371d6724a8eaddd39de4b0e5ba5'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:15.352944 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-ce40fc61-59c8-487f-b0de-1bee3818f9c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '233a6371d6724a8eaddd39de4b0e5ba5'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:15.380928 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-ce40fc61-59c8-487f-b0de-1bee3818f9c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '233a6371d6724a8eaddd39de4b0e5ba5'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:15.407192 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-ce40fc61-59c8-487f-b0de-1bee3818f9c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '233a6371d6724a8eaddd39de4b0e5ba5'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:15.409350 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-ce40fc61-59c8-487f-b0de-1bee3818f9c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '233a6371d6724a8eaddd39de4b0e5ba5'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:15.421069 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 907/1789] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 16:32:14 2022] DELETE /identity/v3/users/233a6371d6724a8eaddd39de4b0e5ba5 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:32:16.615070 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dc174d-bac6-475b-9a68-43d3e6174306 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:16.615633 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dc174d-bac6-475b-9a68-43d3e6174306 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:16.615730 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dc174d-bac6-475b-9a68-43d3e6174306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:16.710919 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-36dc174d-bac6-475b-9a68-43d3e6174306 None None] MFA Rules not processed for user `8c3919b9f57e4604b89d3f6a2763b0b4`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:32:16.714159 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-36dc174d-bac6-475b-9a68-43d3e6174306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:16.946040 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 883/1790] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:32:16 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:32:16.984841 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e0f841-c8c3-43ec-add7-c846aeee3f65 None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:16.985720 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e0f841-c8c3-43ec-add7-c846aeee3f65 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:16.986159 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e0f841-c8c3-43ec-add7-c846aeee3f65 None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:16.988213 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 908/1791] 10.222.0.27 () {54 vars in 921 bytes} [Fri Sep 9 16:32:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:32:17.129616 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dbd69c-6958-4170-ba2a-ce6e83e978c4 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:17.130053 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dbd69c-6958-4170-ba2a-ce6e83e978c4 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:17.130371 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dbd69c-6958-4170-ba2a-ce6e83e978c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:17.218279 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-f5dbd69c-6958-4170-ba2a-ce6e83e978c4 None None] MFA Rules not processed for user `a332b9b4980646a3b14633293f77b505`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:32:17.219923 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-f5dbd69c-6958-4170-ba2a-ce6e83e978c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:17.480115 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 884/1792] 10.222.0.27 () {58 vars in 1018 bytes} [Fri Sep 9 16:32:17 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 353 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:32:17.713569 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e0f841-c8c3-43ec-add7-c846aeee3f65 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:17.715925 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-c8e0f841-c8c3-43ec-add7-c846aeee3f65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:17.919536 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e0f841-c8c3-43ec-add7-c846aeee3f65 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:17.930601 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2b145c-3228-4d74-ac79-3e93a6a9d0e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:17.933377 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2b145c-3228-4d74-ac79-3e93a6a9d0e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:17.933873 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2b145c-3228-4d74-ac79-3e93a6a9d0e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:17.935708 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2b145c-3228-4d74-ac79-3e93a6a9d0e3 admin admin] PATH_INFO: `/v3/projects/03f0739227664ee0b6c91fd867b1cc4c` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:17.938713 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2b145c-3228-4d74-ac79-3e93a6a9d0e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=03f0739227664ee0b6c91fd867b1cc4c)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:17.941781 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2b145c-3228-4d74-ac79-3e93a6a9d0e3 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:18.075890 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-ad2b145c-3228-4d74-ac79-3e93a6a9d0e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03f0739227664ee0b6c91fd867b1cc4c', 'request_id': 'req-ad2b145c-3228-4d74-ac79-3e93a6a9d0e3'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:18.091187 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-ad2b145c-3228-4d74-ac79-3e93a6a9d0e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03f0739227664ee0b6c91fd867b1cc4c', 'request_id': 'req-ad2b145c-3228-4d74-ac79-3e93a6a9d0e3'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:18.106783 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-ad2b145c-3228-4d74-ac79-3e93a6a9d0e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03f0739227664ee0b6c91fd867b1cc4c', 'request_id': 'req-ad2b145c-3228-4d74-ac79-3e93a6a9d0e3'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:18.130800 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-ad2b145c-3228-4d74-ac79-3e93a6a9d0e3 admin admin] The token cache is being invalidate because project 03f0739227664ee0b6c91fd867b1cc4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81446) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 16:32:18.131205 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-ad2b145c-3228-4d74-ac79-3e93a6a9d0e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:18.132344 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-ad2b145c-3228-4d74-ac79-3e93a6a9d0e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:18.142545 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 909/1793] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 16:32:17 2022] DELETE /identity/v3/projects/03f0739227664ee0b6c91fd867b1cc4c => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:32:18.143519 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dbd69c-6958-4170-ba2a-ce6e83e978c4 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:18.165842 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dbd69c-6958-4170-ba2a-ce6e83e978c4 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:18.273335 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:32:18.297019 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2b145c-3228-4d74-ac79-3e93a6a9d0e3 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:18.298750 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-ad2b145c-3228-4d74-ac79-3e93a6a9d0e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:18.327314 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:32:18.329253 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddb083c-736d-4368-81f7-893c9012da79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:18.344028 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddb083c-736d-4368-81f7-893c9012da79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:18.344601 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddb083c-736d-4368-81f7-893c9012da79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:18.345314 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddb083c-736d-4368-81f7-893c9012da79 admin admin] PATH_INFO: `/v3/users/ce5f33aa7add400e85187b53c4918c02` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:18.348144 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddb083c-736d-4368-81f7-893c9012da79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce5f33aa7add400e85187b53c4918c02)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:18.354698 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddb083c-736d-4368-81f7-893c9012da79 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:18.474189 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-dddb083c-736d-4368-81f7-893c9012da79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce5f33aa7add400e85187b53c4918c02'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:18.484756 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-dddb083c-736d-4368-81f7-893c9012da79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce5f33aa7add400e85187b53c4918c02'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:18.485747 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-dddb083c-736d-4368-81f7-893c9012da79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce5f33aa7add400e85187b53c4918c02'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:18.491886 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2b145c-3228-4d74-ac79-3e93a6a9d0e3 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:18.500813 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-dddb083c-736d-4368-81f7-893c9012da79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce5f33aa7add400e85187b53c4918c02'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:18.507404 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bc37c3-a031-4c86-ae68-0724237ba20e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a332b9b4980646a3b14633293f77b505', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:18.508471 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bc37c3-a031-4c86-ae68-0724237ba20e service nova] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:18.508471 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bc37c3-a031-4c86-ae68-0724237ba20e service nova] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:18.508659 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bc37c3-a031-4c86-ae68-0724237ba20e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:18.514871 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-43bc37c3-a031-4c86-ae68-0724237ba20e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:18.531361 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-dddb083c-736d-4368-81f7-893c9012da79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce5f33aa7add400e85187b53c4918c02'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:18.547574 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bc37c3-a031-4c86-ae68-0724237ba20e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:18.554717 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bc37c3-a031-4c86-ae68-0724237ba20e service nova] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:18.555260 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 885/1794] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 16:32:18 2022] DELETE /identity/v3/users/ce5f33aa7add400e85187b53c4918c02 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:32:18.593282 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 910/1795] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:32:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 16:32:18.675487 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddb083c-736d-4368-81f7-893c9012da79 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:18.678029 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-dddb083c-736d-4368-81f7-893c9012da79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:18.855341 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bc37c3-a031-4c86-ae68-0724237ba20e service nova] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:18.857497 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-43bc37c3-a031-4c86-ae68-0724237ba20e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:18.885579 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bc37c3-a031-4c86-ae68-0724237ba20e service nova] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:18.896829 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a27f72b-bd13-49ae-955f-39b0b8e1fc1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:18.897887 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a27f72b-bd13-49ae-955f-39b0b8e1fc1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:18.898645 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a27f72b-bd13-49ae-955f-39b0b8e1fc1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:18.899144 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a27f72b-bd13-49ae-955f-39b0b8e1fc1a admin admin] PATH_INFO: `/v3/projects/7127f3eee794408da348af6775ef5c9f` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:18.902915 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a27f72b-bd13-49ae-955f-39b0b8e1fc1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=7127f3eee794408da348af6775ef5c9f)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:18.905133 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a27f72b-bd13-49ae-955f-39b0b8e1fc1a admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:18.915726 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddb083c-736d-4368-81f7-893c9012da79 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:18.933223 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c32022e-7c18-4ee9-a667-cc080c835acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:18.933880 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c32022e-7c18-4ee9-a667-cc080c835acb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:18.934157 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c32022e-7c18-4ee9-a667-cc080c835acb admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:18.934476 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c32022e-7c18-4ee9-a667-cc080c835acb admin admin] PATH_INFO: `/v3/projects/5eb3d18404e04d9895e5f487c3d2e658` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:18.937550 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c32022e-7c18-4ee9-a667-cc080c835acb admin admin] RBAC: Authorizing `identity:delete_project(project_id=5eb3d18404e04d9895e5f487c3d2e658)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:18.955888 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c32022e-7c18-4ee9-a667-cc080c835acb admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:19.078591 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-1a27f72b-bd13-49ae-955f-39b0b8e1fc1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7127f3eee794408da348af6775ef5c9f', 'request_id': 'req-1a27f72b-bd13-49ae-955f-39b0b8e1fc1a'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:19.088225 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-1a27f72b-bd13-49ae-955f-39b0b8e1fc1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7127f3eee794408da348af6775ef5c9f', 'request_id': 'req-1a27f72b-bd13-49ae-955f-39b0b8e1fc1a'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:19.103578 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-2c32022e-7c18-4ee9-a667-cc080c835acb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5eb3d18404e04d9895e5f487c3d2e658', 'request_id': 'req-2c32022e-7c18-4ee9-a667-cc080c835acb'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:19.108394 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-1a27f72b-bd13-49ae-955f-39b0b8e1fc1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7127f3eee794408da348af6775ef5c9f', 'request_id': 'req-1a27f72b-bd13-49ae-955f-39b0b8e1fc1a'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:19.127733 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-2c32022e-7c18-4ee9-a667-cc080c835acb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5eb3d18404e04d9895e5f487c3d2e658', 'request_id': 'req-2c32022e-7c18-4ee9-a667-cc080c835acb'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:19.145422 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-2c32022e-7c18-4ee9-a667-cc080c835acb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5eb3d18404e04d9895e5f487c3d2e658', 'request_id': 'req-2c32022e-7c18-4ee9-a667-cc080c835acb'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:19.150723 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-1a27f72b-bd13-49ae-955f-39b0b8e1fc1a admin admin] The token cache is being invalidate because project 7127f3eee794408da348af6775ef5c9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81446) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 16:32:19.151431 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-1a27f72b-bd13-49ae-955f-39b0b8e1fc1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:19.153191 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-1a27f72b-bd13-49ae-955f-39b0b8e1fc1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:19.158968 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 911/1796] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 16:32:18 2022] DELETE /identity/v3/projects/7127f3eee794408da348af6775ef5c9f => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:32:19.160435 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:32:19.163367 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a27f72b-bd13-49ae-955f-39b0b8e1fc1a admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:19.166495 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-1a27f72b-bd13-49ae-955f-39b0b8e1fc1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:19.169867 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-2c32022e-7c18-4ee9-a667-cc080c835acb admin admin] The token cache is being invalidate because project 5eb3d18404e04d9895e5f487c3d2e658 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81445) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 16:32:19.170554 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-2c32022e-7c18-4ee9-a667-cc080c835acb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:19.173836 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-2c32022e-7c18-4ee9-a667-cc080c835acb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:19.183362 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 886/1797] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 16:32:18 2022] DELETE /identity/v3/projects/5eb3d18404e04d9895e5f487c3d2e658 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:32:19.184482 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c32022e-7c18-4ee9-a667-cc080c835acb admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:19.186022 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-2c32022e-7c18-4ee9-a667-cc080c835acb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:19.318477 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c32022e-7c18-4ee9-a667-cc080c835acb admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:19.336287 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4e302c-ff42-4fe6-ae5d-2617cb8f6a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:19.336946 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4e302c-ff42-4fe6-ae5d-2617cb8f6a12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:19.337994 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4e302c-ff42-4fe6-ae5d-2617cb8f6a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:19.338278 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4e302c-ff42-4fe6-ae5d-2617cb8f6a12 admin admin] PATH_INFO: `/v3/users/b8cc844c8c994a80a7f3b9d0ae60cdb0` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:19.341044 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4e302c-ff42-4fe6-ae5d-2617cb8f6a12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8cc844c8c994a80a7f3b9d0ae60cdb0)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:19.347589 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4e302c-ff42-4fe6-ae5d-2617cb8f6a12 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:19.361914 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a27f72b-bd13-49ae-955f-39b0b8e1fc1a admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:19.376242 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546b24af-c7ea-43b1-a8b3-8f8bbdf5d60c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:19.376907 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546b24af-c7ea-43b1-a8b3-8f8bbdf5d60c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:19.378930 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546b24af-c7ea-43b1-a8b3-8f8bbdf5d60c admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:19.379276 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546b24af-c7ea-43b1-a8b3-8f8bbdf5d60c admin admin] PATH_INFO: `/v3/users/3b9fabe829be4f9c8ad0e2dd11170bfc` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:19.381529 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546b24af-c7ea-43b1-a8b3-8f8bbdf5d60c admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b9fabe829be4f9c8ad0e2dd11170bfc)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:19.387841 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546b24af-c7ea-43b1-a8b3-8f8bbdf5d60c admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:19.489281 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:32:19.501265 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-cc4e302c-ff42-4fe6-ae5d-2617cb8f6a12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8cc844c8c994a80a7f3b9d0ae60cdb0'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:19.538995 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-cc4e302c-ff42-4fe6-ae5d-2617cb8f6a12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8cc844c8c994a80a7f3b9d0ae60cdb0'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:19.539921 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-cc4e302c-ff42-4fe6-ae5d-2617cb8f6a12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8cc844c8c994a80a7f3b9d0ae60cdb0'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:19.601588 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-cc4e302c-ff42-4fe6-ae5d-2617cb8f6a12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8cc844c8c994a80a7f3b9d0ae60cdb0'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:19.614015 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-546b24af-c7ea-43b1-a8b3-8f8bbdf5d60c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b9fabe829be4f9c8ad0e2dd11170bfc'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:19.641039 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-546b24af-c7ea-43b1-a8b3-8f8bbdf5d60c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b9fabe829be4f9c8ad0e2dd11170bfc'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:19.680204 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-cc4e302c-ff42-4fe6-ae5d-2617cb8f6a12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8cc844c8c994a80a7f3b9d0ae60cdb0'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:19.682503 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-546b24af-c7ea-43b1-a8b3-8f8bbdf5d60c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b9fabe829be4f9c8ad0e2dd11170bfc'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:19.705915 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 887/1798] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 16:32:19 2022] DELETE /identity/v3/users/b8cc844c8c994a80a7f3b9d0ae60cdb0 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:32:19.726357 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-546b24af-c7ea-43b1-a8b3-8f8bbdf5d60c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b9fabe829be4f9c8ad0e2dd11170bfc'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:19.727383 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-546b24af-c7ea-43b1-a8b3-8f8bbdf5d60c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b9fabe829be4f9c8ad0e2dd11170bfc'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:19.765497 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 912/1799] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 16:32:19 2022] DELETE /identity/v3/users/3b9fabe829be4f9c8ad0e2dd11170bfc => generated 0 bytes in 598 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:32:21.076215 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4e302c-ff42-4fe6-ae5d-2617cb8f6a12 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:21.078401 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-cc4e302c-ff42-4fe6-ae5d-2617cb8f6a12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:21.193179 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4f31c8-247c-4c95-9798-a642d85962a3 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:21.202757 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4f31c8-247c-4c95-9798-a642d85962a3 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:21.203307 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4f31c8-247c-4c95-9798-a642d85962a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:21.249329 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-cb4f31c8-247c-4c95-9798-a642d85962a3 None None] MFA Rules not processed for user `7ea10dd1db74490687a8be5a6f5a6f8a`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:32:21.250985 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-cb4f31c8-247c-4c95-9798-a642d85962a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:21.379829 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 913/1800] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:32:21 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 16:32:21.395292 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4e302c-ff42-4fe6-ae5d-2617cb8f6a12 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:21.448823 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:32:21.529329 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80c370d-92d9-4f53-b150-b8516d7aa5d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:21.530678 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80c370d-92d9-4f53-b150-b8516d7aa5d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:21.530952 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80c370d-92d9-4f53-b150-b8516d7aa5d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:21.531218 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80c370d-92d9-4f53-b150-b8516d7aa5d2 admin admin] PATH_INFO: `/v3/projects/f39a52ac47b44d4a8ea8f198c16ae2d7` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:21.532449 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80c370d-92d9-4f53-b150-b8516d7aa5d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f39a52ac47b44d4a8ea8f198c16ae2d7)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:21.534463 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80c370d-92d9-4f53-b150-b8516d7aa5d2 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:21.655813 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-e80c370d-92d9-4f53-b150-b8516d7aa5d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f39a52ac47b44d4a8ea8f198c16ae2d7', 'request_id': 'req-e80c370d-92d9-4f53-b150-b8516d7aa5d2'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:21.670546 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-e80c370d-92d9-4f53-b150-b8516d7aa5d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f39a52ac47b44d4a8ea8f198c16ae2d7', 'request_id': 'req-e80c370d-92d9-4f53-b150-b8516d7aa5d2'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:21.682040 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-e80c370d-92d9-4f53-b150-b8516d7aa5d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f39a52ac47b44d4a8ea8f198c16ae2d7', 'request_id': 'req-e80c370d-92d9-4f53-b150-b8516d7aa5d2'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:21.718652 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-e80c370d-92d9-4f53-b150-b8516d7aa5d2 admin admin] The token cache is being invalidate because project f39a52ac47b44d4a8ea8f198c16ae2d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81445) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 16:32:21.720207 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-e80c370d-92d9-4f53-b150-b8516d7aa5d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:21.721427 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-e80c370d-92d9-4f53-b150-b8516d7aa5d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:21.727706 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 888/1801] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 16:32:21 2022] DELETE /identity/v3/projects/f39a52ac47b44d4a8ea8f198c16ae2d7 => generated 0 bytes in 649 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:32:21.728988 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea9a805-994f-4d60-b060-c52d7195d6e9 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:21.729273 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea9a805-994f-4d60-b060-c52d7195d6e9 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:21.729574 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea9a805-994f-4d60-b060-c52d7195d6e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:21.765631 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-3ea9a805-994f-4d60-b060-c52d7195d6e9 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:32:21.771921 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-3ea9a805-994f-4d60-b060-c52d7195d6e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:21.773147 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80c370d-92d9-4f53-b150-b8516d7aa5d2 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:21.774779 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-e80c370d-92d9-4f53-b150-b8516d7aa5d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:21.905282 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80c370d-92d9-4f53-b150-b8516d7aa5d2 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:21.918044 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9e2c8a-8f43-45bc-aa84-2cb67b27c4b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:21.919004 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9e2c8a-8f43-45bc-aa84-2cb67b27c4b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:21.919445 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9e2c8a-8f43-45bc-aa84-2cb67b27c4b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:21.920075 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9e2c8a-8f43-45bc-aa84-2cb67b27c4b1 admin admin] PATH_INFO: `/v3/projects/6ae6d6bd13db46ce81caf55bf259f327` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:21.921828 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9e2c8a-8f43-45bc-aa84-2cb67b27c4b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ae6d6bd13db46ce81caf55bf259f327)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:21.923449 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9e2c8a-8f43-45bc-aa84-2cb67b27c4b1 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:22.009453 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 914/1802] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:32:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 16:32:22.011463 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7830ac-de8a-4b3a-83fc-ea55aa42ed05 None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:22.012119 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7830ac-de8a-4b3a-83fc-ea55aa42ed05 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:22.012409 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7830ac-de8a-4b3a-83fc-ea55aa42ed05 None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:22.016786 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 915/1803] 10.222.0.27 () {54 vars in 921 bytes} [Fri Sep 9 16:32:22 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:32:22.018333 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bc54d6-c79c-4eff-b42b-186335f86757 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:22.018716 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bc54d6-c79c-4eff-b42b-186335f86757 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:22.025856 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bc54d6-c79c-4eff-b42b-186335f86757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:22.030151 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-0f9e2c8a-8f43-45bc-aa84-2cb67b27c4b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ae6d6bd13db46ce81caf55bf259f327', 'request_id': 'req-0f9e2c8a-8f43-45bc-aa84-2cb67b27c4b1'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:22.037588 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-0f9e2c8a-8f43-45bc-aa84-2cb67b27c4b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ae6d6bd13db46ce81caf55bf259f327', 'request_id': 'req-0f9e2c8a-8f43-45bc-aa84-2cb67b27c4b1'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:22.048258 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:32:22.053921 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-b1bc54d6-c79c-4eff-b42b-186335f86757 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:32:22.054410 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-b1bc54d6-c79c-4eff-b42b-186335f86757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:22.062564 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-0f9e2c8a-8f43-45bc-aa84-2cb67b27c4b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ae6d6bd13db46ce81caf55bf259f327', 'request_id': 'req-0f9e2c8a-8f43-45bc-aa84-2cb67b27c4b1'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:22.080676 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-0f9e2c8a-8f43-45bc-aa84-2cb67b27c4b1 admin admin] The token cache is being invalidate because project 6ae6d6bd13db46ce81caf55bf259f327 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81445) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 16:32:22.081380 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-0f9e2c8a-8f43-45bc-aa84-2cb67b27c4b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:22.081913 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-0f9e2c8a-8f43-45bc-aa84-2cb67b27c4b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:22.087884 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 889/1804] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 16:32:21 2022] DELETE /identity/v3/projects/6ae6d6bd13db46ce81caf55bf259f327 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:32:22.089427 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e70330c-06ca-4c26-a390-49eb4dd6e644 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:22.089713 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e70330c-06ca-4c26-a390-49eb4dd6e644 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:22.089981 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e70330c-06ca-4c26-a390-49eb4dd6e644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:22.130453 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-9e70330c-06ca-4c26-a390-49eb4dd6e644 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:32:22.130453 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-9e70330c-06ca-4c26-a390-49eb4dd6e644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:22.265453 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 890/1805] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:32:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 16:32:22.267127 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93c10b9-943d-47b4-a350-a844a95de04d None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:22.267694 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93c10b9-943d-47b4-a350-a844a95de04d None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:22.273058 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93c10b9-943d-47b4-a350-a844a95de04d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:22.329753 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-f93c10b9-943d-47b4-a350-a844a95de04d None None] MFA Rules not processed for user `a332b9b4980646a3b14633293f77b505`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:32:22.332102 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-f93c10b9-943d-47b4-a350-a844a95de04d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:22.337880 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:32:22.381469 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 916/1806] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:32:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 364 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:32:22.383149 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3057f76a-411f-4351-b841-df73ffc48d62 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:22.385376 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3057f76a-411f-4351-b841-df73ffc48d62 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:22.386097 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3057f76a-411f-4351-b841-df73ffc48d62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:22.434681 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-3057f76a-411f-4351-b841-df73ffc48d62 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:32:22.438504 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-3057f76a-411f-4351-b841-df73ffc48d62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:22.457092 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 917/1807] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:32:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:32:22.458841 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3057f76a-411f-4351-b841-df73ffc48d62 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:22.519054 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3057f76a-411f-4351-b841-df73ffc48d62 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:22.524109 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 891/1808] 10.222.0.27 () {58 vars in 1018 bytes} [Fri Sep 9 16:32:22 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:32:22.525022 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93c10b9-943d-47b4-a350-a844a95de04d None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:22.555332 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195f2158-7bab-43de-95fe-8cd211b5d18f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:22.556198 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195f2158-7bab-43de-95fe-8cd211b5d18f admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:22.556551 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195f2158-7bab-43de-95fe-8cd211b5d18f admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:22.556853 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195f2158-7bab-43de-95fe-8cd211b5d18f admin admin] PATH_INFO: `/v3/domains` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:22.557660 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195f2158-7bab-43de-95fe-8cd211b5d18f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:32:22.557974 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195f2158-7bab-43de-95fe-8cd211b5d18f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:22.566902 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195f2158-7bab-43de-95fe-8cd211b5d18f admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:22.573243 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93c10b9-943d-47b4-a350-a844a95de04d None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:22.585803 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d453de0-e0bb-4a45-8b1c-ec6a9b240250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:22.586464 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d453de0-e0bb-4a45-8b1c-ec6a9b240250 admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:22.591265 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d453de0-e0bb-4a45-8b1c-ec6a9b240250 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:22.591855 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d453de0-e0bb-4a45-8b1c-ec6a9b240250 admin admin] PATH_INFO: `/v3/domains` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:22.594865 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d453de0-e0bb-4a45-8b1c-ec6a9b240250 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:32:22.595075 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d453de0-e0bb-4a45-8b1c-ec6a9b240250 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:22.601684 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d453de0-e0bb-4a45-8b1c-ec6a9b240250 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:22.659586 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 892/1809] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Sep 9 16:32:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:32:22.660285 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 918/1810] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Sep 9 16:32:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:32:22.660734 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d453de0-e0bb-4a45-8b1c-ec6a9b240250 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:22.664154 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195f2158-7bab-43de-95fe-8cd211b5d18f admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:22.685472 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195f2158-7bab-43de-95fe-8cd211b5d18f admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:22.694761 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d453de0-e0bb-4a45-8b1c-ec6a9b240250 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:22.695524 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ccffb5-a036-490a-b3c0-e79720646ec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:22.696215 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ccffb5-a036-490a-b3c0-e79720646ec3 admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:22.696418 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ccffb5-a036-490a-b3c0-e79720646ec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:22.699296 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ccffb5-a036-490a-b3c0-e79720646ec3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:22.699915 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ccffb5-a036-490a-b3c0-e79720646ec3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:22.704108 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ccffb5-a036-490a-b3c0-e79720646ec3 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:22.718992 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceff5a1-b4bc-4c07-95c1-b5e5901e7d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:22.719609 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceff5a1-b4bc-4c07-95c1-b5e5901e7d1d admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:22.719886 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceff5a1-b4bc-4c07-95c1-b5e5901e7d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:22.720151 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceff5a1-b4bc-4c07-95c1-b5e5901e7d1d admin admin] PATH_INFO: `/v3/projects` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:22.720782 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ceff5a1-b4bc-4c07-95c1-b5e5901e7d1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:22.722717 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ceff5a1-b4bc-4c07-95c1-b5e5901e7d1d admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:22.788249 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 919/1811] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 16:32:22 2022] POST /identity/v3/projects => generated 375 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:32:22.792971 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ccffb5-a036-490a-b3c0-e79720646ec3 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:22.809979 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 893/1812] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 16:32:22 2022] POST /identity/v3/projects => generated 391 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:32:22.814981 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceff5a1-b4bc-4c07-95c1-b5e5901e7d1d admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:22.939553 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:32:22.978710 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceff5a1-b4bc-4c07-95c1-b5e5901e7d1d admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:22.990786 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76b2f5a-7c9a-4d1c-8217-d1c5f67339f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:22.993176 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76b2f5a-7c9a-4d1c-8217-d1c5f67339f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:22.993433 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76b2f5a-7c9a-4d1c-8217-d1c5f67339f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:22.993701 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76b2f5a-7c9a-4d1c-8217-d1c5f67339f6 admin admin] PATH_INFO: `/v3/users` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:22.995497 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76b2f5a-7c9a-4d1c-8217-d1c5f67339f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:22.999629 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76b2f5a-7c9a-4d1c-8217-d1c5f67339f6 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:23.004547 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ccffb5-a036-490a-b3c0-e79720646ec3 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:23.021541 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2ae55a-773b-4c0d-a934-893157d4d06e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:23.022229 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2ae55a-773b-4c0d-a934-893157d4d06e admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:23.025126 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2ae55a-773b-4c0d-a934-893157d4d06e admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:23.025126 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2ae55a-773b-4c0d-a934-893157d4d06e admin admin] PATH_INFO: `/v3/users` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:23.026915 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2ae55a-773b-4c0d-a934-893157d4d06e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:23.032986 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2ae55a-773b-4c0d-a934-893157d4d06e admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:23.058454 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 894/1813] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 16:32:22 2022] POST /identity/v3/users => generated 296 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:32:23.059185 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76b2f5a-7c9a-4d1c-8217-d1c5f67339f6 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:23.062247 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-d76b2f5a-7c9a-4d1c-8217-d1c5f67339f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:23.079982 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76b2f5a-7c9a-4d1c-8217-d1c5f67339f6 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:23.085422 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f604c90-e07a-4dda-83f2-8ba5536cf583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:23.086053 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f604c90-e07a-4dda-83f2-8ba5536cf583 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:23.086951 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f604c90-e07a-4dda-83f2-8ba5536cf583 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:23.086951 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f604c90-e07a-4dda-83f2-8ba5536cf583 admin admin] PATH_INFO: `/v3/projects/9eb29ac2ae5e406fbedc2a1cb7f9ea72` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:23.088953 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f604c90-e07a-4dda-83f2-8ba5536cf583 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9eb29ac2ae5e406fbedc2a1cb7f9ea72)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:23.092929 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f604c90-e07a-4dda-83f2-8ba5536cf583 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:23.128995 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 920/1814] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 16:32:22 2022] POST /identity/v3/users => generated 288 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:32:23.128995 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2ae55a-773b-4c0d-a934-893157d4d06e admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:23.164700 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2ae55a-773b-4c0d-a934-893157d4d06e admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:23.188538 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-0f604c90-e07a-4dda-83f2-8ba5536cf583 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9eb29ac2ae5e406fbedc2a1cb7f9ea72', 'request_id': 'req-0f604c90-e07a-4dda-83f2-8ba5536cf583'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:23.196736 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-0f604c90-e07a-4dda-83f2-8ba5536cf583 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9eb29ac2ae5e406fbedc2a1cb7f9ea72', 'request_id': 'req-0f604c90-e07a-4dda-83f2-8ba5536cf583'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:23.220033 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-0f604c90-e07a-4dda-83f2-8ba5536cf583 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9eb29ac2ae5e406fbedc2a1cb7f9ea72', 'request_id': 'req-0f604c90-e07a-4dda-83f2-8ba5536cf583'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:23.234928 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-0f604c90-e07a-4dda-83f2-8ba5536cf583 admin admin] The token cache is being invalidate because project 9eb29ac2ae5e406fbedc2a1cb7f9ea72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81445) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 16:32:23.235231 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-0f604c90-e07a-4dda-83f2-8ba5536cf583 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:23.235908 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-0f604c90-e07a-4dda-83f2-8ba5536cf583 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:23.244025 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 895/1815] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 16:32:23 2022] DELETE /identity/v3/projects/9eb29ac2ae5e406fbedc2a1cb7f9ea72 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:32:23.245291 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f604c90-e07a-4dda-83f2-8ba5536cf583 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:23.247882 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-0f604c90-e07a-4dda-83f2-8ba5536cf583 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:23.368875 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f604c90-e07a-4dda-83f2-8ba5536cf583 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:23.375566 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71c9edd-8d57-4b02-bde2-83be54e76cc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:23.377057 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71c9edd-8d57-4b02-bde2-83be54e76cc6 admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:23.377673 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71c9edd-8d57-4b02-bde2-83be54e76cc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:23.377957 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71c9edd-8d57-4b02-bde2-83be54e76cc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:23.378792 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71c9edd-8d57-4b02-bde2-83be54e76cc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:23.381155 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71c9edd-8d57-4b02-bde2-83be54e76cc6 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:23.400099 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 896/1816] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:32:23 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:32:23.400311 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e1aad4-219d-4eb3-a4ce-1c75eeb5b50a None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:23.400654 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e1aad4-219d-4eb3-a4ce-1c75eeb5b50a None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:23.401332 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e1aad4-219d-4eb3-a4ce-1c75eeb5b50a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:23.437861 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-f3e1aad4-219d-4eb3-a4ce-1c75eeb5b50a None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:32:23.439258 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-f3e1aad4-219d-4eb3-a4ce-1c75eeb5b50a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:23.440202 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910409ed-e8d5-4cc9-962d-ff631363fe1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:23.441096 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910409ed-e8d5-4cc9-962d-ff631363fe1f admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:23.441379 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910409ed-e8d5-4cc9-962d-ff631363fe1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:23.441656 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910409ed-e8d5-4cc9-962d-ff631363fe1f admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:23.442328 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910409ed-e8d5-4cc9-962d-ff631363fe1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:23.443939 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910409ed-e8d5-4cc9-962d-ff631363fe1f admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:23.450366 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 897/1817] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:32:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:32:23.460208 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e1aad4-219d-4eb3-a4ce-1c75eeb5b50a None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:23.485854 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e1aad4-219d-4eb3-a4ce-1c75eeb5b50a None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:23.496159 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 921/1818] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:32:23 2022] GET /identity/v3/roles => generated 1420 bytes in 368 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:32:23.497839 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684a36f3-5a12-4ebe-9d9d-82fb732464af None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:23.498327 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684a36f3-5a12-4ebe-9d9d-82fb732464af None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:23.498696 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684a36f3-5a12-4ebe-9d9d-82fb732464af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:23.501899 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463875a7-e448-4aac-ab67-5422c1f392ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:23.503862 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463875a7-e448-4aac-ab67-5422c1f392ce admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:23.505200 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463875a7-e448-4aac-ab67-5422c1f392ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:23.505702 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463875a7-e448-4aac-ab67-5422c1f392ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:23.507979 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463875a7-e448-4aac-ab67-5422c1f392ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:23.512382 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463875a7-e448-4aac-ab67-5422c1f392ce admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:23.531728 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-684a36f3-5a12-4ebe-9d9d-82fb732464af None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:32:23.534082 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-684a36f3-5a12-4ebe-9d9d-82fb732464af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:23.540860 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 898/1819] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:32:23 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:32:23.547739 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 922/1820] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:32:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:32:23.557205 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463875a7-e448-4aac-ab67-5422c1f392ce admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:23.557537 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684a36f3-5a12-4ebe-9d9d-82fb732464af None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:23.560538 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-463875a7-e448-4aac-ab67-5422c1f392ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:23.581453 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684a36f3-5a12-4ebe-9d9d-82fb732464af None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:23.581691 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463875a7-e448-4aac-ab67-5422c1f392ce admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:23.591074 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedae620-44ae-4d16-85fd-58ee9fa3f9d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:23.591698 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedae620-44ae-4d16-85fd-58ee9fa3f9d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:23.592509 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedae620-44ae-4d16-85fd-58ee9fa3f9d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:23.592789 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedae620-44ae-4d16-85fd-58ee9fa3f9d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:23.594236 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedae620-44ae-4d16-85fd-58ee9fa3f9d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:23.597000 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedae620-44ae-4d16-85fd-58ee9fa3f9d6 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:23.598280 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e52a3e-270f-442d-95db-f1b2b9a0c688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:23.599136 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e52a3e-270f-442d-95db-f1b2b9a0c688 admin admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:23.599589 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e52a3e-270f-442d-95db-f1b2b9a0c688 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:23.599698 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e52a3e-270f-442d-95db-f1b2b9a0c688 admin admin] PATH_INFO: `/v3/projects/b9d7a11fdf5040c49c29efaf86025b71/users/0e0dbade6d354dba86a0d318013b4f88/roles/b38e84bf077846ee802e6bb1bad83522` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:23.620497 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 899/1821] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:32:23 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:32:23.620497 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedae620-44ae-4d16-85fd-58ee9fa3f9d6 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:23.640747 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedae620-44ae-4d16-85fd-58ee9fa3f9d6 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:23.657144 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6615522e-cfc5-47bf-bbae-28c511cc40fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:23.660439 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6615522e-cfc5-47bf-bbae-28c511cc40fd admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:23.661572 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6615522e-cfc5-47bf-bbae-28c511cc40fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:23.661863 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6615522e-cfc5-47bf-bbae-28c511cc40fd admin admin] PATH_INFO: `/v3/domains` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:23.662094 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e52a3e-270f-442d-95db-f1b2b9a0c688 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9d7a11fdf5040c49c29efaf86025b71, user_id=0e0dbade6d354dba86a0d318013b4f88, role_id=b38e84bf077846ee802e6bb1bad83522)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:23.662720 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6615522e-cfc5-47bf-bbae-28c511cc40fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:32:23.663031 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6615522e-cfc5-47bf-bbae-28c511cc40fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:23.665717 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6615522e-cfc5-47bf-bbae-28c511cc40fd admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:23.671613 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e52a3e-270f-442d-95db-f1b2b9a0c688 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:23.687319 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 900/1822] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Sep 9 16:32:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:32:23.695186 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6615522e-cfc5-47bf-bbae-28c511cc40fd admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:23.708225 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:32:23.719270 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6615522e-cfc5-47bf-bbae-28c511cc40fd admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:23.727709 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 923/1823] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 16:32:23 2022] PUT /identity/v3/projects/b9d7a11fdf5040c49c29efaf86025b71/users/0e0dbade6d354dba86a0d318013b4f88/roles/b38e84bf077846ee802e6bb1bad83522 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:32:23.728435 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e52a3e-270f-442d-95db-f1b2b9a0c688 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:23.743458 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:32:23.899124 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c2cdc5-a418-47a2-a2da-7b35cd0e99a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:23.901346 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c2cdc5-a418-47a2-a2da-7b35cd0e99a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:23.901817 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c2cdc5-a418-47a2-a2da-7b35cd0e99a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:23.902272 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c2cdc5-a418-47a2-a2da-7b35cd0e99a1 admin admin] PATH_INFO: `/v3/projects/23744323f8e6446c83dcf55cc1308315/users/089d3203e8ca4c85994146dd821dbe0b/roles/b38e84bf077846ee802e6bb1bad83522` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:23.930415 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c2cdc5-a418-47a2-a2da-7b35cd0e99a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23744323f8e6446c83dcf55cc1308315, user_id=089d3203e8ca4c85994146dd821dbe0b, role_id=b38e84bf077846ee802e6bb1bad83522)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:23.940528 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c2cdc5-a418-47a2-a2da-7b35cd0e99a1 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:23.945120 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e52a3e-270f-442d-95db-f1b2b9a0c688 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:23.957428 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7317e606-af7c-4647-b326-781b7415968e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:23.961035 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7317e606-af7c-4647-b326-781b7415968e admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:23.962056 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7317e606-af7c-4647-b326-781b7415968e admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:23.963291 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7317e606-af7c-4647-b326-781b7415968e admin admin] PATH_INFO: `/v3/projects` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:23.965433 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7317e606-af7c-4647-b326-781b7415968e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:23.969200 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 901/1824] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 16:32:23 2022] PUT /identity/v3/projects/23744323f8e6446c83dcf55cc1308315/users/089d3203e8ca4c85994146dd821dbe0b/roles/b38e84bf077846ee802e6bb1bad83522 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:32:23.970944 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a92a9c-d90a-4912-bc30-de2fcd9ae235 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:23.972362 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a92a9c-d90a-4912-bc30-de2fcd9ae235 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:23.972763 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7317e606-af7c-4647-b326-781b7415968e admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:23.974461 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a92a9c-d90a-4912-bc30-de2fcd9ae235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:24.032308 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 924/1825] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 16:32:23 2022] POST /identity/v3/projects => generated 355 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:32:24.033636 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7317e606-af7c-4647-b326-781b7415968e admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:24.036761 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-7317e606-af7c-4647-b326-781b7415968e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:24.044410 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-d9a92a9c-d90a-4912-bc30-de2fcd9ae235 None None] MFA Rules not processed for user `0e0dbade6d354dba86a0d318013b4f88`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:32:24.049143 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-d9a92a9c-d90a-4912-bc30-de2fcd9ae235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:24.181974 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7317e606-af7c-4647-b326-781b7415968e admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:24.191452 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa20b7f-9ec3-4989-9b6d-39076b2e723c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a332b9b4980646a3b14633293f77b505', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:24.192588 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa20b7f-9ec3-4989-9b6d-39076b2e723c service nova] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:24.192881 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa20b7f-9ec3-4989-9b6d-39076b2e723c service nova] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:24.193169 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa20b7f-9ec3-4989-9b6d-39076b2e723c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:24.195091 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-daa20b7f-9ec3-4989-9b6d-39076b2e723c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:24.201965 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 902/1826] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:32:23 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:32:24.203802 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161630b7-c95e-4ace-b6ac-1c66400206db None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:24.204288 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161630b7-c95e-4ace-b6ac-1c66400206db None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:24.204716 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161630b7-c95e-4ace-b6ac-1c66400206db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:24.212171 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa20b7f-9ec3-4989-9b6d-39076b2e723c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:24.213972 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa20b7f-9ec3-4989-9b6d-39076b2e723c service nova] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:24.236926 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 925/1827] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:32:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:32:24.238948 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa20b7f-9ec3-4989-9b6d-39076b2e723c service nova] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:24.241509 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-161630b7-c95e-4ace-b6ac-1c66400206db None None] MFA Rules not processed for user `089d3203e8ca4c85994146dd821dbe0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:32:24.243211 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-161630b7-c95e-4ace-b6ac-1c66400206db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:24.367284 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa20b7f-9ec3-4989-9b6d-39076b2e723c service nova] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:24.376788 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1f6786-56f9-4cbb-b4b9-29b37cc8ddad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:24.377603 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1f6786-56f9-4cbb-b4b9-29b37cc8ddad admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:24.378147 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1f6786-56f9-4cbb-b4b9-29b37cc8ddad admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:24.378558 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1f6786-56f9-4cbb-b4b9-29b37cc8ddad admin admin] PATH_INFO: `/v3/users` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:24.379293 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1f6786-56f9-4cbb-b4b9-29b37cc8ddad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:24.380357 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 903/1828] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:32:24 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:32:24.381212 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161630b7-c95e-4ace-b6ac-1c66400206db None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:24.381648 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1f6786-56f9-4cbb-b4b9-29b37cc8ddad admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:24.392428 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161630b7-c95e-4ace-b6ac-1c66400206db None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:24.405620 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0d3d0a-1e83-406d-b96a-3d36458b079a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:24.407387 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0d3d0a-1e83-406d-b96a-3d36458b079a admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:24.407654 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0d3d0a-1e83-406d-b96a-3d36458b079a admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:24.407927 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0d3d0a-1e83-406d-b96a-3d36458b079a admin admin] PATH_INFO: `/v3/projects` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:24.408564 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0d3d0a-1e83-406d-b96a-3d36458b079a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:24.410570 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0d3d0a-1e83-406d-b96a-3d36458b079a admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:24.423348 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:32:24.444578 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:32:24.454063 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 926/1829] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 16:32:24 2022] POST /identity/v3/users => generated 278 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:32:24.454063 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1f6786-56f9-4cbb-b4b9-29b37cc8ddad admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:24.474609 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1f6786-56f9-4cbb-b4b9-29b37cc8ddad admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:24.481950 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d716d48-b15a-4728-af8c-6109ed7cc6f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:24.483071 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d716d48-b15a-4728-af8c-6109ed7cc6f5 admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:24.483549 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d716d48-b15a-4728-af8c-6109ed7cc6f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:24.483888 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d716d48-b15a-4728-af8c-6109ed7cc6f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:24.484676 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d716d48-b15a-4728-af8c-6109ed7cc6f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:24.487452 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d716d48-b15a-4728-af8c-6109ed7cc6f5 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:24.491806 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 904/1830] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 16:32:24 2022] POST /identity/v3/projects => generated 377 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:32:24.491806 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0d3d0a-1e83-406d-b96a-3d36458b079a admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:24.581080 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0d3d0a-1e83-406d-b96a-3d36458b079a admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:24.584097 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 927/1831] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 16:32:24 2022] POST /identity/v3/projects => generated 393 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:32:24.585154 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d716d48-b15a-4728-af8c-6109ed7cc6f5 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:24.657727 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2d0cc7-b2e2-4749-b70b-da10557c73ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:24.658358 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2d0cc7-b2e2-4749-b70b-da10557c73ed admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:24.658636 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2d0cc7-b2e2-4749-b70b-da10557c73ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:24.659159 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2d0cc7-b2e2-4749-b70b-da10557c73ed admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:24.659533 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2d0cc7-b2e2-4749-b70b-da10557c73ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:24.661265 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2d0cc7-b2e2-4749-b70b-da10557c73ed admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:24.675246 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 905/1832] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:32:24 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:32:24.679467 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2d0cc7-b2e2-4749-b70b-da10557c73ed admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:24.692906 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2d0cc7-b2e2-4749-b70b-da10557c73ed admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:24.693795 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d716d48-b15a-4728-af8c-6109ed7cc6f5 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:24.698790 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3869805a-62e3-45c4-9594-a1135a825da3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:24.699479 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3869805a-62e3-45c4-9594-a1135a825da3 admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:24.700129 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3869805a-62e3-45c4-9594-a1135a825da3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:24.700129 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3869805a-62e3-45c4-9594-a1135a825da3 admin admin] PATH_INFO: `/v3/users` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:24.700625 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3869805a-62e3-45c4-9594-a1135a825da3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:24.701667 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1518ea-3594-4339-865e-ab76fa963eb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:24.702428 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1518ea-3594-4339-865e-ab76fa963eb5 admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:24.702778 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1518ea-3594-4339-865e-ab76fa963eb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:24.703124 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1518ea-3594-4339-865e-ab76fa963eb5 admin admin] PATH_INFO: `/v3/users` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:24.703252 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3869805a-62e3-45c4-9594-a1135a825da3 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:24.703788 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1518ea-3594-4339-865e-ab76fa963eb5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:24.708785 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1518ea-3594-4339-865e-ab76fa963eb5 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:24.737302 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 928/1833] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 16:32:24 2022] POST /identity/v3/users => generated 295 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:32:24.738618 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1518ea-3594-4339-865e-ab76fa963eb5 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:24.740030 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 906/1834] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 16:32:24 2022] POST /identity/v3/users => generated 303 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:32:24.742248 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3869805a-62e3-45c4-9594-a1135a825da3 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:24.775899 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3869805a-62e3-45c4-9594-a1135a825da3 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:24.782379 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1518ea-3594-4339-865e-ab76fa963eb5 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:24.788604 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e756d90b-309d-4a86-b435-5e100d5bfcb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:24.790759 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e756d90b-309d-4a86-b435-5e100d5bfcb8 admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:24.793376 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e756d90b-309d-4a86-b435-5e100d5bfcb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:24.793682 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e756d90b-309d-4a86-b435-5e100d5bfcb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:24.794348 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e756d90b-309d-4a86-b435-5e100d5bfcb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:24.796121 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e756d90b-309d-4a86-b435-5e100d5bfcb8 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:24.803552 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07724efb-cc3e-4bbd-8904-91454b2c5f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:24.804307 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07724efb-cc3e-4bbd-8904-91454b2c5f02 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:24.804584 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07724efb-cc3e-4bbd-8904-91454b2c5f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:24.804843 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07724efb-cc3e-4bbd-8904-91454b2c5f02 admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:24.805610 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07724efb-cc3e-4bbd-8904-91454b2c5f02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:24.807434 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07724efb-cc3e-4bbd-8904-91454b2c5f02 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:24.830772 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 907/1835] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:32:24 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 16:32:24.831670 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e756d90b-309d-4a86-b435-5e100d5bfcb8 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:24.857041 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e756d90b-309d-4a86-b435-5e100d5bfcb8 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:24.871062 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 929/1836] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:32:24 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:32:24.871062 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07724efb-cc3e-4bbd-8904-91454b2c5f02 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:24.880205 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7856c0-e268-4e45-88c8-2aaddef59b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:24.881006 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7856c0-e268-4e45-88c8-2aaddef59b53 admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:24.881904 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7856c0-e268-4e45-88c8-2aaddef59b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:24.882545 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7856c0-e268-4e45-88c8-2aaddef59b53 admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:24.884780 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7856c0-e268-4e45-88c8-2aaddef59b53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:24.888320 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7856c0-e268-4e45-88c8-2aaddef59b53 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:24.906298 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07724efb-cc3e-4bbd-8904-91454b2c5f02 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:24.927807 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c912d7b-2462-4cc3-a08b-18e97f228c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:24.929100 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 908/1837] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:32:24 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:32:24.929374 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c912d7b-2462-4cc3-a08b-18e97f228c75 admin admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:24.929835 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c912d7b-2462-4cc3-a08b-18e97f228c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:24.929980 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7856c0-e268-4e45-88c8-2aaddef59b53 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:24.935413 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c912d7b-2462-4cc3-a08b-18e97f228c75 admin admin] PATH_INFO: `/v3/projects/d73fe898cd614f938d64d07affb978bc/users/c7f9f535bc344b6ab2749666fce151a1/roles/0a36d1be416f4089be19be979943b731` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:24.941608 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7856c0-e268-4e45-88c8-2aaddef59b53 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:24.947831 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ea0ccf-6394-499b-8e83-6bc34f57a89d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:24.948607 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ea0ccf-6394-499b-8e83-6bc34f57a89d admin admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:24.948964 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ea0ccf-6394-499b-8e83-6bc34f57a89d admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:24.949337 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ea0ccf-6394-499b-8e83-6bc34f57a89d admin admin] PATH_INFO: `/v3/projects/46e93cf2ec4b49168be7d648df93a5d6/users/b61390bea3554473a3c2d758f4427755/roles/b38e84bf077846ee802e6bb1bad83522` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:24.964129 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c912d7b-2462-4cc3-a08b-18e97f228c75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d73fe898cd614f938d64d07affb978bc, user_id=c7f9f535bc344b6ab2749666fce151a1, role_id=0a36d1be416f4089be19be979943b731)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:24.967145 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c912d7b-2462-4cc3-a08b-18e97f228c75 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:24.974012 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ea0ccf-6394-499b-8e83-6bc34f57a89d admin admin] RBAC: Authorizing `identity:create_grant(project_id=46e93cf2ec4b49168be7d648df93a5d6, user_id=b61390bea3554473a3c2d758f4427755, role_id=b38e84bf077846ee802e6bb1bad83522)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:24.977004 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ea0ccf-6394-499b-8e83-6bc34f57a89d admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:24.993162 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 930/1838] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 16:32:24 2022] PUT /identity/v3/projects/d73fe898cd614f938d64d07affb978bc/users/c7f9f535bc344b6ab2749666fce151a1/roles/0a36d1be416f4089be19be979943b731 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:32:24.994275 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c912d7b-2462-4cc3-a08b-18e97f228c75 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:24.996518 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 909/1839] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 16:32:24 2022] PUT /identity/v3/projects/46e93cf2ec4b49168be7d648df93a5d6/users/b61390bea3554473a3c2d758f4427755/roles/b38e84bf077846ee802e6bb1bad83522 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:32:24.997366 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ea0ccf-6394-499b-8e83-6bc34f57a89d admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:25.030700 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:32:25.069013 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ea0ccf-6394-499b-8e83-6bc34f57a89d admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:25.071728 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c912d7b-2462-4cc3-a08b-18e97f228c75 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:25.073465 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880ece62-7de4-4f29-9f7b-5ddc23c1faa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:25.074061 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880ece62-7de4-4f29-9f7b-5ddc23c1faa4 admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:25.074365 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880ece62-7de4-4f29-9f7b-5ddc23c1faa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:25.074634 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880ece62-7de4-4f29-9f7b-5ddc23c1faa4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:25.075253 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880ece62-7de4-4f29-9f7b-5ddc23c1faa4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:25.076947 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3bcaf3-6d5c-4c08-9499-1352697f1663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:25.077420 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880ece62-7de4-4f29-9f7b-5ddc23c1faa4 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:25.077604 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3bcaf3-6d5c-4c08-9499-1352697f1663 admin admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:25.077879 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3bcaf3-6d5c-4c08-9499-1352697f1663 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:25.078146 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3bcaf3-6d5c-4c08-9499-1352697f1663 admin admin] PATH_INFO: `/v3/projects/5a7931b05cbb4516811309a88d2cbcc5/users/23e1b02f39a149ab98a97602c8719d04/roles/0a36d1be416f4089be19be979943b731` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:25.087121 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 910/1840] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:32:24 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:32:25.087121 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b7748e-8dde-4550-a30c-a71e0070ea34 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:25.087121 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b7748e-8dde-4550-a30c-a71e0070ea34 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:25.087121 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b7748e-8dde-4550-a30c-a71e0070ea34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:25.096105 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3bcaf3-6d5c-4c08-9499-1352697f1663 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a7931b05cbb4516811309a88d2cbcc5, user_id=23e1b02f39a149ab98a97602c8719d04, role_id=0a36d1be416f4089be19be979943b731)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:25.098979 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3bcaf3-6d5c-4c08-9499-1352697f1663 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:25.111866 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 931/1841] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 16:32:24 2022] PUT /identity/v3/projects/5a7931b05cbb4516811309a88d2cbcc5/users/23e1b02f39a149ab98a97602c8719d04/roles/0a36d1be416f4089be19be979943b731 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:32:25.112642 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3bcaf3-6d5c-4c08-9499-1352697f1663 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:25.115794 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-f8b7748e-8dde-4550-a30c-a71e0070ea34 None None] MFA Rules not processed for user `b61390bea3554473a3c2d758f4427755`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:32:25.117056 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-f8b7748e-8dde-4550-a30c-a71e0070ea34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:25.133211 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:32:25.179158 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3bcaf3-6d5c-4c08-9499-1352697f1663 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:25.181775 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 911/1842] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:32:25 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:32:25.182650 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b7748e-8dde-4550-a30c-a71e0070ea34 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:25.184052 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ea02ef-9d28-4053-a30a-99875c13d6f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:25.184700 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ea02ef-9d28-4053-a30a-99875c13d6f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:25.185082 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ea02ef-9d28-4053-a30a-99875c13d6f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:25.186135 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ea02ef-9d28-4053-a30a-99875c13d6f0 admin admin] PATH_INFO: `/v3/projects/d73fe898cd614f938d64d07affb978bc/users/c7f9f535bc344b6ab2749666fce151a1/roles/0a36d1be416f4089be19be979943b731` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:25.188072 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ea02ef-9d28-4053-a30a-99875c13d6f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d73fe898cd614f938d64d07affb978bc, user_id=c7f9f535bc344b6ab2749666fce151a1, role_id=0a36d1be416f4089be19be979943b731)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:25.190980 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ea02ef-9d28-4053-a30a-99875c13d6f0 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:25.193463 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b7748e-8dde-4550-a30c-a71e0070ea34 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:25.198087 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9800dfde-b56e-4ed2-b5b4-d915a3e6bade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:25.198712 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9800dfde-b56e-4ed2-b5b4-d915a3e6bade admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:25.198983 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9800dfde-b56e-4ed2-b5b4-d915a3e6bade admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:25.199256 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9800dfde-b56e-4ed2-b5b4-d915a3e6bade admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:25.199911 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9800dfde-b56e-4ed2-b5b4-d915a3e6bade admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:25.201142 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 932/1843] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 16:32:25 2022] PUT /identity/v3/projects/d73fe898cd614f938d64d07affb978bc/users/c7f9f535bc344b6ab2749666fce151a1/roles/0a36d1be416f4089be19be979943b731 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:32:25.201590 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9800dfde-b56e-4ed2-b5b4-d915a3e6bade admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:25.202039 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ea02ef-9d28-4053-a30a-99875c13d6f0 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:25.220216 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 912/1844] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:32:25 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:32:25.221575 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e157ba-b72d-47ea-8fe5-e1c02c858f05 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:25.221872 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e157ba-b72d-47ea-8fe5-e1c02c858f05 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:25.222122 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e157ba-b72d-47ea-8fe5-e1c02c858f05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:25.253240 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-42e157ba-b72d-47ea-8fe5-e1c02c858f05 None None] MFA Rules not processed for user `c7f9f535bc344b6ab2749666fce151a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:32:25.254644 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-42e157ba-b72d-47ea-8fe5-e1c02c858f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:25.269001 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ea02ef-9d28-4053-a30a-99875c13d6f0 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:25.274116 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35f07d1-122a-4cb3-b37f-3103c623cb74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:25.275206 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35f07d1-122a-4cb3-b37f-3103c623cb74 admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:25.275676 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35f07d1-122a-4cb3-b37f-3103c623cb74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:25.276093 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35f07d1-122a-4cb3-b37f-3103c623cb74 admin admin] PATH_INFO: `/v3/projects` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:25.277550 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35f07d1-122a-4cb3-b37f-3103c623cb74 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:25.280184 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35f07d1-122a-4cb3-b37f-3103c623cb74 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:25.312019 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 933/1845] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 16:32:25 2022] POST /identity/v3/projects => generated 355 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:32:25.312019 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35f07d1-122a-4cb3-b37f-3103c623cb74 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:25.338691 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 913/1846] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:32:25 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:32:25.339501 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e157ba-b72d-47ea-8fe5-e1c02c858f05 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:25.351398 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e157ba-b72d-47ea-8fe5-e1c02c858f05 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:25.376474 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35f07d1-122a-4cb3-b37f-3103c623cb74 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:25.378653 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:32:25.381824 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a82da72-41c0-4a2c-bb8b-7d4d9795dacb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:25.382516 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a82da72-41c0-4a2c-bb8b-7d4d9795dacb admin admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:25.382790 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a82da72-41c0-4a2c-bb8b-7d4d9795dacb admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:25.383053 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a82da72-41c0-4a2c-bb8b-7d4d9795dacb admin admin] PATH_INFO: `/v3/projects/5a7931b05cbb4516811309a88d2cbcc5/users/23e1b02f39a149ab98a97602c8719d04/roles/0a36d1be416f4089be19be979943b731` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:25.384967 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a82da72-41c0-4a2c-bb8b-7d4d9795dacb admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a7931b05cbb4516811309a88d2cbcc5, user_id=23e1b02f39a149ab98a97602c8719d04, role_id=0a36d1be416f4089be19be979943b731)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:25.387628 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a82da72-41c0-4a2c-bb8b-7d4d9795dacb admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:25.398204 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 934/1847] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 16:32:25 2022] PUT /identity/v3/projects/5a7931b05cbb4516811309a88d2cbcc5/users/23e1b02f39a149ab98a97602c8719d04/roles/0a36d1be416f4089be19be979943b731 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:32:25.398808 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a82da72-41c0-4a2c-bb8b-7d4d9795dacb admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:25.400491 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-2a82da72-41c0-4a2c-bb8b-7d4d9795dacb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:25.410857 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44791c83-80fc-4324-b044-7092c5879c9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:25.411461 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44791c83-80fc-4324-b044-7092c5879c9c admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:25.411737 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44791c83-80fc-4324-b044-7092c5879c9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:25.412003 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44791c83-80fc-4324-b044-7092c5879c9c admin admin] PATH_INFO: `/v3/users` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:25.412617 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44791c83-80fc-4324-b044-7092c5879c9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:25.414541 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44791c83-80fc-4324-b044-7092c5879c9c admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:25.436175 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 914/1848] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 16:32:25 2022] POST /identity/v3/users => generated 284 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:32:25.440670 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:32:25.440914 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9838e4d-6c41-4c29-b440-e629c14f775b None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:25.441098 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9838e4d-6c41-4c29-b440-e629c14f775b None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:25.441376 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9838e4d-6c41-4c29-b440-e629c14f775b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:25.471877 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-e9838e4d-6c41-4c29-b440-e629c14f775b None None] MFA Rules not processed for user `23e1b02f39a149ab98a97602c8719d04`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:32:25.472510 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a82da72-41c0-4a2c-bb8b-7d4d9795dacb admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:25.473212 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-e9838e4d-6c41-4c29-b440-e629c14f775b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:25.476176 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7068344f-8a0d-4a7a-97ed-cf537a649767 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8078e791ba68460f8b3aeafb4b79b73a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:25.476797 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7068344f-8a0d-4a7a-97ed-cf537a649767 service cinder] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:25.477229 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7068344f-8a0d-4a7a-97ed-cf537a649767 service cinder] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:25.477500 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7068344f-8a0d-4a7a-97ed-cf537a649767 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:25.543534 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7068344f-8a0d-4a7a-97ed-cf537a649767 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:25.545067 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7068344f-8a0d-4a7a-97ed-cf537a649767 service cinder] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:25.547996 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 915/1849] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:32:25 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:32:25.552954 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9838e4d-6c41-4c29-b440-e629c14f775b None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:25.558708 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 935/1850] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:32:25 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:32:25.561072 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7068344f-8a0d-4a7a-97ed-cf537a649767 service cinder] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:25.563907 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-7068344f-8a0d-4a7a-97ed-cf537a649767 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:25.592516 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7068344f-8a0d-4a7a-97ed-cf537a649767 service cinder] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:25.596746 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484dd1a5-411c-4575-8a11-9b7fd4f07d5a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8078e791ba68460f8b3aeafb4b79b73a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:25.597352 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484dd1a5-411c-4575-8a11-9b7fd4f07d5a service cinder] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:25.597625 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484dd1a5-411c-4575-8a11-9b7fd4f07d5a service cinder] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:25.597893 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484dd1a5-411c-4575-8a11-9b7fd4f07d5a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:25.624849 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484dd1a5-411c-4575-8a11-9b7fd4f07d5a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:25.626296 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484dd1a5-411c-4575-8a11-9b7fd4f07d5a service cinder] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:25.631551 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9838e4d-6c41-4c29-b440-e629c14f775b None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:25.642042 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926dee75-0448-40fd-8074-af4bd44e5428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:25.642930 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926dee75-0448-40fd-8074-af4bd44e5428 admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:25.643287 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926dee75-0448-40fd-8074-af4bd44e5428 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:25.643631 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926dee75-0448-40fd-8074-af4bd44e5428 admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:25.645132 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926dee75-0448-40fd-8074-af4bd44e5428 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:25.647273 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926dee75-0448-40fd-8074-af4bd44e5428 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:25.655320 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 936/1851] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:32:25 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:32:25.672612 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 916/1852] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:32:25 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:32:25.677041 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484dd1a5-411c-4575-8a11-9b7fd4f07d5a service cinder] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:25.688340 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484dd1a5-411c-4575-8a11-9b7fd4f07d5a service cinder] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:25.699668 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45da5662-4723-4ade-bd96-64f196ee5f19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:25.700685 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45da5662-4723-4ade-bd96-64f196ee5f19 admin admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:25.701895 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45da5662-4723-4ade-bd96-64f196ee5f19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:25.702386 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45da5662-4723-4ade-bd96-64f196ee5f19 admin admin] PATH_INFO: `/v3/projects/eeea2b28a837492781571c6319fe7343/users/ff263d9807364222b97a8afab79c01e3/roles/0a36d1be416f4089be19be979943b731` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:25.727790 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45da5662-4723-4ade-bd96-64f196ee5f19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eeea2b28a837492781571c6319fe7343, user_id=ff263d9807364222b97a8afab79c01e3, role_id=0a36d1be416f4089be19be979943b731)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:25.730552 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45da5662-4723-4ade-bd96-64f196ee5f19 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:25.749923 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926dee75-0448-40fd-8074-af4bd44e5428 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:25.765460 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 937/1853] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 16:32:25 2022] PUT /identity/v3/projects/eeea2b28a837492781571c6319fe7343/users/ff263d9807364222b97a8afab79c01e3/roles/0a36d1be416f4089be19be979943b731 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:32:25.768052 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926dee75-0448-40fd-8074-af4bd44e5428 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:25.774252 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45da5662-4723-4ade-bd96-64f196ee5f19 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:25.834682 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:32:25.851090 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0533ffbd-e15f-451f-a6f3-bcb86d629d34 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8078e791ba68460f8b3aeafb4b79b73a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:25.851644 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0533ffbd-e15f-451f-a6f3-bcb86d629d34 service cinder] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:25.854255 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0533ffbd-e15f-451f-a6f3-bcb86d629d34 service cinder] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:25.854255 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0533ffbd-e15f-451f-a6f3-bcb86d629d34 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:25.854516 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45da5662-4723-4ade-bd96-64f196ee5f19 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:25.859187 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebab5e0-63d0-441f-9214-7196acac1017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:25.860406 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebab5e0-63d0-441f-9214-7196acac1017 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:25.860764 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebab5e0-63d0-441f-9214-7196acac1017 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:25.861111 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebab5e0-63d0-441f-9214-7196acac1017 admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:25.861937 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebab5e0-63d0-441f-9214-7196acac1017 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:25.863661 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebab5e0-63d0-441f-9214-7196acac1017 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:25.879208 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 938/1854] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:32:25 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:32:25.880626 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebab5e0-63d0-441f-9214-7196acac1017 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:25.906350 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebab5e0-63d0-441f-9214-7196acac1017 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:25.911550 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca57b26-65c3-4a3e-8e1c-384581ff78c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:25.912521 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca57b26-65c3-4a3e-8e1c-384581ff78c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:25.912876 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca57b26-65c3-4a3e-8e1c-384581ff78c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:25.913225 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca57b26-65c3-4a3e-8e1c-384581ff78c5 admin admin] PATH_INFO: `/v3/projects/eeea2b28a837492781571c6319fe7343/users/ff263d9807364222b97a8afab79c01e3/roles/0a36d1be416f4089be19be979943b731` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:25.915635 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca57b26-65c3-4a3e-8e1c-384581ff78c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eeea2b28a837492781571c6319fe7343, user_id=ff263d9807364222b97a8afab79c01e3, role_id=0a36d1be416f4089be19be979943b731)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:25.926501 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca57b26-65c3-4a3e-8e1c-384581ff78c5 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:25.934757 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0533ffbd-e15f-451f-a6f3-bcb86d629d34 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:25.936799 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0533ffbd-e15f-451f-a6f3-bcb86d629d34 service cinder] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:25.948123 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 939/1856] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 16:32:25 2022] PUT /identity/v3/projects/eeea2b28a837492781571c6319fe7343/users/ff263d9807364222b97a8afab79c01e3/roles/0a36d1be416f4089be19be979943b731 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 16:32:25.950484 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 917/1856] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:32:25 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:32:25.959318 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435ac5dd-f80f-4002-b43c-385ca7dded51 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:25.959707 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435ac5dd-f80f-4002-b43c-385ca7dded51 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:25.960096 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435ac5dd-f80f-4002-b43c-385ca7dded51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:26.004651 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-435ac5dd-f80f-4002-b43c-385ca7dded51 None None] MFA Rules not processed for user `ff263d9807364222b97a8afab79c01e3`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:32:26.005892 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-435ac5dd-f80f-4002-b43c-385ca7dded51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:26.042651 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:32:26.127772 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 940/1857] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:32:25 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:32:26.339637 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0533ffbd-e15f-451f-a6f3-bcb86d629d34 service cinder] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:26.354755 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0533ffbd-e15f-451f-a6f3-bcb86d629d34 service cinder] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:26.446787 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3292a36c-48db-4855-999a-31a221ef79f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8078e791ba68460f8b3aeafb4b79b73a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:26.446787 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3292a36c-48db-4855-999a-31a221ef79f0 service cinder] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:26.446787 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3292a36c-48db-4855-999a-31a221ef79f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:26.446787 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3292a36c-48db-4855-999a-31a221ef79f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:26.454732 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3292a36c-48db-4855-999a-31a221ef79f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:26.456415 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3292a36c-48db-4855-999a-31a221ef79f0 service cinder] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:26.470341 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 918/1858] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:32:26 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:32:26.555996 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435ac5dd-f80f-4002-b43c-385ca7dded51 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:26.566957 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435ac5dd-f80f-4002-b43c-385ca7dded51 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:26.570835 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea11f70-b170-4ca5-a1b3-849787e4eab5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8078e791ba68460f8b3aeafb4b79b73a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:26.571470 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea11f70-b170-4ca5-a1b3-849787e4eab5 service cinder] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:26.571752 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea11f70-b170-4ca5-a1b3-849787e4eab5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:26.572042 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea11f70-b170-4ca5-a1b3-849787e4eab5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:26.635519 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea11f70-b170-4ca5-a1b3-849787e4eab5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:26.636863 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea11f70-b170-4ca5-a1b3-849787e4eab5 service cinder] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:26.647389 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 941/1859] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:32:26 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:32:28.390221 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3292a36c-48db-4855-999a-31a221ef79f0 service cinder] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:28.400354 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3292a36c-48db-4855-999a-31a221ef79f0 service cinder] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:28.410212 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022ac492-e5f8-4773-90d3-95ad87ec1f53 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8078e791ba68460f8b3aeafb4b79b73a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:28.411124 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022ac492-e5f8-4773-90d3-95ad87ec1f53 service cinder] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:28.411554 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022ac492-e5f8-4773-90d3-95ad87ec1f53 service cinder] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:28.411983 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022ac492-e5f8-4773-90d3-95ad87ec1f53 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:28.547371 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022ac492-e5f8-4773-90d3-95ad87ec1f53 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:28.548844 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022ac492-e5f8-4773-90d3-95ad87ec1f53 service cinder] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:28.565695 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 919/1860] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:32:28 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:32:30.567926 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea11f70-b170-4ca5-a1b3-849787e4eab5 service cinder] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:30.658579 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea11f70-b170-4ca5-a1b3-849787e4eab5 service cinder] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:30.665125 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c6836f-71cd-4f45-8197-cd022105b3d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:30.666562 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c6836f-71cd-4f45-8197-cd022105b3d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:30.667091 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c6836f-71cd-4f45-8197-cd022105b3d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:30.667692 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c6836f-71cd-4f45-8197-cd022105b3d2 admin admin] PATH_INFO: `/v3/users/089d3203e8ca4c85994146dd821dbe0b` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:30.668904 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c6836f-71cd-4f45-8197-cd022105b3d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=089d3203e8ca4c85994146dd821dbe0b)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:30.673132 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c6836f-71cd-4f45-8197-cd022105b3d2 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:30.782330 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-89c6836f-71cd-4f45-8197-cd022105b3d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '089d3203e8ca4c85994146dd821dbe0b'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:30.791359 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:32:30.795996 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-89c6836f-71cd-4f45-8197-cd022105b3d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '089d3203e8ca4c85994146dd821dbe0b'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:30.817483 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-89c6836f-71cd-4f45-8197-cd022105b3d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '089d3203e8ca4c85994146dd821dbe0b'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:30.829506 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-89c6836f-71cd-4f45-8197-cd022105b3d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '089d3203e8ca4c85994146dd821dbe0b'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:30.830293 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-89c6836f-71cd-4f45-8197-cd022105b3d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '089d3203e8ca4c85994146dd821dbe0b'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:30.839297 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 942/1861] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 16:32:30 2022] DELETE /identity/v3/users/089d3203e8ca4c85994146dd821dbe0b => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:32:30.844515 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7914bf23-e928-447e-8081-dca074c39003 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:30.845035 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7914bf23-e928-447e-8081-dca074c39003 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:30.845137 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7914bf23-e928-447e-8081-dca074c39003 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:30.866556 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-7914bf23-e928-447e-8081-dca074c39003 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:32:30.868029 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-7914bf23-e928-447e-8081-dca074c39003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:30.906559 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:32:30.998949 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 920/1862] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:32:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:32:31.009493 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c6836f-71cd-4f45-8197-cd022105b3d2 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:31.011109 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-89c6836f-71cd-4f45-8197-cd022105b3d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:31.110801 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c6836f-71cd-4f45-8197-cd022105b3d2 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:31.114694 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760b67dc-ed91-4f7a-b9e3-9bca44083453 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f44bfdd5214e8d84a2c0a5b1fd9b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:31.115400 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760b67dc-ed91-4f7a-b9e3-9bca44083453 service neutron] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:31.115925 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760b67dc-ed91-4f7a-b9e3-9bca44083453 service neutron] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:31.116415 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760b67dc-ed91-4f7a-b9e3-9bca44083453 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:31.126753 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760b67dc-ed91-4f7a-b9e3-9bca44083453 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:31.129239 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760b67dc-ed91-4f7a-b9e3-9bca44083453 service neutron] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:31.140232 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 943/1863] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:32:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:32:31.273089 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737471b8-4856-4f63-9d0e-febed148e969 None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:31.274790 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737471b8-4856-4f63-9d0e-febed148e969 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:31.275291 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737471b8-4856-4f63-9d0e-febed148e969 None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:31.276896 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 921/1864] 10.222.0.27 () {54 vars in 921 bytes} [Fri Sep 9 16:32:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:32:31.290527 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210dd4f1-f114-4888-823c-c8b2e48ab5d6 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:31.290914 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210dd4f1-f114-4888-823c-c8b2e48ab5d6 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:31.291076 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210dd4f1-f114-4888-823c-c8b2e48ab5d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:31.328997 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-210dd4f1-f114-4888-823c-c8b2e48ab5d6 None None] MFA Rules not processed for user `a332b9b4980646a3b14633293f77b505`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:32:31.330222 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-210dd4f1-f114-4888-823c-c8b2e48ab5d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:31.478186 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 944/1865] 10.222.0.27 () {58 vars in 1018 bytes} [Fri Sep 9 16:32:31 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:32:31.503520 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737471b8-4856-4f63-9d0e-febed148e969 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:31.505792 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-737471b8-4856-4f63-9d0e-febed148e969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:31.541684 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737471b8-4856-4f63-9d0e-febed148e969 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:31.560475 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc09eeb-9a0f-4222-a4c8-4ac4b78c79e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a332b9b4980646a3b14633293f77b505', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:31.561111 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc09eeb-9a0f-4222-a4c8-4ac4b78c79e9 service nova] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:31.561388 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc09eeb-9a0f-4222-a4c8-4ac4b78c79e9 service nova] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:31.561656 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc09eeb-9a0f-4222-a4c8-4ac4b78c79e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:31.580987 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc09eeb-9a0f-4222-a4c8-4ac4b78c79e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:31.582830 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc09eeb-9a0f-4222-a4c8-4ac4b78c79e9 service nova] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:31.613369 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 922/1866] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:32:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:32:31.694024 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210dd4f1-f114-4888-823c-c8b2e48ab5d6 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:31.696811 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-210dd4f1-f114-4888-823c-c8b2e48ab5d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:31.722400 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210dd4f1-f114-4888-823c-c8b2e48ab5d6 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:31.728303 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7b670e-05c1-491a-9f74-7a587766b498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:31.731961 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7b670e-05c1-491a-9f74-7a587766b498 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:31.731961 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7b670e-05c1-491a-9f74-7a587766b498 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:31.731961 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7b670e-05c1-491a-9f74-7a587766b498 admin admin] PATH_INFO: `/v3/projects/23744323f8e6446c83dcf55cc1308315` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:31.731961 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7b670e-05c1-491a-9f74-7a587766b498 admin admin] RBAC: Authorizing `identity:delete_project(project_id=23744323f8e6446c83dcf55cc1308315)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:31.735053 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7b670e-05c1-491a-9f74-7a587766b498 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:31.830557 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-0b7b670e-05c1-491a-9f74-7a587766b498 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23744323f8e6446c83dcf55cc1308315', 'request_id': 'req-0b7b670e-05c1-491a-9f74-7a587766b498'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:31.846599 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-0b7b670e-05c1-491a-9f74-7a587766b498 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23744323f8e6446c83dcf55cc1308315', 'request_id': 'req-0b7b670e-05c1-491a-9f74-7a587766b498'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:31.851659 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:32:31.879213 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-0b7b670e-05c1-491a-9f74-7a587766b498 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23744323f8e6446c83dcf55cc1308315', 'request_id': 'req-0b7b670e-05c1-491a-9f74-7a587766b498'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:31.896828 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-0b7b670e-05c1-491a-9f74-7a587766b498 admin admin] The token cache is being invalidate because project 23744323f8e6446c83dcf55cc1308315 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81446) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 16:32:31.897745 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-0b7b670e-05c1-491a-9f74-7a587766b498 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:31.900685 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-0b7b670e-05c1-491a-9f74-7a587766b498 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:31.902809 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 945/1867] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 16:32:31 2022] DELETE /identity/v3/projects/23744323f8e6446c83dcf55cc1308315 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:32:31.907148 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc09eeb-9a0f-4222-a4c8-4ac4b78c79e9 service nova] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:31.924994 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc09eeb-9a0f-4222-a4c8-4ac4b78c79e9 service nova] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:32.070865 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6ad48b-67bb-4b40-bd20-370c0e1ffcaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:32.071744 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6ad48b-67bb-4b40-bd20-370c0e1ffcaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:32.072464 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6ad48b-67bb-4b40-bd20-370c0e1ffcaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:32.072925 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6ad48b-67bb-4b40-bd20-370c0e1ffcaa admin admin] PATH_INFO: `/v3/users/23e1b02f39a149ab98a97602c8719d04` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:32.075894 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6ad48b-67bb-4b40-bd20-370c0e1ffcaa admin admin] RBAC: Authorizing `identity:delete_user(user_id=23e1b02f39a149ab98a97602c8719d04)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:32.079020 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6ad48b-67bb-4b40-bd20-370c0e1ffcaa admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:32.174366 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-da6ad48b-67bb-4b40-bd20-370c0e1ffcaa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23e1b02f39a149ab98a97602c8719d04'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:32.189959 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-da6ad48b-67bb-4b40-bd20-370c0e1ffcaa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23e1b02f39a149ab98a97602c8719d04'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:32.192241 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-da6ad48b-67bb-4b40-bd20-370c0e1ffcaa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23e1b02f39a149ab98a97602c8719d04'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:32.205158 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-da6ad48b-67bb-4b40-bd20-370c0e1ffcaa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23e1b02f39a149ab98a97602c8719d04'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:32.219403 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-da6ad48b-67bb-4b40-bd20-370c0e1ffcaa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23e1b02f39a149ab98a97602c8719d04'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:32.230962 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 923/1868] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 16:32:31 2022] DELETE /identity/v3/users/23e1b02f39a149ab98a97602c8719d04 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:32:32.945508 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7b670e-05c1-491a-9f74-7a587766b498 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:32.958370 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-0b7b670e-05c1-491a-9f74-7a587766b498 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:32.993211 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7b670e-05c1-491a-9f74-7a587766b498 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:33.071838 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4741fe-c9cf-4bd8-84b9-e2081aa64486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:33.072597 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4741fe-c9cf-4bd8-84b9-e2081aa64486 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:33.073567 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4741fe-c9cf-4bd8-84b9-e2081aa64486 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:33.074600 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4741fe-c9cf-4bd8-84b9-e2081aa64486 admin admin] PATH_INFO: `/v3/projects/5a7931b05cbb4516811309a88d2cbcc5` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:33.077163 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4741fe-c9cf-4bd8-84b9-e2081aa64486 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a7931b05cbb4516811309a88d2cbcc5)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:33.079549 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4741fe-c9cf-4bd8-84b9-e2081aa64486 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:33.170574 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-be4741fe-c9cf-4bd8-84b9-e2081aa64486 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a7931b05cbb4516811309a88d2cbcc5', 'request_id': 'req-be4741fe-c9cf-4bd8-84b9-e2081aa64486'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:33.179126 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-be4741fe-c9cf-4bd8-84b9-e2081aa64486 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a7931b05cbb4516811309a88d2cbcc5', 'request_id': 'req-be4741fe-c9cf-4bd8-84b9-e2081aa64486'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:33.190922 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-be4741fe-c9cf-4bd8-84b9-e2081aa64486 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a7931b05cbb4516811309a88d2cbcc5', 'request_id': 'req-be4741fe-c9cf-4bd8-84b9-e2081aa64486'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:33.208438 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-be4741fe-c9cf-4bd8-84b9-e2081aa64486 admin admin] The token cache is being invalidate because project 5a7931b05cbb4516811309a88d2cbcc5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81446) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 16:32:33.208734 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-be4741fe-c9cf-4bd8-84b9-e2081aa64486 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:33.209586 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-be4741fe-c9cf-4bd8-84b9-e2081aa64486 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:33.211428 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 946/1869] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 16:32:32 2022] DELETE /identity/v3/projects/5a7931b05cbb4516811309a88d2cbcc5 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:32:33.216961 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55902f84-1657-4144-9e5d-7e77ea4a7883 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:33.217508 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55902f84-1657-4144-9e5d-7e77ea4a7883 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:33.217508 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55902f84-1657-4144-9e5d-7e77ea4a7883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:33.242716 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-55902f84-1657-4144-9e5d-7e77ea4a7883 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:32:33.244015 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-55902f84-1657-4144-9e5d-7e77ea4a7883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:33.315988 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:32:33.353217 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 924/1870] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:32:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:32:33.361843 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbfe23c-dbb9-4042-9358-d082182b73c5 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:33.362132 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbfe23c-dbb9-4042-9358-d082182b73c5 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:33.362504 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbfe23c-dbb9-4042-9358-d082182b73c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:33.382542 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-cdbfe23c-dbb9-4042-9358-d082182b73c5 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:32:33.383755 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-cdbfe23c-dbb9-4042-9358-d082182b73c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:33.392031 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 947/1871] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:32:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:32:33.396424 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55902f84-1657-4144-9e5d-7e77ea4a7883 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:33.406752 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55902f84-1657-4144-9e5d-7e77ea4a7883 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:33.411485 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee5ece9-8d4c-447e-b077-80cf2745844e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:33.412092 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee5ece9-8d4c-447e-b077-80cf2745844e admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:33.412375 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee5ece9-8d4c-447e-b077-80cf2745844e admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:33.412649 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee5ece9-8d4c-447e-b077-80cf2745844e admin admin] PATH_INFO: `/v3/domains` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:33.413288 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee5ece9-8d4c-447e-b077-80cf2745844e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:32:33.413590 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee5ece9-8d4c-447e-b077-80cf2745844e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:33.415252 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee5ece9-8d4c-447e-b077-80cf2745844e admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:33.429127 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 925/1872] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Sep 9 16:32:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:32:33.434045 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbfe23c-dbb9-4042-9358-d082182b73c5 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:33.443607 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbfe23c-dbb9-4042-9358-d082182b73c5 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:33.449460 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a921466-0ace-4346-93ee-fdf05dc2e357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:33.450066 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a921466-0ace-4346-93ee-fdf05dc2e357 admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:33.450371 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a921466-0ace-4346-93ee-fdf05dc2e357 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:33.450647 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a921466-0ace-4346-93ee-fdf05dc2e357 admin admin] PATH_INFO: `/v3/projects` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:33.451310 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a921466-0ace-4346-93ee-fdf05dc2e357 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:33.453206 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a921466-0ace-4346-93ee-fdf05dc2e357 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:33.481831 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 948/1873] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 16:32:33 2022] POST /identity/v3/projects => generated 387 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:32:33.486586 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee5ece9-8d4c-447e-b077-80cf2745844e admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:33.496793 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee5ece9-8d4c-447e-b077-80cf2745844e admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:33.560001 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a823127-5b72-4a62-98ce-c3c08c2859d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:33.560748 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a823127-5b72-4a62-98ce-c3c08c2859d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:33.561197 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a823127-5b72-4a62-98ce-c3c08c2859d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:33.561633 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a823127-5b72-4a62-98ce-c3c08c2859d1 admin admin] PATH_INFO: `/v3/users` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:33.562496 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a823127-5b72-4a62-98ce-c3c08c2859d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:33.564617 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a823127-5b72-4a62-98ce-c3c08c2859d1 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:33.596142 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 926/1874] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 16:32:33 2022] POST /identity/v3/users => generated 294 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:32:33.597326 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a921466-0ace-4346-93ee-fdf05dc2e357 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:33.608481 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a921466-0ace-4346-93ee-fdf05dc2e357 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:33.613201 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6a711e-f716-4b62-a9fa-a405dae010a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:33.613996 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6a711e-f716-4b62-a9fa-a405dae010a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:33.614397 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6a711e-f716-4b62-a9fa-a405dae010a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:33.614760 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6a711e-f716-4b62-a9fa-a405dae010a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:33.615494 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6a711e-f716-4b62-a9fa-a405dae010a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:33.617292 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6a711e-f716-4b62-a9fa-a405dae010a7 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:33.630846 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 949/1875] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:32:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:32:33.635468 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a823127-5b72-4a62-98ce-c3c08c2859d1 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:33.646067 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a823127-5b72-4a62-98ce-c3c08c2859d1 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:33.651118 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73799055-dda6-4fc0-8aaf-9051bfcc89f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:33.651785 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73799055-dda6-4fc0-8aaf-9051bfcc89f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:33.652086 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73799055-dda6-4fc0-8aaf-9051bfcc89f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:33.652375 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73799055-dda6-4fc0-8aaf-9051bfcc89f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:33.653031 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73799055-dda6-4fc0-8aaf-9051bfcc89f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:33.655928 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73799055-dda6-4fc0-8aaf-9051bfcc89f3 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:33.671033 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 927/1876] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:32:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:32:33.672411 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6a711e-f716-4b62-a9fa-a405dae010a7 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:33.682574 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6a711e-f716-4b62-a9fa-a405dae010a7 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:33.687384 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea8fcf0-56de-4f0b-8f07-2703b4cb6e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:33.688043 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea8fcf0-56de-4f0b-8f07-2703b4cb6e23 admin admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:33.688313 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea8fcf0-56de-4f0b-8f07-2703b4cb6e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:33.688594 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea8fcf0-56de-4f0b-8f07-2703b4cb6e23 admin admin] PATH_INFO: `/v3/projects/4e48d3fb662940b193a74013abf74cb3/users/76c43e592a9d48d1ae7629265d0bc66c/roles/b38e84bf077846ee802e6bb1bad83522` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:33.705659 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea8fcf0-56de-4f0b-8f07-2703b4cb6e23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e48d3fb662940b193a74013abf74cb3, user_id=76c43e592a9d48d1ae7629265d0bc66c, role_id=b38e84bf077846ee802e6bb1bad83522)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:33.708338 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea8fcf0-56de-4f0b-8f07-2703b4cb6e23 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:33.726260 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 950/1877] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 16:32:33 2022] PUT /identity/v3/projects/4e48d3fb662940b193a74013abf74cb3/users/76c43e592a9d48d1ae7629265d0bc66c/roles/b38e84bf077846ee802e6bb1bad83522 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:32:33.737275 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97792ed-62c1-4236-b50d-0b29cd03ada2 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:33.737560 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97792ed-62c1-4236-b50d-0b29cd03ada2 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:33.737834 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97792ed-62c1-4236-b50d-0b29cd03ada2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:33.766190 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-b97792ed-62c1-4236-b50d-0b29cd03ada2 None None] MFA Rules not processed for user `76c43e592a9d48d1ae7629265d0bc66c`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:32:33.767443 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-b97792ed-62c1-4236-b50d-0b29cd03ada2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:33.831857 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 928/1878] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:32:33 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:32:33.836253 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea8fcf0-56de-4f0b-8f07-2703b4cb6e23 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:33.854199 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:DELETE=8,keystone:SELECT=89,keystone:INSERT=3 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:32:33.905112 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea8fcf0-56de-4f0b-8f07-2703b4cb6e23 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:33.910003 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a89bca9-e6c1-4201-b336-de365738b75b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:33.910651 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a89bca9-e6c1-4201-b336-de365738b75b admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:33.910957 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a89bca9-e6c1-4201-b336-de365738b75b admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:33.911232 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a89bca9-e6c1-4201-b336-de365738b75b admin admin] PATH_INFO: `/v3/projects` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:33.911872 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a89bca9-e6c1-4201-b336-de365738b75b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:33.913901 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a89bca9-e6c1-4201-b336-de365738b75b admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:33.939870 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 951/1879] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 16:32:33 2022] POST /identity/v3/projects => generated 387 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 16:32:33.944113 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97792ed-62c1-4236-b50d-0b29cd03ada2 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:33.955167 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97792ed-62c1-4236-b50d-0b29cd03ada2 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:33.986070 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:32:34.014664 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2e7faa-7ba2-4d6c-b207-22885f3458c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:34.015375 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2e7faa-7ba2-4d6c-b207-22885f3458c7 admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:34.015658 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2e7faa-7ba2-4d6c-b207-22885f3458c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:34.015965 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2e7faa-7ba2-4d6c-b207-22885f3458c7 admin admin] PATH_INFO: `/v3/users` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:34.016622 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2e7faa-7ba2-4d6c-b207-22885f3458c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:34.018582 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2e7faa-7ba2-4d6c-b207-22885f3458c7 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:34.041096 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 929/1880] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 16:32:33 2022] POST /identity/v3/users => generated 300 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:32:34.045227 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a89bca9-e6c1-4201-b336-de365738b75b admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:34.055710 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a89bca9-e6c1-4201-b336-de365738b75b admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:34.061044 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99262f60-3b86-4c4f-a510-eac68679147b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:34.061749 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99262f60-3b86-4c4f-a510-eac68679147b admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:34.062162 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99262f60-3b86-4c4f-a510-eac68679147b admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:34.062526 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99262f60-3b86-4c4f-a510-eac68679147b admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:34.063224 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99262f60-3b86-4c4f-a510-eac68679147b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:34.064985 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99262f60-3b86-4c4f-a510-eac68679147b admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:34.079891 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 952/1881] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:32:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 16:32:34.081054 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2e7faa-7ba2-4d6c-b207-22885f3458c7 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:34.091381 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2e7faa-7ba2-4d6c-b207-22885f3458c7 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:34.096018 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e598d7-0ae6-4a78-a293-aa21ef4c799e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:34.096669 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e598d7-0ae6-4a78-a293-aa21ef4c799e admin admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:34.096950 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e598d7-0ae6-4a78-a293-aa21ef4c799e admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:34.097225 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e598d7-0ae6-4a78-a293-aa21ef4c799e admin admin] PATH_INFO: `/v3/projects/e5ee6cc9fced44d0bdbab0b8901b04f9/users/05bfb9bcc5904f5a8b5fa18fe0ff7f92/roles/0a36d1be416f4089be19be979943b731` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:34.115175 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e598d7-0ae6-4a78-a293-aa21ef4c799e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5ee6cc9fced44d0bdbab0b8901b04f9, user_id=05bfb9bcc5904f5a8b5fa18fe0ff7f92, role_id=0a36d1be416f4089be19be979943b731)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:34.117874 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e598d7-0ae6-4a78-a293-aa21ef4c799e admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:34.142099 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 930/1882] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 16:32:34 2022] PUT /identity/v3/projects/e5ee6cc9fced44d0bdbab0b8901b04f9/users/05bfb9bcc5904f5a8b5fa18fe0ff7f92/roles/0a36d1be416f4089be19be979943b731 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 16:32:34.142207 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99262f60-3b86-4c4f-a510-eac68679147b admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:34.149520 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99262f60-3b86-4c4f-a510-eac68679147b admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:34.212050 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5d826f-2be2-4561-8bad-09d00be9e5ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:34.212689 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5d826f-2be2-4561-8bad-09d00be9e5ab admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:34.212970 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5d826f-2be2-4561-8bad-09d00be9e5ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:34.213247 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5d826f-2be2-4561-8bad-09d00be9e5ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:34.213903 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5d826f-2be2-4561-8bad-09d00be9e5ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:34.215671 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5d826f-2be2-4561-8bad-09d00be9e5ab admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:34.229335 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 953/1883] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:32:34 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 16:32:34.233891 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e598d7-0ae6-4a78-a293-aa21ef4c799e admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:34.246989 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e598d7-0ae6-4a78-a293-aa21ef4c799e admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:34.253726 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4228ef5a-0be7-4e61-bdeb-70efd45f0a4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:34.254940 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4228ef5a-0be7-4e61-bdeb-70efd45f0a4f admin admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:34.255389 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4228ef5a-0be7-4e61-bdeb-70efd45f0a4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:34.255815 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4228ef5a-0be7-4e61-bdeb-70efd45f0a4f admin admin] PATH_INFO: `/v3/projects/e5ee6cc9fced44d0bdbab0b8901b04f9/users/05bfb9bcc5904f5a8b5fa18fe0ff7f92/roles/0a36d1be416f4089be19be979943b731` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:34.258126 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4228ef5a-0be7-4e61-bdeb-70efd45f0a4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5ee6cc9fced44d0bdbab0b8901b04f9, user_id=05bfb9bcc5904f5a8b5fa18fe0ff7f92, role_id=0a36d1be416f4089be19be979943b731)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:34.262239 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4228ef5a-0be7-4e61-bdeb-70efd45f0a4f admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:34.287897 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 931/1884] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 16:32:34 2022] PUT /identity/v3/projects/e5ee6cc9fced44d0bdbab0b8901b04f9/users/05bfb9bcc5904f5a8b5fa18fe0ff7f92/roles/0a36d1be416f4089be19be979943b731 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 16:32:34.298762 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16057641-9eed-4598-9bc3-817a33f58154 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:34.299058 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16057641-9eed-4598-9bc3-817a33f58154 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:34.299547 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16057641-9eed-4598-9bc3-817a33f58154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:34.376864 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-16057641-9eed-4598-9bc3-817a33f58154 None None] MFA Rules not processed for user `05bfb9bcc5904f5a8b5fa18fe0ff7f92`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:32:34.376864 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-16057641-9eed-4598-9bc3-817a33f58154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:34.541531 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 954/1885] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:32:34 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:32:34.600071 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4228ef5a-0be7-4e61-bdeb-70efd45f0a4f admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:34.601789 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-4228ef5a-0be7-4e61-bdeb-70efd45f0a4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:34.681801 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4228ef5a-0be7-4e61-bdeb-70efd45f0a4f admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:34.686703 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d6d582-6ebc-4c74-bd69-30a44a5d633f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8078e791ba68460f8b3aeafb4b79b73a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:34.687423 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d6d582-6ebc-4c74-bd69-30a44a5d633f service cinder] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:34.687644 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d6d582-6ebc-4c74-bd69-30a44a5d633f service cinder] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:34.687985 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d6d582-6ebc-4c74-bd69-30a44a5d633f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:34.704167 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d6d582-6ebc-4c74-bd69-30a44a5d633f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:34.705881 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d6d582-6ebc-4c74-bd69-30a44a5d633f service cinder] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:34.716825 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 932/1886] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:32:34 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:32:35.198608 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16057641-9eed-4598-9bc3-817a33f58154 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:35.224021 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:32:35.374787 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16057641-9eed-4598-9bc3-817a33f58154 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:35.397544 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a73997-d194-415e-a6cd-700533fa7343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:35.398572 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a73997-d194-415e-a6cd-700533fa7343 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:35.399049 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a73997-d194-415e-a6cd-700533fa7343 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:35.399483 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a73997-d194-415e-a6cd-700533fa7343 admin admin] PATH_INFO: `/v3/users/76c43e592a9d48d1ae7629265d0bc66c` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:35.401029 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a73997-d194-415e-a6cd-700533fa7343 admin admin] RBAC: Authorizing `identity:delete_user(user_id=76c43e592a9d48d1ae7629265d0bc66c)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:35.403064 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a73997-d194-415e-a6cd-700533fa7343 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:35.468072 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-c7a73997-d194-415e-a6cd-700533fa7343 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76c43e592a9d48d1ae7629265d0bc66c'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:35.485032 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-c7a73997-d194-415e-a6cd-700533fa7343 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76c43e592a9d48d1ae7629265d0bc66c'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:35.501862 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-c7a73997-d194-415e-a6cd-700533fa7343 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76c43e592a9d48d1ae7629265d0bc66c'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:35.513607 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-c7a73997-d194-415e-a6cd-700533fa7343 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76c43e592a9d48d1ae7629265d0bc66c'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:35.514376 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-c7a73997-d194-415e-a6cd-700533fa7343 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76c43e592a9d48d1ae7629265d0bc66c'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:35.522398 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 955/1887] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 16:32:35 2022] DELETE /identity/v3/users/76c43e592a9d48d1ae7629265d0bc66c => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:32:35.525969 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac06d8c-296f-4104-8c4f-ff6c13366622 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:35.526961 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac06d8c-296f-4104-8c4f-ff6c13366622 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:35.527241 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac06d8c-296f-4104-8c4f-ff6c13366622 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:35.548640 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-5ac06d8c-296f-4104-8c4f-ff6c13366622 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:32:35.550222 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-5ac06d8c-296f-4104-8c4f-ff6c13366622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:35.614037 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 933/1888] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:32:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:32:35.623800 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a73997-d194-415e-a6cd-700533fa7343 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:35.625203 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-c7a73997-d194-415e-a6cd-700533fa7343 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:35.682865 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a73997-d194-415e-a6cd-700533fa7343 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:35.686482 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d35cb4-e516-476f-85c5-66c27af633be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f44bfdd5214e8d84a2c0a5b1fd9b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:35.687080 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d35cb4-e516-476f-85c5-66c27af633be service neutron] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:35.687354 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d35cb4-e516-476f-85c5-66c27af633be service neutron] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:35.688038 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d35cb4-e516-476f-85c5-66c27af633be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:35.697529 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d35cb4-e516-476f-85c5-66c27af633be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:35.699026 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d35cb4-e516-476f-85c5-66c27af633be service neutron] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:35.711980 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 956/1889] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:32:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:32:36.274406 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac06d8c-296f-4104-8c4f-ff6c13366622 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:36.275886 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-5ac06d8c-296f-4104-8c4f-ff6c13366622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:36.289438 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac06d8c-296f-4104-8c4f-ff6c13366622 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:36.339120 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e09f64-8dde-4b23-9d9b-b779cf21c3eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:36.340022 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e09f64-8dde-4b23-9d9b-b779cf21c3eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:36.340363 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e09f64-8dde-4b23-9d9b-b779cf21c3eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:36.340602 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e09f64-8dde-4b23-9d9b-b779cf21c3eb admin admin] PATH_INFO: `/v3/projects/4e48d3fb662940b193a74013abf74cb3` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:36.342508 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e09f64-8dde-4b23-9d9b-b779cf21c3eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e48d3fb662940b193a74013abf74cb3)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:36.344890 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e09f64-8dde-4b23-9d9b-b779cf21c3eb admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:36.378545 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:32:36.412598 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-f7e09f64-8dde-4b23-9d9b-b779cf21c3eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e48d3fb662940b193a74013abf74cb3', 'request_id': 'req-f7e09f64-8dde-4b23-9d9b-b779cf21c3eb'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:36.422159 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-f7e09f64-8dde-4b23-9d9b-b779cf21c3eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e48d3fb662940b193a74013abf74cb3', 'request_id': 'req-f7e09f64-8dde-4b23-9d9b-b779cf21c3eb'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:36.433269 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-f7e09f64-8dde-4b23-9d9b-b779cf21c3eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e48d3fb662940b193a74013abf74cb3', 'request_id': 'req-f7e09f64-8dde-4b23-9d9b-b779cf21c3eb'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:36.455243 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-f7e09f64-8dde-4b23-9d9b-b779cf21c3eb admin admin] The token cache is being invalidate because project 4e48d3fb662940b193a74013abf74cb3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81445) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 16:32:36.455797 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-f7e09f64-8dde-4b23-9d9b-b779cf21c3eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:36.456526 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-f7e09f64-8dde-4b23-9d9b-b779cf21c3eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:36.458777 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 934/1890] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 16:32:36 2022] DELETE /identity/v3/projects/4e48d3fb662940b193a74013abf74cb3 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:32:36.463579 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d35cb4-e516-476f-85c5-66c27af633be service neutron] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:36.477325 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d35cb4-e516-476f-85c5-66c27af633be service neutron] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:36.522606 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:32:36.566244 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45e2b0c-0d0b-47be-9b4b-f4d03899ec62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:36.567090 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45e2b0c-0d0b-47be-9b4b-f4d03899ec62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:36.568245 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45e2b0c-0d0b-47be-9b4b-f4d03899ec62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:36.568245 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45e2b0c-0d0b-47be-9b4b-f4d03899ec62 admin admin] PATH_INFO: `/v3/users/05bfb9bcc5904f5a8b5fa18fe0ff7f92` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:36.570095 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45e2b0c-0d0b-47be-9b4b-f4d03899ec62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05bfb9bcc5904f5a8b5fa18fe0ff7f92)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:36.573706 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45e2b0c-0d0b-47be-9b4b-f4d03899ec62 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:36.687804 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-b45e2b0c-0d0b-47be-9b4b-f4d03899ec62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05bfb9bcc5904f5a8b5fa18fe0ff7f92'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:36.700565 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-b45e2b0c-0d0b-47be-9b4b-f4d03899ec62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05bfb9bcc5904f5a8b5fa18fe0ff7f92'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:36.725609 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-b45e2b0c-0d0b-47be-9b4b-f4d03899ec62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05bfb9bcc5904f5a8b5fa18fe0ff7f92'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:36.750280 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-b45e2b0c-0d0b-47be-9b4b-f4d03899ec62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05bfb9bcc5904f5a8b5fa18fe0ff7f92'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:36.751135 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-b45e2b0c-0d0b-47be-9b4b-f4d03899ec62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05bfb9bcc5904f5a8b5fa18fe0ff7f92'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:36.763607 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 957/1891] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 16:32:36 2022] DELETE /identity/v3/users/05bfb9bcc5904f5a8b5fa18fe0ff7f92 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:32:37.679547 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e09f64-8dde-4b23-9d9b-b779cf21c3eb admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:37.682689 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-f7e09f64-8dde-4b23-9d9b-b779cf21c3eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:37.699776 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e09f64-8dde-4b23-9d9b-b779cf21c3eb admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:37.786253 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c97a0cd-f7c4-4ceb-804b-958f8a019c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:37.788194 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c97a0cd-f7c4-4ceb-804b-958f8a019c4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:37.788919 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c97a0cd-f7c4-4ceb-804b-958f8a019c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:37.789422 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c97a0cd-f7c4-4ceb-804b-958f8a019c4a admin admin] PATH_INFO: `/v3/projects/e5ee6cc9fced44d0bdbab0b8901b04f9` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:37.791033 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c97a0cd-f7c4-4ceb-804b-958f8a019c4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5ee6cc9fced44d0bdbab0b8901b04f9)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:37.795461 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c97a0cd-f7c4-4ceb-804b-958f8a019c4a admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:37.877873 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-6c97a0cd-f7c4-4ceb-804b-958f8a019c4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5ee6cc9fced44d0bdbab0b8901b04f9', 'request_id': 'req-6c97a0cd-f7c4-4ceb-804b-958f8a019c4a'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:37.886601 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-6c97a0cd-f7c4-4ceb-804b-958f8a019c4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5ee6cc9fced44d0bdbab0b8901b04f9', 'request_id': 'req-6c97a0cd-f7c4-4ceb-804b-958f8a019c4a'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:37.899727 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-6c97a0cd-f7c4-4ceb-804b-958f8a019c4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5ee6cc9fced44d0bdbab0b8901b04f9', 'request_id': 'req-6c97a0cd-f7c4-4ceb-804b-958f8a019c4a'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:37.917843 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-6c97a0cd-f7c4-4ceb-804b-958f8a019c4a admin admin] The token cache is being invalidate because project e5ee6cc9fced44d0bdbab0b8901b04f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81445) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 16:32:37.918137 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-6c97a0cd-f7c4-4ceb-804b-958f8a019c4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:37.918990 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-6c97a0cd-f7c4-4ceb-804b-958f8a019c4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:37.926011 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 935/1892] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 16:32:37 2022] DELETE /identity/v3/projects/e5ee6cc9fced44d0bdbab0b8901b04f9 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:32:37.927971 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf9f951-9619-402f-8bc2-3615e7fa298b None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:37.928467 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf9f951-9619-402f-8bc2-3615e7fa298b None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:37.928562 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf9f951-9619-402f-8bc2-3615e7fa298b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:37.951783 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-6bf9f951-9619-402f-8bc2-3615e7fa298b None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:32:37.953828 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-6bf9f951-9619-402f-8bc2-3615e7fa298b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:38.083643 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 958/1893] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:32:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 16:32:38.085805 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8e1e83-d00d-4944-b803-8bef776357ca None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:38.086330 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8e1e83-d00d-4944-b803-8bef776357ca None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:38.086841 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8e1e83-d00d-4944-b803-8bef776357ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:38.113348 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-7f8e1e83-d00d-4944-b803-8bef776357ca None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:32:38.114098 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-7f8e1e83-d00d-4944-b803-8bef776357ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:38.125921 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 936/1894] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:32:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:32:38.127358 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf9f951-9619-402f-8bc2-3615e7fa298b None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:38.138448 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf9f951-9619-402f-8bc2-3615e7fa298b None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:38.143263 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dc6ff3-3256-40d5-9bc0-2c4843bc0923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:38.143928 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dc6ff3-3256-40d5-9bc0-2c4843bc0923 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:38.144260 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dc6ff3-3256-40d5-9bc0-2c4843bc0923 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:38.144535 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dc6ff3-3256-40d5-9bc0-2c4843bc0923 admin admin] PATH_INFO: `/v3/domains` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:38.145181 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dc6ff3-3256-40d5-9bc0-2c4843bc0923 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:32:38.145489 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dc6ff3-3256-40d5-9bc0-2c4843bc0923 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:38.147133 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dc6ff3-3256-40d5-9bc0-2c4843bc0923 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:38.160368 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 959/1895] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Sep 9 16:32:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 16:32:38.164935 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8e1e83-d00d-4944-b803-8bef776357ca None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:38.176241 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8e1e83-d00d-4944-b803-8bef776357ca None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:38.183124 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb584522-3a8b-43af-b56e-0ba10d787622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:38.183977 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb584522-3a8b-43af-b56e-0ba10d787622 admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:38.184092 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb584522-3a8b-43af-b56e-0ba10d787622 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:38.184357 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb584522-3a8b-43af-b56e-0ba10d787622 admin admin] PATH_INFO: `/v3/projects` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:38.184993 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb584522-3a8b-43af-b56e-0ba10d787622 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:38.187165 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb584522-3a8b-43af-b56e-0ba10d787622 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:38.217700 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 937/1896] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 16:32:38 2022] POST /identity/v3/projects => generated 383 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:32:38.221891 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dc6ff3-3256-40d5-9bc0-2c4843bc0923 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:38.232114 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dc6ff3-3256-40d5-9bc0-2c4843bc0923 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:38.272258 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:32:38.301753 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6003b2d-ceab-42f2-bde7-dde29148e584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:38.302504 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6003b2d-ceab-42f2-bde7-dde29148e584 admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:38.302883 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6003b2d-ceab-42f2-bde7-dde29148e584 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:38.304267 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6003b2d-ceab-42f2-bde7-dde29148e584 admin admin] PATH_INFO: `/v3/users` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:38.304267 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6003b2d-ceab-42f2-bde7-dde29148e584 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:38.305676 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6003b2d-ceab-42f2-bde7-dde29148e584 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:38.344174 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 960/1897] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 16:32:38 2022] POST /identity/v3/users => generated 292 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 16:32:38.345826 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb584522-3a8b-43af-b56e-0ba10d787622 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:38.367362 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb584522-3a8b-43af-b56e-0ba10d787622 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:38.375161 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572844a4-0749-4252-be25-98a3f13081b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:38.376107 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572844a4-0749-4252-be25-98a3f13081b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:38.376748 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572844a4-0749-4252-be25-98a3f13081b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:38.377128 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572844a4-0749-4252-be25-98a3f13081b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:38.378036 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572844a4-0749-4252-be25-98a3f13081b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:38.380778 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572844a4-0749-4252-be25-98a3f13081b5 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:38.398991 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 938/1898] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:32:38 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:32:38.402499 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6003b2d-ceab-42f2-bde7-dde29148e584 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:38.417846 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6003b2d-ceab-42f2-bde7-dde29148e584 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:38.423279 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295fea71-5fa0-4622-b0a6-17838228275c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:38.424156 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295fea71-5fa0-4622-b0a6-17838228275c admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:38.424497 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295fea71-5fa0-4622-b0a6-17838228275c admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:38.424853 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295fea71-5fa0-4622-b0a6-17838228275c admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:38.425840 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295fea71-5fa0-4622-b0a6-17838228275c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:38.427507 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295fea71-5fa0-4622-b0a6-17838228275c admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:38.445887 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 961/1899] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:32:38 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:32:38.450785 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572844a4-0749-4252-be25-98a3f13081b5 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:38.457509 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:32:38.467776 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572844a4-0749-4252-be25-98a3f13081b5 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:38.475349 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6189b87-0acd-4dc0-8f56-7e3d7577dd56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:38.475349 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6189b87-0acd-4dc0-8f56-7e3d7577dd56 admin admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:38.475349 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6189b87-0acd-4dc0-8f56-7e3d7577dd56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:38.475349 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6189b87-0acd-4dc0-8f56-7e3d7577dd56 admin admin] PATH_INFO: `/v3/projects/784568b8a3f84aeb8360da94698107eb/users/94544b1098714c9a932214cf4592a310/roles/b38e84bf077846ee802e6bb1bad83522` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:38.507558 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6189b87-0acd-4dc0-8f56-7e3d7577dd56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=784568b8a3f84aeb8360da94698107eb, user_id=94544b1098714c9a932214cf4592a310, role_id=b38e84bf077846ee802e6bb1bad83522)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:38.515444 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6189b87-0acd-4dc0-8f56-7e3d7577dd56 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:38.551516 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 939/1900] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 16:32:38 2022] PUT /identity/v3/projects/784568b8a3f84aeb8360da94698107eb/users/94544b1098714c9a932214cf4592a310/roles/b38e84bf077846ee802e6bb1bad83522 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:32:38.553933 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441dda57-ea06-4872-8fd6-bda0885951b7 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:38.554240 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441dda57-ea06-4872-8fd6-bda0885951b7 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:38.554896 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441dda57-ea06-4872-8fd6-bda0885951b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:38.616580 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-441dda57-ea06-4872-8fd6-bda0885951b7 None None] MFA Rules not processed for user `94544b1098714c9a932214cf4592a310`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:32:38.618276 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-441dda57-ea06-4872-8fd6-bda0885951b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:38.737884 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 962/1901] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:32:38 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:32:38.781992 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6189b87-0acd-4dc0-8f56-7e3d7577dd56 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:38.784173 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-f6189b87-0acd-4dc0-8f56-7e3d7577dd56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:38.933272 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6189b87-0acd-4dc0-8f56-7e3d7577dd56 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:38.939225 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa6ec99-a0f6-4980-9a46-846360774b3d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8078e791ba68460f8b3aeafb4b79b73a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:38.939988 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa6ec99-a0f6-4980-9a46-846360774b3d service cinder] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:38.940370 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa6ec99-a0f6-4980-9a46-846360774b3d service cinder] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:38.941263 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa6ec99-a0f6-4980-9a46-846360774b3d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:38.989208 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa6ec99-a0f6-4980-9a46-846360774b3d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:38.991126 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa6ec99-a0f6-4980-9a46-846360774b3d service cinder] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:39.009827 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 940/1902] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:32:38 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:32:43.239902 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441dda57-ea06-4872-8fd6-bda0885951b7 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:43.241975 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-441dda57-ea06-4872-8fd6-bda0885951b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:43.393563 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441dda57-ea06-4872-8fd6-bda0885951b7 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:43.403415 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5b2af6-619f-4107-94e9-ddba683130b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:43.404103 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5b2af6-619f-4107-94e9-ddba683130b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:43.404381 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5b2af6-619f-4107-94e9-ddba683130b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:43.404651 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5b2af6-619f-4107-94e9-ddba683130b1 admin admin] PATH_INFO: `/v3/users/0e0dbade6d354dba86a0d318013b4f88` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:43.405831 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5b2af6-619f-4107-94e9-ddba683130b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e0dbade6d354dba86a0d318013b4f88)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:43.407809 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5b2af6-619f-4107-94e9-ddba683130b1 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:43.501897 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-ca5b2af6-619f-4107-94e9-ddba683130b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e0dbade6d354dba86a0d318013b4f88'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:43.504118 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:32:43.518762 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-ca5b2af6-619f-4107-94e9-ddba683130b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e0dbade6d354dba86a0d318013b4f88'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:43.535208 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-ca5b2af6-619f-4107-94e9-ddba683130b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e0dbade6d354dba86a0d318013b4f88'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:43.546595 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-ca5b2af6-619f-4107-94e9-ddba683130b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e0dbade6d354dba86a0d318013b4f88'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:43.547512 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-ca5b2af6-619f-4107-94e9-ddba683130b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e0dbade6d354dba86a0d318013b4f88'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:43.577374 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 963/1903] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 16:32:43 2022] DELETE /identity/v3/users/0e0dbade6d354dba86a0d318013b4f88 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:32:43.582550 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3551c3-6db8-4054-9a67-ed456b6b74b5 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:43.583266 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3551c3-6db8-4054-9a67-ed456b6b74b5 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:43.583684 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3551c3-6db8-4054-9a67-ed456b6b74b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:43.618992 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-4c3551c3-6db8-4054-9a67-ed456b6b74b5 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:32:43.620227 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-4c3551c3-6db8-4054-9a67-ed456b6b74b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:43.738174 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 941/1904] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:32:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:32:43.748731 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5b2af6-619f-4107-94e9-ddba683130b1 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:43.750239 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-ca5b2af6-619f-4107-94e9-ddba683130b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:43.823057 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5b2af6-619f-4107-94e9-ddba683130b1 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:43.834816 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383f6c0a-22b7-4b7b-8eb4-767967d009e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f44bfdd5214e8d84a2c0a5b1fd9b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:43.835731 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383f6c0a-22b7-4b7b-8eb4-767967d009e4 service neutron] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:43.836345 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383f6c0a-22b7-4b7b-8eb4-767967d009e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:43.836818 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383f6c0a-22b7-4b7b-8eb4-767967d009e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:43.852801 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383f6c0a-22b7-4b7b-8eb4-767967d009e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:43.854953 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383f6c0a-22b7-4b7b-8eb4-767967d009e4 service neutron] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:43.870860 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 964/1905] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:32:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:32:44.173526 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3551c3-6db8-4054-9a67-ed456b6b74b5 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:44.175077 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-4c3551c3-6db8-4054-9a67-ed456b6b74b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:44.195298 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3551c3-6db8-4054-9a67-ed456b6b74b5 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:44.205989 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469d59b5-10f4-4ace-aef5-daae8f1e462e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:44.206679 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469d59b5-10f4-4ace-aef5-daae8f1e462e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:44.206960 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469d59b5-10f4-4ace-aef5-daae8f1e462e admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:44.207317 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469d59b5-10f4-4ace-aef5-daae8f1e462e admin admin] PATH_INFO: `/v3/projects/b9d7a11fdf5040c49c29efaf86025b71` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:44.208358 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469d59b5-10f4-4ace-aef5-daae8f1e462e admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9d7a11fdf5040c49c29efaf86025b71)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:44.210268 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469d59b5-10f4-4ace-aef5-daae8f1e462e admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:44.270084 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-469d59b5-10f4-4ace-aef5-daae8f1e462e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9d7a11fdf5040c49c29efaf86025b71', 'request_id': 'req-469d59b5-10f4-4ace-aef5-daae8f1e462e'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:44.276754 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-469d59b5-10f4-4ace-aef5-daae8f1e462e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9d7a11fdf5040c49c29efaf86025b71', 'request_id': 'req-469d59b5-10f4-4ace-aef5-daae8f1e462e'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:44.288016 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-469d59b5-10f4-4ace-aef5-daae8f1e462e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9d7a11fdf5040c49c29efaf86025b71', 'request_id': 'req-469d59b5-10f4-4ace-aef5-daae8f1e462e'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:44.302827 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-469d59b5-10f4-4ace-aef5-daae8f1e462e admin admin] The token cache is being invalidate because project b9d7a11fdf5040c49c29efaf86025b71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81445) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 16:32:44.303376 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-469d59b5-10f4-4ace-aef5-daae8f1e462e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:44.304187 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-469d59b5-10f4-4ace-aef5-daae8f1e462e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:44.308848 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 942/1906] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 16:32:44 2022] DELETE /identity/v3/projects/b9d7a11fdf5040c49c29efaf86025b71 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:32:44.310140 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383f6c0a-22b7-4b7b-8eb4-767967d009e4 service neutron] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:44.326445 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383f6c0a-22b7-4b7b-8eb4-767967d009e4 service neutron] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:44.413335 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f82147-c95f-4eaa-9832-7a93d473d9d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:44.414903 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f82147-c95f-4eaa-9832-7a93d473d9d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:44.415323 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f82147-c95f-4eaa-9832-7a93d473d9d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:44.415702 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f82147-c95f-4eaa-9832-7a93d473d9d6 admin admin] PATH_INFO: `/v3/users/c7f9f535bc344b6ab2749666fce151a1` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:44.417097 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f82147-c95f-4eaa-9832-7a93d473d9d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7f9f535bc344b6ab2749666fce151a1)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:44.420177 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f82147-c95f-4eaa-9832-7a93d473d9d6 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:44.528312 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-e7f82147-c95f-4eaa-9832-7a93d473d9d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7f9f535bc344b6ab2749666fce151a1'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:44.551143 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-e7f82147-c95f-4eaa-9832-7a93d473d9d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7f9f535bc344b6ab2749666fce151a1'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:44.576148 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-e7f82147-c95f-4eaa-9832-7a93d473d9d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7f9f535bc344b6ab2749666fce151a1'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:44.582379 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:32:44.585467 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-e7f82147-c95f-4eaa-9832-7a93d473d9d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7f9f535bc344b6ab2749666fce151a1'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:44.587106 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-e7f82147-c95f-4eaa-9832-7a93d473d9d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7f9f535bc344b6ab2749666fce151a1'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:44.602816 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 965/1907] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 16:32:44 2022] DELETE /identity/v3/users/c7f9f535bc344b6ab2749666fce151a1 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:32:44.749893 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469d59b5-10f4-4ace-aef5-daae8f1e462e admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:44.753375 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-469d59b5-10f4-4ace-aef5-daae8f1e462e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:44.768662 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:32:44.782656 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469d59b5-10f4-4ace-aef5-daae8f1e462e admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:44.885547 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f82147-c95f-4eaa-9832-7a93d473d9d6 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:44.887088 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-e7f82147-c95f-4eaa-9832-7a93d473d9d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:44.892478 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e828c71e-5bc8-4aca-b88e-6cdbd3d26f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:44.894188 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e828c71e-5bc8-4aca-b88e-6cdbd3d26f79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:44.894726 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e828c71e-5bc8-4aca-b88e-6cdbd3d26f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:44.895207 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e828c71e-5bc8-4aca-b88e-6cdbd3d26f79 admin admin] PATH_INFO: `/v3/users/94544b1098714c9a932214cf4592a310` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:44.897216 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e828c71e-5bc8-4aca-b88e-6cdbd3d26f79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=94544b1098714c9a932214cf4592a310)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:44.900030 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e828c71e-5bc8-4aca-b88e-6cdbd3d26f79 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:44.905406 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f82147-c95f-4eaa-9832-7a93d473d9d6 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:44.918214 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabec3a6-6a35-4e23-974c-2e3b5b786b35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:44.919297 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabec3a6-6a35-4e23-974c-2e3b5b786b35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:44.920281 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabec3a6-6a35-4e23-974c-2e3b5b786b35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:44.920731 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabec3a6-6a35-4e23-974c-2e3b5b786b35 admin admin] PATH_INFO: `/v3/users/b61390bea3554473a3c2d758f4427755` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:44.922084 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabec3a6-6a35-4e23-974c-2e3b5b786b35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b61390bea3554473a3c2d758f4427755)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:44.924371 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabec3a6-6a35-4e23-974c-2e3b5b786b35 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:44.978862 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-e828c71e-5bc8-4aca-b88e-6cdbd3d26f79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94544b1098714c9a932214cf4592a310'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:44.990567 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-aabec3a6-6a35-4e23-974c-2e3b5b786b35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b61390bea3554473a3c2d758f4427755'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:44.993768 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-e828c71e-5bc8-4aca-b88e-6cdbd3d26f79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94544b1098714c9a932214cf4592a310'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:44.994813 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-e828c71e-5bc8-4aca-b88e-6cdbd3d26f79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94544b1098714c9a932214cf4592a310'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:45.004315 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-e828c71e-5bc8-4aca-b88e-6cdbd3d26f79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94544b1098714c9a932214cf4592a310'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:45.005544 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-aabec3a6-6a35-4e23-974c-2e3b5b786b35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b61390bea3554473a3c2d758f4427755'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:45.022334 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-e828c71e-5bc8-4aca-b88e-6cdbd3d26f79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94544b1098714c9a932214cf4592a310'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:45.026011 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-aabec3a6-6a35-4e23-974c-2e3b5b786b35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b61390bea3554473a3c2d758f4427755'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:45.036486 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 943/1908] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 16:32:44 2022] DELETE /identity/v3/users/94544b1098714c9a932214cf4592a310 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:32:45.036486 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e828c71e-5bc8-4aca-b88e-6cdbd3d26f79 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:45.037925 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-e828c71e-5bc8-4aca-b88e-6cdbd3d26f79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:45.040271 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-aabec3a6-6a35-4e23-974c-2e3b5b786b35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b61390bea3554473a3c2d758f4427755'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:45.041106 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-aabec3a6-6a35-4e23-974c-2e3b5b786b35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b61390bea3554473a3c2d758f4427755'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:45.053122 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 966/1909] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 16:32:44 2022] DELETE /identity/v3/users/b61390bea3554473a3c2d758f4427755 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 16:32:45.055066 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93182ec-c14b-4e1c-8bb2-d54b10849e7b None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:45.055525 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93182ec-c14b-4e1c-8bb2-d54b10849e7b None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:45.055957 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93182ec-c14b-4e1c-8bb2-d54b10849e7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:45.082901 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-a93182ec-c14b-4e1c-8bb2-d54b10849e7b None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:32:45.084111 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-a93182ec-c14b-4e1c-8bb2-d54b10849e7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:45.156882 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e828c71e-5bc8-4aca-b88e-6cdbd3d26f79 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:45.190124 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 967/1910] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:32:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:32:45.193027 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:32:45.195892 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981b9d7f-8457-4a92-8e64-9cf7e629ef72 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:45.196219 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981b9d7f-8457-4a92-8e64-9cf7e629ef72 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:45.197534 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981b9d7f-8457-4a92-8e64-9cf7e629ef72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:45.223404 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-981b9d7f-8457-4a92-8e64-9cf7e629ef72 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:32:45.226144 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-981b9d7f-8457-4a92-8e64-9cf7e629ef72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:45.236031 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 968/1911] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:32:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:32:45.241578 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981b9d7f-8457-4a92-8e64-9cf7e629ef72 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:45.243719 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-981b9d7f-8457-4a92-8e64-9cf7e629ef72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:45.248694 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2ba743-d605-4655-8e23-a275ec7e7074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:45.249656 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2ba743-d605-4655-8e23-a275ec7e7074 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:45.250391 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2ba743-d605-4655-8e23-a275ec7e7074 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:45.250860 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2ba743-d605-4655-8e23-a275ec7e7074 admin admin] PATH_INFO: `/v3/projects/d73fe898cd614f938d64d07affb978bc` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:45.252825 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2ba743-d605-4655-8e23-a275ec7e7074 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d73fe898cd614f938d64d07affb978bc)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:45.254805 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2ba743-d605-4655-8e23-a275ec7e7074 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:45.323485 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-dd2ba743-d605-4655-8e23-a275ec7e7074 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd73fe898cd614f938d64d07affb978bc', 'request_id': 'req-dd2ba743-d605-4655-8e23-a275ec7e7074'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:45.325409 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981b9d7f-8457-4a92-8e64-9cf7e629ef72 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:45.336250 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:32:45.340635 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-dd2ba743-d605-4655-8e23-a275ec7e7074 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd73fe898cd614f938d64d07affb978bc', 'request_id': 'req-dd2ba743-d605-4655-8e23-a275ec7e7074'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:45.356146 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-dd2ba743-d605-4655-8e23-a275ec7e7074 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd73fe898cd614f938d64d07affb978bc', 'request_id': 'req-dd2ba743-d605-4655-8e23-a275ec7e7074'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:45.378920 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-dd2ba743-d605-4655-8e23-a275ec7e7074 admin admin] The token cache is being invalidate because project d73fe898cd614f938d64d07affb978bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81445) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 16:32:45.379098 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-dd2ba743-d605-4655-8e23-a275ec7e7074 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:45.379894 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-dd2ba743-d605-4655-8e23-a275ec7e7074 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:45.381473 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 944/1912] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 16:32:45 2022] DELETE /identity/v3/projects/d73fe898cd614f938d64d07affb978bc => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:32:45.382431 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2ba743-d605-4655-8e23-a275ec7e7074 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:45.386605 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-dd2ba743-d605-4655-8e23-a275ec7e7074 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:45.414015 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a52cfb-90d7-4e32-81c2-626fdfb2ff7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f44bfdd5214e8d84a2c0a5b1fd9b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:45.414716 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a52cfb-90d7-4e32-81c2-626fdfb2ff7e service neutron] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:45.414997 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a52cfb-90d7-4e32-81c2-626fdfb2ff7e service neutron] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:45.415266 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a52cfb-90d7-4e32-81c2-626fdfb2ff7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:45.417556 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-d9a52cfb-90d7-4e32-81c2-626fdfb2ff7e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:45.480315 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2ba743-d605-4655-8e23-a275ec7e7074 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:45.485804 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06539159-62fa-4de6-b2ad-4981492217ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f44bfdd5214e8d84a2c0a5b1fd9b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:45.487598 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06539159-62fa-4de6-b2ad-4981492217ea service neutron] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:45.487960 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06539159-62fa-4de6-b2ad-4981492217ea service neutron] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:45.488597 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06539159-62fa-4de6-b2ad-4981492217ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:45.490895 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-06539159-62fa-4de6-b2ad-4981492217ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:45.505676 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a52cfb-90d7-4e32-81c2-626fdfb2ff7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:45.508149 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a52cfb-90d7-4e32-81c2-626fdfb2ff7e service neutron] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:45.523712 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 969/1913] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:32:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:32:45.525371 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b931e4a-1811-4ec7-bdbf-0c0c14de005e None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:45.525717 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b931e4a-1811-4ec7-bdbf-0c0c14de005e None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:45.526051 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b931e4a-1811-4ec7-bdbf-0c0c14de005e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:45.551443 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-7b931e4a-1811-4ec7-bdbf-0c0c14de005e None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:32:45.552836 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-7b931e4a-1811-4ec7-bdbf-0c0c14de005e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:45.562919 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 970/1914] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:32:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:32:45.570447 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3a61c9-f646-4e4c-829d-58f0a5ebda68 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:45.570870 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3a61c9-f646-4e4c-829d-58f0a5ebda68 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:45.571149 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3a61c9-f646-4e4c-829d-58f0a5ebda68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:45.574530 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06539159-62fa-4de6-b2ad-4981492217ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:45.577422 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06539159-62fa-4de6-b2ad-4981492217ea service neutron] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:45.588374 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 945/1915] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:32:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:32:45.604219 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-8b3a61c9-f646-4e4c-829d-58f0a5ebda68 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:32:45.605936 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-8b3a61c9-f646-4e4c-829d-58f0a5ebda68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:45.621245 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 971/1916] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:32:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:32:45.623438 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06539159-62fa-4de6-b2ad-4981492217ea service neutron] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:45.634922 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06539159-62fa-4de6-b2ad-4981492217ea service neutron] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:45.644125 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d807914-55c6-47a7-a64b-03eb4b832a29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:45.644922 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d807914-55c6-47a7-a64b-03eb4b832a29 admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:45.645381 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d807914-55c6-47a7-a64b-03eb4b832a29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:45.645840 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d807914-55c6-47a7-a64b-03eb4b832a29 admin admin] PATH_INFO: `/v3/domains` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:45.646853 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d807914-55c6-47a7-a64b-03eb4b832a29 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:32:45.647335 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d807914-55c6-47a7-a64b-03eb4b832a29 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:45.649268 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d807914-55c6-47a7-a64b-03eb4b832a29 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:45.657883 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:32:45.672166 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3a61c9-f646-4e4c-829d-58f0a5ebda68 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:45.677499 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 946/1917] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Sep 9 16:32:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:32:45.686528 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3a61c9-f646-4e4c-829d-58f0a5ebda68 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:45.697182 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884dcbfc-4a8a-408f-9a22-cce3831c5de0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:45.697855 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884dcbfc-4a8a-408f-9a22-cce3831c5de0 admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:45.698134 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884dcbfc-4a8a-408f-9a22-cce3831c5de0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:45.698522 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884dcbfc-4a8a-408f-9a22-cce3831c5de0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:45.699161 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884dcbfc-4a8a-408f-9a22-cce3831c5de0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:45.702001 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884dcbfc-4a8a-408f-9a22-cce3831c5de0 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:45.747577 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 972/1918] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 16:32:45 2022] POST /identity/v3/projects => generated 375 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 16:32:45.748896 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d807914-55c6-47a7-a64b-03eb4b832a29 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:45.760148 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d807914-55c6-47a7-a64b-03eb4b832a29 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:45.863126 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bf7c52-0290-49fc-8443-541bd714cac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:45.863126 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bf7c52-0290-49fc-8443-541bd714cac9 admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:45.863126 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bf7c52-0290-49fc-8443-541bd714cac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:45.863126 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bf7c52-0290-49fc-8443-541bd714cac9 admin admin] PATH_INFO: `/v3/users` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:45.863472 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bf7c52-0290-49fc-8443-541bd714cac9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:45.865353 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bf7c52-0290-49fc-8443-541bd714cac9 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:45.904810 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 947/1919] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 16:32:45 2022] POST /identity/v3/users => generated 288 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 16:32:45.908192 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884dcbfc-4a8a-408f-9a22-cce3831c5de0 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:45.922886 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884dcbfc-4a8a-408f-9a22-cce3831c5de0 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:45.929223 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9f1231-d95c-4ae7-afe4-cbd1dd12bfdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:45.929843 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9f1231-d95c-4ae7-afe4-cbd1dd12bfdd admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:45.930117 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9f1231-d95c-4ae7-afe4-cbd1dd12bfdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:45.930464 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9f1231-d95c-4ae7-afe4-cbd1dd12bfdd admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:45.931208 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9f1231-d95c-4ae7-afe4-cbd1dd12bfdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:45.932688 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9f1231-d95c-4ae7-afe4-cbd1dd12bfdd admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:45.949939 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bf7c52-0290-49fc-8443-541bd714cac9 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:45.950123 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 973/1920] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:32:45 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:32:45.964116 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bf7c52-0290-49fc-8443-541bd714cac9 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:45.974484 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d42cdd6-c1ef-4897-8939-9c30b487244c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:45.974646 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d42cdd6-c1ef-4897-8939-9c30b487244c admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:45.974938 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d42cdd6-c1ef-4897-8939-9c30b487244c admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:45.975214 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d42cdd6-c1ef-4897-8939-9c30b487244c admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:45.975865 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d42cdd6-c1ef-4897-8939-9c30b487244c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:45.979550 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d42cdd6-c1ef-4897-8939-9c30b487244c admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:45.997328 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 948/1921] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:32:45 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:32:45.999634 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9f1231-d95c-4ae7-afe4-cbd1dd12bfdd admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:46.012669 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9f1231-d95c-4ae7-afe4-cbd1dd12bfdd admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:46.031040 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867441a5-c129-4887-9b07-136f475ed675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:46.031733 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867441a5-c129-4887-9b07-136f475ed675 admin admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:46.032006 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867441a5-c129-4887-9b07-136f475ed675 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:46.032274 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867441a5-c129-4887-9b07-136f475ed675 admin admin] PATH_INFO: `/v3/projects/3ee7494cbd584a208a40d6b2cc1cf15a/users/ffa74f50dd5540cdac3a66466bdcedac/roles/b38e84bf077846ee802e6bb1bad83522` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:46.050062 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867441a5-c129-4887-9b07-136f475ed675 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ee7494cbd584a208a40d6b2cc1cf15a, user_id=ffa74f50dd5540cdac3a66466bdcedac, role_id=b38e84bf077846ee802e6bb1bad83522)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:46.052777 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867441a5-c129-4887-9b07-136f475ed675 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:46.070325 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 974/1922] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 16:32:45 2022] PUT /identity/v3/projects/3ee7494cbd584a208a40d6b2cc1cf15a/users/ffa74f50dd5540cdac3a66466bdcedac/roles/b38e84bf077846ee802e6bb1bad83522 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:32:46.083247 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3ccc55-5580-4a65-902a-669bd03b58cb None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:46.083655 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3ccc55-5580-4a65-902a-669bd03b58cb None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:46.084025 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3ccc55-5580-4a65-902a-669bd03b58cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:46.131148 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-1b3ccc55-5580-4a65-902a-669bd03b58cb None None] MFA Rules not processed for user `ffa74f50dd5540cdac3a66466bdcedac`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:32:46.131148 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-1b3ccc55-5580-4a65-902a-669bd03b58cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:46.184986 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867441a5-c129-4887-9b07-136f475ed675 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:46.187312 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-867441a5-c129-4887-9b07-136f475ed675 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:46.234438 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 949/1923] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:32:46 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:32:46.252089 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3ccc55-5580-4a65-902a-669bd03b58cb None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:46.305398 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:32:46.326637 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867441a5-c129-4887-9b07-136f475ed675 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:46.333946 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0222c4-2b52-47eb-b04b-947e95b16972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:46.336334 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0222c4-2b52-47eb-b04b-947e95b16972 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:46.336334 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0222c4-2b52-47eb-b04b-947e95b16972 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:46.336585 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0222c4-2b52-47eb-b04b-947e95b16972 admin admin] PATH_INFO: `/v3/projects/784568b8a3f84aeb8360da94698107eb` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:46.338108 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0222c4-2b52-47eb-b04b-947e95b16972 admin admin] RBAC: Authorizing `identity:delete_project(project_id=784568b8a3f84aeb8360da94698107eb)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:46.340455 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0222c4-2b52-47eb-b04b-947e95b16972 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:46.390174 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3ccc55-5580-4a65-902a-669bd03b58cb None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:46.400140 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-3a0222c4-2b52-47eb-b04b-947e95b16972 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '784568b8a3f84aeb8360da94698107eb', 'request_id': 'req-3a0222c4-2b52-47eb-b04b-947e95b16972'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:46.400321 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:32:46.407336 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-3a0222c4-2b52-47eb-b04b-947e95b16972 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '784568b8a3f84aeb8360da94698107eb', 'request_id': 'req-3a0222c4-2b52-47eb-b04b-947e95b16972'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:46.415902 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-3a0222c4-2b52-47eb-b04b-947e95b16972 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '784568b8a3f84aeb8360da94698107eb', 'request_id': 'req-3a0222c4-2b52-47eb-b04b-947e95b16972'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:46.430627 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-3a0222c4-2b52-47eb-b04b-947e95b16972 admin admin] The token cache is being invalidate because project 784568b8a3f84aeb8360da94698107eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81446) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 16:32:46.431467 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-3a0222c4-2b52-47eb-b04b-947e95b16972 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:46.431850 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-3a0222c4-2b52-47eb-b04b-947e95b16972 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:46.434735 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 975/1924] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 16:32:46 2022] DELETE /identity/v3/projects/784568b8a3f84aeb8360da94698107eb => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 16:32:46.440415 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dc163e-dfa6-4f17-a94b-3a84e052558d None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:46.441012 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dc163e-dfa6-4f17-a94b-3a84e052558d None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:46.441285 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dc163e-dfa6-4f17-a94b-3a84e052558d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:46.462939 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-f8dc163e-dfa6-4f17-a94b-3a84e052558d None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:32:46.463869 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-f8dc163e-dfa6-4f17-a94b-3a84e052558d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:46.472822 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a52033b-2816-449f-abe1-fa9ba7622b77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:46.473814 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a52033b-2816-449f-abe1-fa9ba7622b77 admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:46.474179 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a52033b-2816-449f-abe1-fa9ba7622b77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:46.474629 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a52033b-2816-449f-abe1-fa9ba7622b77 admin admin] PATH_INFO: `/v3/projects` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:46.475738 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a52033b-2816-449f-abe1-fa9ba7622b77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:46.477910 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a52033b-2816-449f-abe1-fa9ba7622b77 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:46.511260 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 950/1925] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 16:32:46 2022] POST /identity/v3/projects => generated 377 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:32:46.515322 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a52033b-2816-449f-abe1-fa9ba7622b77 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:46.517319 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-4a52033b-2816-449f-abe1-fa9ba7622b77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:46.532672 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 976/1926] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:32:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 16:32:46.540298 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7419d486-5535-4af5-9827-71a865e05b13 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:46.540572 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7419d486-5535-4af5-9827-71a865e05b13 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:46.540847 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7419d486-5535-4af5-9827-71a865e05b13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:46.560920 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-7419d486-5535-4af5-9827-71a865e05b13 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:32:46.562115 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-7419d486-5535-4af5-9827-71a865e05b13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:46.595394 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a52033b-2816-449f-abe1-fa9ba7622b77 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:46.601336 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f13b472-a78a-4e33-b96d-7e65786757c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:46.601949 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f13b472-a78a-4e33-b96d-7e65786757c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:46.602415 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f13b472-a78a-4e33-b96d-7e65786757c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:46.603212 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f13b472-a78a-4e33-b96d-7e65786757c4 admin admin] PATH_INFO: `/v3/users` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:46.603860 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f13b472-a78a-4e33-b96d-7e65786757c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:46.606582 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f13b472-a78a-4e33-b96d-7e65786757c4 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:46.628981 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 977/1927] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:32:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 16:32:46.631858 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 951/1928] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 16:32:46 2022] POST /identity/v3/users => generated 289 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 16:32:46.635980 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7419d486-5535-4af5-9827-71a865e05b13 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:46.637079 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f13b472-a78a-4e33-b96d-7e65786757c4 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:46.648897 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f13b472-a78a-4e33-b96d-7e65786757c4 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:46.649043 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7419d486-5535-4af5-9827-71a865e05b13 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:46.654621 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726876a2-a70c-4795-b526-be956ab8c7e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:46.655288 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726876a2-a70c-4795-b526-be956ab8c7e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:46.655565 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726876a2-a70c-4795-b526-be956ab8c7e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:46.655894 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726876a2-a70c-4795-b526-be956ab8c7e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:46.656557 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726876a2-a70c-4795-b526-be956ab8c7e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:32:46.656862 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726876a2-a70c-4795-b526-be956ab8c7e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:46.658502 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726876a2-a70c-4795-b526-be956ab8c7e9 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:46.667090 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ede205c-bb25-40ea-bd5a-cded151f897d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:46.667319 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ede205c-bb25-40ea-bd5a-cded151f897d admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:46.667554 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ede205c-bb25-40ea-bd5a-cded151f897d admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:46.667757 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ede205c-bb25-40ea-bd5a-cded151f897d admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:46.668381 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ede205c-bb25-40ea-bd5a-cded151f897d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:46.670691 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ede205c-bb25-40ea-bd5a-cded151f897d admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:46.675856 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 978/1929] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Sep 9 16:32:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 16:32:46.680343 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726876a2-a70c-4795-b526-be956ab8c7e9 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:46.685298 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 952/1930] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:32:46 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:32:46.686467 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ede205c-bb25-40ea-bd5a-cded151f897d admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:46.692524 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726876a2-a70c-4795-b526-be956ab8c7e9 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:46.697297 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ede205c-bb25-40ea-bd5a-cded151f897d admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:46.697678 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56a54af-b651-4902-89d8-d5150f16bf6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:46.698411 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56a54af-b651-4902-89d8-d5150f16bf6a admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:46.698790 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56a54af-b651-4902-89d8-d5150f16bf6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:46.699160 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56a54af-b651-4902-89d8-d5150f16bf6a admin admin] PATH_INFO: `/v3/projects` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:46.699889 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56a54af-b651-4902-89d8-d5150f16bf6a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:46.701928 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56a54af-b651-4902-89d8-d5150f16bf6a admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:46.702028 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eb00c9-9214-4c8c-9b87-a1dffd3c66aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:46.702606 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eb00c9-9214-4c8c-9b87-a1dffd3c66aa admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:46.702883 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eb00c9-9214-4c8c-9b87-a1dffd3c66aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:46.703214 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eb00c9-9214-4c8c-9b87-a1dffd3c66aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:46.703975 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61eb00c9-9214-4c8c-9b87-a1dffd3c66aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:46.705557 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61eb00c9-9214-4c8c-9b87-a1dffd3c66aa admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:46.708881 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:32:46.721285 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 953/1931] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:32:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 16:32:46.722388 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eb00c9-9214-4c8c-9b87-a1dffd3c66aa admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:46.735185 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eb00c9-9214-4c8c-9b87-a1dffd3c66aa admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:46.740503 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2507e1-3351-45b3-84a7-53383c9e9efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:46.741155 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2507e1-3351-45b3-84a7-53383c9e9efb admin admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:46.741434 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2507e1-3351-45b3-84a7-53383c9e9efb admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:46.741702 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2507e1-3351-45b3-84a7-53383c9e9efb admin admin] PATH_INFO: `/v3/projects/555948e193c045e1a8fa7a63274b0a36/users/efbb1b4ac2f24e64a6fdf271a875e9e6/roles/b38e84bf077846ee802e6bb1bad83522` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:46.743877 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 979/1932] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 16:32:46 2022] POST /identity/v3/projects => generated 383 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 16:32:46.746290 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56a54af-b651-4902-89d8-d5150f16bf6a admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:46.751351 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-e56a54af-b651-4902-89d8-d5150f16bf6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:46.762258 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2507e1-3351-45b3-84a7-53383c9e9efb admin admin] RBAC: Authorizing `identity:create_grant(project_id=555948e193c045e1a8fa7a63274b0a36, user_id=efbb1b4ac2f24e64a6fdf271a875e9e6, role_id=b38e84bf077846ee802e6bb1bad83522)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:46.765013 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2507e1-3351-45b3-84a7-53383c9e9efb admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:46.788300 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 954/1933] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 16:32:46 2022] PUT /identity/v3/projects/555948e193c045e1a8fa7a63274b0a36/users/efbb1b4ac2f24e64a6fdf271a875e9e6/roles/b38e84bf077846ee802e6bb1bad83522 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 16:32:46.788300 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2507e1-3351-45b3-84a7-53383c9e9efb admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:46.841070 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:32:46.860717 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2507e1-3351-45b3-84a7-53383c9e9efb admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:46.863267 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56a54af-b651-4902-89d8-d5150f16bf6a admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:46.865479 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09a7ba6-b0be-43d1-9eb2-3bf51e9fc33b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:46.866087 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09a7ba6-b0be-43d1-9eb2-3bf51e9fc33b admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:46.866397 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09a7ba6-b0be-43d1-9eb2-3bf51e9fc33b admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:46.866677 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09a7ba6-b0be-43d1-9eb2-3bf51e9fc33b admin admin] PATH_INFO: `/v3/users` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:46.867297 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09a7ba6-b0be-43d1-9eb2-3bf51e9fc33b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:46.869258 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09a7ba6-b0be-43d1-9eb2-3bf51e9fc33b admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:46.870992 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df676151-f3d0-4fb6-9c15-689afb549de0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:46.873433 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df676151-f3d0-4fb6-9c15-689afb549de0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:46.873980 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df676151-f3d0-4fb6-9c15-689afb549de0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:46.874484 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df676151-f3d0-4fb6-9c15-689afb549de0 admin admin] PATH_INFO: `/v3/projects/46e93cf2ec4b49168be7d648df93a5d6` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:46.876020 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df676151-f3d0-4fb6-9c15-689afb549de0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=46e93cf2ec4b49168be7d648df93a5d6)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:46.879045 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df676151-f3d0-4fb6-9c15-689afb549de0 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:46.898351 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 955/1934] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 16:32:46 2022] POST /identity/v3/users => generated 292 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:32:46.902922 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9387c6a3-ca6f-4d18-9abc-cf45e6bf4a56 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:46.903209 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9387c6a3-ca6f-4d18-9abc-cf45e6bf4a56 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:46.903584 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9387c6a3-ca6f-4d18-9abc-cf45e6bf4a56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:46.936357 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-9387c6a3-ca6f-4d18-9abc-cf45e6bf4a56 None None] MFA Rules not processed for user `efbb1b4ac2f24e64a6fdf271a875e9e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:32:46.937693 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-9387c6a3-ca6f-4d18-9abc-cf45e6bf4a56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:46.953228 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-df676151-f3d0-4fb6-9c15-689afb549de0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46e93cf2ec4b49168be7d648df93a5d6', 'request_id': 'req-df676151-f3d0-4fb6-9c15-689afb549de0'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:46.967280 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-df676151-f3d0-4fb6-9c15-689afb549de0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46e93cf2ec4b49168be7d648df93a5d6', 'request_id': 'req-df676151-f3d0-4fb6-9c15-689afb549de0'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:47.007922 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-df676151-f3d0-4fb6-9c15-689afb549de0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46e93cf2ec4b49168be7d648df93a5d6', 'request_id': 'req-df676151-f3d0-4fb6-9c15-689afb549de0'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:47.036226 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-df676151-f3d0-4fb6-9c15-689afb549de0 admin admin] The token cache is being invalidate because project 46e93cf2ec4b49168be7d648df93a5d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81446) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 16:32:47.038065 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-df676151-f3d0-4fb6-9c15-689afb549de0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:47.039315 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-df676151-f3d0-4fb6-9c15-689afb549de0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:47.045847 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 980/1935] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 16:32:46 2022] DELETE /identity/v3/projects/46e93cf2ec4b49168be7d648df93a5d6 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:32:47.045847 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df676151-f3d0-4fb6-9c15-689afb549de0 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:47.048317 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-df676151-f3d0-4fb6-9c15-689afb549de0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:47.057259 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 956/1936] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:32:46 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:32:47.057259 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9387c6a3-ca6f-4d18-9abc-cf45e6bf4a56 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:47.175053 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9387c6a3-ca6f-4d18-9abc-cf45e6bf4a56 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:47.180302 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df676151-f3d0-4fb6-9c15-689afb549de0 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:47.187753 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f52582-29de-43b7-9512-c9e501a965c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:47.188369 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f52582-29de-43b7-9512-c9e501a965c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:47.188648 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f52582-29de-43b7-9512-c9e501a965c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:47.188888 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6387c7c0-8b71-4442-97a2-88d2a359cb2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:47.189015 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f52582-29de-43b7-9512-c9e501a965c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:47.189629 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f52582-29de-43b7-9512-c9e501a965c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:47.189766 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6387c7c0-8b71-4442-97a2-88d2a359cb2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:47.191228 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6387c7c0-8b71-4442-97a2-88d2a359cb2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:47.191570 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6387c7c0-8b71-4442-97a2-88d2a359cb2d admin admin] PATH_INFO: `/v3/users/ff263d9807364222b97a8afab79c01e3` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:47.192558 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f52582-29de-43b7-9512-c9e501a965c1 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:47.193968 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6387c7c0-8b71-4442-97a2-88d2a359cb2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff263d9807364222b97a8afab79c01e3)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:47.197966 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6387c7c0-8b71-4442-97a2-88d2a359cb2d admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:47.210462 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 981/1937] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:32:47 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:32:47.212483 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f52582-29de-43b7-9512-c9e501a965c1 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:47.218337 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-78f52582-29de-43b7-9512-c9e501a965c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:47.244436 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f52582-29de-43b7-9512-c9e501a965c1 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:47.251285 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8068d031-bfa5-40ca-acc1-212280857cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:47.251980 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8068d031-bfa5-40ca-acc1-212280857cde admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:47.252590 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8068d031-bfa5-40ca-acc1-212280857cde admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:47.252887 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8068d031-bfa5-40ca-acc1-212280857cde admin admin] PATH_INFO: `/v3/projects` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:47.253531 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8068d031-bfa5-40ca-acc1-212280857cde admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:47.255835 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8068d031-bfa5-40ca-acc1-212280857cde admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:47.288119 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:32:47.319222 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-6387c7c0-8b71-4442-97a2-88d2a359cb2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff263d9807364222b97a8afab79c01e3'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:47.322690 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 982/1938] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 16:32:47 2022] POST /identity/v3/projects => generated 377 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:32:47.323586 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8068d031-bfa5-40ca-acc1-212280857cde admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:47.332939 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-6387c7c0-8b71-4442-97a2-88d2a359cb2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff263d9807364222b97a8afab79c01e3'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:47.334789 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-6387c7c0-8b71-4442-97a2-88d2a359cb2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff263d9807364222b97a8afab79c01e3'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:47.346568 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-6387c7c0-8b71-4442-97a2-88d2a359cb2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff263d9807364222b97a8afab79c01e3'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:47.349131 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:32:47.371733 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-6387c7c0-8b71-4442-97a2-88d2a359cb2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff263d9807364222b97a8afab79c01e3'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:47.385583 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 957/1939] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 16:32:47 2022] DELETE /identity/v3/users/ff263d9807364222b97a8afab79c01e3 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:32:47.385583 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6387c7c0-8b71-4442-97a2-88d2a359cb2d admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:47.385937 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-6387c7c0-8b71-4442-97a2-88d2a359cb2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:47.431748 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8068d031-bfa5-40ca-acc1-212280857cde admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:47.521254 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d70bd52-cad1-4306-a567-6a8aede8d456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:47.521837 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6387c7c0-8b71-4442-97a2-88d2a359cb2d admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:47.522341 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d70bd52-cad1-4306-a567-6a8aede8d456 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:47.523003 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d70bd52-cad1-4306-a567-6a8aede8d456 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:47.523509 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d70bd52-cad1-4306-a567-6a8aede8d456 admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:47.524463 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d70bd52-cad1-4306-a567-6a8aede8d456 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:47.527340 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d70bd52-cad1-4306-a567-6a8aede8d456 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:47.529425 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a5eec7-fc31-489c-983e-92074cf0a731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:47.530045 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a5eec7-fc31-489c-983e-92074cf0a731 admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:47.530345 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a5eec7-fc31-489c-983e-92074cf0a731 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:47.530621 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a5eec7-fc31-489c-983e-92074cf0a731 admin admin] PATH_INFO: `/v3/users` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:47.532018 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a5eec7-fc31-489c-983e-92074cf0a731 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:47.534202 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a5eec7-fc31-489c-983e-92074cf0a731 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:47.546328 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 983/1940] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:32:47 2022] GET /identity/v3/roles => generated 1420 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:32:47.550601 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d70bd52-cad1-4306-a567-6a8aede8d456 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:47.553623 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-8d70bd52-cad1-4306-a567-6a8aede8d456 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:47.572369 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 958/1941] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 16:32:47 2022] POST /identity/v3/users => generated 295 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:32:47.577101 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a5eec7-fc31-489c-983e-92074cf0a731 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:47.590654 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a5eec7-fc31-489c-983e-92074cf0a731 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:47.598671 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d70bd52-cad1-4306-a567-6a8aede8d456 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:47.600276 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c228a7b-e42d-4372-9900-db57aaf5052c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:47.601106 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c228a7b-e42d-4372-9900-db57aaf5052c admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:47.601424 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c228a7b-e42d-4372-9900-db57aaf5052c admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:47.601671 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c228a7b-e42d-4372-9900-db57aaf5052c admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:47.602439 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c228a7b-e42d-4372-9900-db57aaf5052c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:47.604838 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c228a7b-e42d-4372-9900-db57aaf5052c admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:47.608186 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec43755-8995-445f-9285-3436d1ddf0d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:47.608964 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec43755-8995-445f-9285-3436d1ddf0d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:47.609346 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec43755-8995-445f-9285-3436d1ddf0d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:47.609901 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec43755-8995-445f-9285-3436d1ddf0d0 admin admin] PATH_INFO: `/v3/projects/7b74fca3d412400ca5865c7be7bd5e04/users/c2eff9bc7f914f0fb4b354df01648743/roles/b38e84bf077846ee802e6bb1bad83522` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:47.620300 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 959/1942] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:32:47 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:32:47.621353 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c228a7b-e42d-4372-9900-db57aaf5052c admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:47.629229 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec43755-8995-445f-9285-3436d1ddf0d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b74fca3d412400ca5865c7be7bd5e04, user_id=c2eff9bc7f914f0fb4b354df01648743, role_id=b38e84bf077846ee802e6bb1bad83522)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:47.633198 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec43755-8995-445f-9285-3436d1ddf0d0 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:47.633722 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c228a7b-e42d-4372-9900-db57aaf5052c admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:47.645374 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38ee9e6-03c0-4522-a126-fff5d6206139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:47.645998 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38ee9e6-03c0-4522-a126-fff5d6206139 admin admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:47.647553 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38ee9e6-03c0-4522-a126-fff5d6206139 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:47.648062 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38ee9e6-03c0-4522-a126-fff5d6206139 admin admin] PATH_INFO: `/v3/projects/0ca1280ed95146d4a34096709eb7591e/users/fe3221c6e9a241f5913443c2354d5b78/roles/0a36d1be416f4089be19be979943b731` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:47.664664 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 984/1943] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 16:32:47 2022] PUT /identity/v3/projects/7b74fca3d412400ca5865c7be7bd5e04/users/c2eff9bc7f914f0fb4b354df01648743/roles/b38e84bf077846ee802e6bb1bad83522 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:32:47.676266 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3bb244-5e79-4129-bbb9-48e4716809fa None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:47.676635 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3bb244-5e79-4129-bbb9-48e4716809fa None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:47.676973 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3bb244-5e79-4129-bbb9-48e4716809fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:47.685325 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38ee9e6-03c0-4522-a126-fff5d6206139 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ca1280ed95146d4a34096709eb7591e, user_id=fe3221c6e9a241f5913443c2354d5b78, role_id=0a36d1be416f4089be19be979943b731)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:47.689942 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38ee9e6-03c0-4522-a126-fff5d6206139 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:47.722431 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 960/1944] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 16:32:47 2022] PUT /identity/v3/projects/0ca1280ed95146d4a34096709eb7591e/users/fe3221c6e9a241f5913443c2354d5b78/roles/0a36d1be416f4089be19be979943b731 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:32:47.728020 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38ee9e6-03c0-4522-a126-fff5d6206139 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:47.740429 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-fc3bb244-5e79-4129-bbb9-48e4716809fa None None] MFA Rules not processed for user `c2eff9bc7f914f0fb4b354df01648743`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:32:47.741776 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-fc3bb244-5e79-4129-bbb9-48e4716809fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:47.809992 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38ee9e6-03c0-4522-a126-fff5d6206139 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:47.815084 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775d8858-416a-4f8b-b109-4af78581e41c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:47.816086 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775d8858-416a-4f8b-b109-4af78581e41c admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:47.816374 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775d8858-416a-4f8b-b109-4af78581e41c admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:47.816637 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775d8858-416a-4f8b-b109-4af78581e41c admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:47.817275 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775d8858-416a-4f8b-b109-4af78581e41c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:47.818916 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775d8858-416a-4f8b-b109-4af78581e41c admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:47.830351 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 961/1945] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:32:47 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:32:47.830945 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775d8858-416a-4f8b-b109-4af78581e41c admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:47.832864 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-775d8858-416a-4f8b-b109-4af78581e41c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:47.839241 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:32:47.848283 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775d8858-416a-4f8b-b109-4af78581e41c admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:47.849015 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 985/1946] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:32:47 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:32:47.850356 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3bb244-5e79-4129-bbb9-48e4716809fa None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:47.857482 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7566879e-ca8e-4cdc-b935-c5fd4595a5f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:47.858174 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7566879e-ca8e-4cdc-b935-c5fd4595a5f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:47.858606 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7566879e-ca8e-4cdc-b935-c5fd4595a5f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:47.858876 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7566879e-ca8e-4cdc-b935-c5fd4595a5f8 admin admin] PATH_INFO: `/v3/users/d73862fa25564450a5841678df6555cc` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:47.860158 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7566879e-ca8e-4cdc-b935-c5fd4595a5f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d73862fa25564450a5841678df6555cc)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:47.862138 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7566879e-ca8e-4cdc-b935-c5fd4595a5f8 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:47.864323 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3bb244-5e79-4129-bbb9-48e4716809fa None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:47.870639 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf50195-269b-4ab6-a08f-5c84862f02f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:47.871479 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf50195-269b-4ab6-a08f-5c84862f02f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:47.871843 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf50195-269b-4ab6-a08f-5c84862f02f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:47.872157 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf50195-269b-4ab6-a08f-5c84862f02f7 admin admin] PATH_INFO: `/v3/projects/0ca1280ed95146d4a34096709eb7591e/users/fe3221c6e9a241f5913443c2354d5b78/roles/0a36d1be416f4089be19be979943b731` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:47.874467 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf50195-269b-4ab6-a08f-5c84862f02f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ca1280ed95146d4a34096709eb7591e, user_id=fe3221c6e9a241f5913443c2354d5b78, role_id=0a36d1be416f4089be19be979943b731)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:47.877734 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf50195-269b-4ab6-a08f-5c84862f02f7 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:47.893781 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 986/1947] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 16:32:47 2022] PUT /identity/v3/projects/0ca1280ed95146d4a34096709eb7591e/users/fe3221c6e9a241f5913443c2354d5b78/roles/0a36d1be416f4089be19be979943b731 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:32:47.895113 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf50195-269b-4ab6-a08f-5c84862f02f7 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:47.900046 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:32:47.939344 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-7566879e-ca8e-4cdc-b935-c5fd4595a5f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd73862fa25564450a5841678df6555cc'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:47.947593 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-7566879e-ca8e-4cdc-b935-c5fd4595a5f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd73862fa25564450a5841678df6555cc'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:47.948376 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-7566879e-ca8e-4cdc-b935-c5fd4595a5f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd73862fa25564450a5841678df6555cc'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:47.956246 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-7566879e-ca8e-4cdc-b935-c5fd4595a5f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd73862fa25564450a5841678df6555cc'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:47.969434 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-7566879e-ca8e-4cdc-b935-c5fd4595a5f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd73862fa25564450a5841678df6555cc'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:47.975471 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 962/1948] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 16:32:47 2022] DELETE /identity/v3/users/d73862fa25564450a5841678df6555cc => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:32:47.976272 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7566879e-ca8e-4cdc-b935-c5fd4595a5f8 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:47.977613 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf50195-269b-4ab6-a08f-5c84862f02f7 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:47.977727 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-7566879e-ca8e-4cdc-b935-c5fd4595a5f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:48.044064 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea1cdf0-caa6-4507-9222-e02181a785d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:48.045660 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea1cdf0-caa6-4507-9222-e02181a785d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:48.045944 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea1cdf0-caa6-4507-9222-e02181a785d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:48.046092 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7566879e-ca8e-4cdc-b935-c5fd4595a5f8 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:48.046205 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea1cdf0-caa6-4507-9222-e02181a785d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:48.047468 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea1cdf0-caa6-4507-9222-e02181a785d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:48.050065 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea1cdf0-caa6-4507-9222-e02181a785d2 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:48.051014 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb54e3c4-e619-49f8-8863-60542bfa5063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:48.051654 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb54e3c4-e619-49f8-8863-60542bfa5063 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:48.051971 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb54e3c4-e619-49f8-8863-60542bfa5063 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:48.052363 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb54e3c4-e619-49f8-8863-60542bfa5063 admin admin] PATH_INFO: `/v3/projects/eeea2b28a837492781571c6319fe7343` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:48.053645 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb54e3c4-e619-49f8-8863-60542bfa5063 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eeea2b28a837492781571c6319fe7343)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:48.055707 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb54e3c4-e619-49f8-8863-60542bfa5063 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:48.085200 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 987/1949] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 16:32:47 2022] POST /identity/v3/projects => generated 385 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:32:48.087102 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82307450-e199-4d84-83a2-3c319f0a8adc None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:48.087542 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82307450-e199-4d84-83a2-3c319f0a8adc None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:48.088050 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82307450-e199-4d84-83a2-3c319f0a8adc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:48.109362 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-bb54e3c4-e619-49f8-8863-60542bfa5063 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eeea2b28a837492781571c6319fe7343', 'request_id': 'req-bb54e3c4-e619-49f8-8863-60542bfa5063'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:48.115716 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-bb54e3c4-e619-49f8-8863-60542bfa5063 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eeea2b28a837492781571c6319fe7343', 'request_id': 'req-bb54e3c4-e619-49f8-8863-60542bfa5063'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:48.124061 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-82307450-e199-4d84-83a2-3c319f0a8adc None None] MFA Rules not processed for user `fe3221c6e9a241f5913443c2354d5b78`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:32:48.124267 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-bb54e3c4-e619-49f8-8863-60542bfa5063 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eeea2b28a837492781571c6319fe7343', 'request_id': 'req-bb54e3c4-e619-49f8-8863-60542bfa5063'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:48.124474 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-82307450-e199-4d84-83a2-3c319f0a8adc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:48.136473 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-bb54e3c4-e619-49f8-8863-60542bfa5063 admin admin] The token cache is being invalidate because project eeea2b28a837492781571c6319fe7343 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81445) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 16:32:48.137045 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-bb54e3c4-e619-49f8-8863-60542bfa5063 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:48.137711 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-bb54e3c4-e619-49f8-8863-60542bfa5063 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:48.139525 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 963/1950] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 16:32:47 2022] DELETE /identity/v3/projects/eeea2b28a837492781571c6319fe7343 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:32:48.141211 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121b616c-3c14-4c9d-a5bd-5adb8dc57ab5 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:48.141501 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121b616c-3c14-4c9d-a5bd-5adb8dc57ab5 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:48.141770 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121b616c-3c14-4c9d-a5bd-5adb8dc57ab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:48.164392 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-121b616c-3c14-4c9d-a5bd-5adb8dc57ab5 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:32:48.165527 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-121b616c-3c14-4c9d-a5bd-5adb8dc57ab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:48.200448 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:32:48.228853 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 988/1951] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:32:48 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:32:48.233669 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82307450-e199-4d84-83a2-3c319f0a8adc None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:48.233669 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-82307450-e199-4d84-83a2-3c319f0a8adc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:48.240256 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:32:48.244266 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 964/1952] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:32:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:32:48.244266 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a95e6c-52aa-40b7-b51f-476b5bfb5c26 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:48.244266 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a95e6c-52aa-40b7-b51f-476b5bfb5c26 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:48.244266 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a95e6c-52aa-40b7-b51f-476b5bfb5c26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:48.244602 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82307450-e199-4d84-83a2-3c319f0a8adc None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:48.254976 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa71a11d-75da-495e-b1e2-f469fdfa2220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:48.255872 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa71a11d-75da-495e-b1e2-f469fdfa2220 admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:48.256320 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa71a11d-75da-495e-b1e2-f469fdfa2220 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:48.256706 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa71a11d-75da-495e-b1e2-f469fdfa2220 admin admin] PATH_INFO: `/v3/users` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:48.257682 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa71a11d-75da-495e-b1e2-f469fdfa2220 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:48.260910 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa71a11d-75da-495e-b1e2-f469fdfa2220 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:48.266371 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-43a95e6c-52aa-40b7-b51f-476b5bfb5c26 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:32:48.267591 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-43a95e6c-52aa-40b7-b51f-476b5bfb5c26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:48.276315 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 965/1953] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:32:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:32:48.277830 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a95e6c-52aa-40b7-b51f-476b5bfb5c26 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:48.283972 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-43a95e6c-52aa-40b7-b51f-476b5bfb5c26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:48.302051 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 989/1954] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 16:32:48 2022] POST /identity/v3/users => generated 293 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:32:48.302051 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa71a11d-75da-495e-b1e2-f469fdfa2220 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:48.302051 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-fa71a11d-75da-495e-b1e2-f469fdfa2220 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:48.361784 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a95e6c-52aa-40b7-b51f-476b5bfb5c26 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:48.364870 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa71a11d-75da-495e-b1e2-f469fdfa2220 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:48.365599 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d34fb36-0130-4efd-9e1c-bc0bc44c423d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8078e791ba68460f8b3aeafb4b79b73a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:48.366291 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d34fb36-0130-4efd-9e1c-bc0bc44c423d service cinder] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:48.366663 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d34fb36-0130-4efd-9e1c-bc0bc44c423d service cinder] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:48.367103 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d34fb36-0130-4efd-9e1c-bc0bc44c423d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:48.368786 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22893490-e36d-4907-9318-800846cc0a21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f44bfdd5214e8d84a2c0a5b1fd9b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:48.369392 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22893490-e36d-4907-9318-800846cc0a21 service neutron] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:48.369669 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22893490-e36d-4907-9318-800846cc0a21 service neutron] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:48.369943 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22893490-e36d-4907-9318-800846cc0a21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:48.377244 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d34fb36-0130-4efd-9e1c-bc0bc44c423d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:48.378855 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d34fb36-0130-4efd-9e1c-bc0bc44c423d service cinder] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:48.379602 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22893490-e36d-4907-9318-800846cc0a21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:48.381144 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22893490-e36d-4907-9318-800846cc0a21 service neutron] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:48.390284 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 966/1955] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:32:48 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:32:48.391620 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe01e9f-e4b8-46ff-a9bb-d1adfe8dbda2 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:48.391902 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe01e9f-e4b8-46ff-a9bb-d1adfe8dbda2 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:48.392169 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe01e9f-e4b8-46ff-a9bb-d1adfe8dbda2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:48.392783 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 990/1956] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:32:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:32:48.393736 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22893490-e36d-4907-9318-800846cc0a21 service neutron] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:48.404347 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22893490-e36d-4907-9318-800846cc0a21 service neutron] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:48.409333 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7b36b8-0003-4248-8853-0c48513b6bc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:48.409947 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7b36b8-0003-4248-8853-0c48513b6bc1 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:48.410415 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7b36b8-0003-4248-8853-0c48513b6bc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:48.410693 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7b36b8-0003-4248-8853-0c48513b6bc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:48.411467 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7b36b8-0003-4248-8853-0c48513b6bc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:48.413231 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-cbe01e9f-e4b8-46ff-a9bb-d1adfe8dbda2 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:32:48.413570 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7b36b8-0003-4248-8853-0c48513b6bc1 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:48.414757 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-cbe01e9f-e4b8-46ff-a9bb-d1adfe8dbda2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:48.424847 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 967/1957] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:32:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:32:48.428759 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe01e9f-e4b8-46ff-a9bb-d1adfe8dbda2 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:48.438045 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 991/1958] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:32:48 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:32:48.443391 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7b36b8-0003-4248-8853-0c48513b6bc1 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:48.448458 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe01e9f-e4b8-46ff-a9bb-d1adfe8dbda2 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:48.456799 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4311248-29d2-4726-9c78-729a8e152a27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:48.457692 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4311248-29d2-4726-9c78-729a8e152a27 admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:48.457972 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4311248-29d2-4726-9c78-729a8e152a27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:48.458392 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4311248-29d2-4726-9c78-729a8e152a27 admin admin] PATH_INFO: `/v3/domains` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:48.459047 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4311248-29d2-4726-9c78-729a8e152a27 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:32:48.459348 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4311248-29d2-4726-9c78-729a8e152a27 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:48.460144 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7b36b8-0003-4248-8853-0c48513b6bc1 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:48.461316 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4311248-29d2-4726-9c78-729a8e152a27 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:48.466803 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b140a00c-a613-4b0a-a10f-bd639760786b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:48.467552 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b140a00c-a613-4b0a-a10f-bd639760786b admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:48.467893 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b140a00c-a613-4b0a-a10f-bd639760786b admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:48.468287 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b140a00c-a613-4b0a-a10f-bd639760786b admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:48.469196 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b140a00c-a613-4b0a-a10f-bd639760786b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:48.471295 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b140a00c-a613-4b0a-a10f-bd639760786b admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:48.479205 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 968/1959] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Sep 9 16:32:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:32:48.480179 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4311248-29d2-4726-9c78-729a8e152a27 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:48.484774 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-c4311248-29d2-4726-9c78-729a8e152a27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:48.489913 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 992/1960] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:32:48 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:32:48.494246 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b140a00c-a613-4b0a-a10f-bd639760786b admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:48.502508 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4311248-29d2-4726-9c78-729a8e152a27 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:48.507505 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fac1ca-8a39-4e92-8428-7367806f1747 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8078e791ba68460f8b3aeafb4b79b73a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:48.508210 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fac1ca-8a39-4e92-8428-7367806f1747 service cinder] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:48.508489 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fac1ca-8a39-4e92-8428-7367806f1747 service cinder] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:48.508841 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fac1ca-8a39-4e92-8428-7367806f1747 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:48.510020 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b140a00c-a613-4b0a-a10f-bd639760786b admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:48.510977 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-46fac1ca-8a39-4e92-8428-7367806f1747 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:48.514883 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070448ac-f3f3-4c2a-8dc0-3cbfd1fca3e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:48.515530 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070448ac-f3f3-4c2a-8dc0-3cbfd1fca3e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:48.515807 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070448ac-f3f3-4c2a-8dc0-3cbfd1fca3e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:48.516078 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070448ac-f3f3-4c2a-8dc0-3cbfd1fca3e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:48.516710 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070448ac-f3f3-4c2a-8dc0-3cbfd1fca3e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:48.519423 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070448ac-f3f3-4c2a-8dc0-3cbfd1fca3e9 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:48.562457 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 993/1961] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 16:32:48 2022] POST /identity/v3/projects => generated 367 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:32:48.563418 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070448ac-f3f3-4c2a-8dc0-3cbfd1fca3e9 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:48.598409 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fac1ca-8a39-4e92-8428-7367806f1747 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:48.600826 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fac1ca-8a39-4e92-8428-7367806f1747 service cinder] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:48.612193 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 969/1962] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:32:48 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:32:48.613092 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fac1ca-8a39-4e92-8428-7367806f1747 service cinder] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:48.626683 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fac1ca-8a39-4e92-8428-7367806f1747 service cinder] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:48.648424 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070448ac-f3f3-4c2a-8dc0-3cbfd1fca3e9 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:48.653666 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2891ae20-da98-4a20-8aad-bc5cabc491fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:48.654481 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2891ae20-da98-4a20-8aad-bc5cabc491fe admin admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:48.655182 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2891ae20-da98-4a20-8aad-bc5cabc491fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:48.655182 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2891ae20-da98-4a20-8aad-bc5cabc491fe admin admin] PATH_INFO: `/v3/projects/cb911304574d4bccbe6b543ff994833a/users/5ee59ae4e96541bb964841051ab33629/roles/b38e84bf077846ee802e6bb1bad83522` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:48.688711 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2891ae20-da98-4a20-8aad-bc5cabc491fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb911304574d4bccbe6b543ff994833a, user_id=5ee59ae4e96541bb964841051ab33629, role_id=b38e84bf077846ee802e6bb1bad83522)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:48.691932 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2891ae20-da98-4a20-8aad-bc5cabc491fe admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:48.700919 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:32:48.725079 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 994/1963] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 16:32:48 2022] PUT /identity/v3/projects/cb911304574d4bccbe6b543ff994833a/users/5ee59ae4e96541bb964841051ab33629/roles/b38e84bf077846ee802e6bb1bad83522 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:32:48.725346 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad78238-e332-442d-9cca-1c7213622257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:48.725346 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad78238-e332-442d-9cca-1c7213622257 admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:48.725346 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad78238-e332-442d-9cca-1c7213622257 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:48.725346 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad78238-e332-442d-9cca-1c7213622257 admin admin] PATH_INFO: `/v3/users` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:48.725692 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad78238-e332-442d-9cca-1c7213622257 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:48.726571 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffe86fc-9736-4ea1-ae09-bc614101688e None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:48.726856 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffe86fc-9736-4ea1-ae09-bc614101688e None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:48.727261 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffe86fc-9736-4ea1-ae09-bc614101688e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:48.727754 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad78238-e332-442d-9cca-1c7213622257 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:48.771996 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 970/1964] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 16:32:48 2022] POST /identity/v3/users => generated 284 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:32:48.782058 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-cffe86fc-9736-4ea1-ae09-bc614101688e None None] MFA Rules not processed for user `5ee59ae4e96541bb964841051ab33629`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:32:48.783481 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-cffe86fc-9736-4ea1-ae09-bc614101688e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:48.791835 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad78238-e332-442d-9cca-1c7213622257 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:48.824292 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:32:48.836154 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad78238-e332-442d-9cca-1c7213622257 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:48.909356 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 995/1965] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:32:48 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 16:32:48.910491 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffe86fc-9736-4ea1-ae09-bc614101688e None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:48.911799 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-cffe86fc-9736-4ea1-ae09-bc614101688e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:48.920112 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c562e9af-b016-4dd4-84b6-b0a5e2cc2daf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:48.920847 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c562e9af-b016-4dd4-84b6-b0a5e2cc2daf admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:48.921127 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c562e9af-b016-4dd4-84b6-b0a5e2cc2daf admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:48.921395 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c562e9af-b016-4dd4-84b6-b0a5e2cc2daf admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:48.922033 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c562e9af-b016-4dd4-84b6-b0a5e2cc2daf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:48.924445 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c562e9af-b016-4dd4-84b6-b0a5e2cc2daf admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:48.945026 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 971/1966] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:32:48 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:32:48.946080 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c562e9af-b016-4dd4-84b6-b0a5e2cc2daf admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:48.965482 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c562e9af-b016-4dd4-84b6-b0a5e2cc2daf admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:48.973177 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4884add-4f79-44e7-90e5-ddd7215bc2e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:48.973796 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4884add-4f79-44e7-90e5-ddd7215bc2e5 admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:48.974074 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4884add-4f79-44e7-90e5-ddd7215bc2e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:48.974367 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4884add-4f79-44e7-90e5-ddd7215bc2e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:48.983558 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4884add-4f79-44e7-90e5-ddd7215bc2e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:48.987966 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4884add-4f79-44e7-90e5-ddd7215bc2e5 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:49.018453 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffe86fc-9736-4ea1-ae09-bc614101688e None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:49.029239 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 972/1967] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 16:32:48 2022] POST /identity/v3/projects => generated 385 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:32:49.031317 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4884add-4f79-44e7-90e5-ddd7215bc2e5 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:49.032234 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8019e418-07d8-4626-bd77-92f76adf5e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:49.032874 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8019e418-07d8-4626-bd77-92f76adf5e78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:49.033145 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8019e418-07d8-4626-bd77-92f76adf5e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:49.033398 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8019e418-07d8-4626-bd77-92f76adf5e78 admin admin] PATH_INFO: `/v3/projects/2cf9674599f74a14bbda1e75d5bcb77e` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:49.036657 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8019e418-07d8-4626-bd77-92f76adf5e78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2cf9674599f74a14bbda1e75d5bcb77e)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:49.038638 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8019e418-07d8-4626-bd77-92f76adf5e78 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:49.111601 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-8019e418-07d8-4626-bd77-92f76adf5e78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2cf9674599f74a14bbda1e75d5bcb77e', 'request_id': 'req-8019e418-07d8-4626-bd77-92f76adf5e78'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:49.123701 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-8019e418-07d8-4626-bd77-92f76adf5e78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2cf9674599f74a14bbda1e75d5bcb77e', 'request_id': 'req-8019e418-07d8-4626-bd77-92f76adf5e78'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:49.132802 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-8019e418-07d8-4626-bd77-92f76adf5e78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2cf9674599f74a14bbda1e75d5bcb77e', 'request_id': 'req-8019e418-07d8-4626-bd77-92f76adf5e78'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:49.151888 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-8019e418-07d8-4626-bd77-92f76adf5e78 admin admin] The token cache is being invalidate because project 2cf9674599f74a14bbda1e75d5bcb77e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81446) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 16:32:49.152259 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-8019e418-07d8-4626-bd77-92f76adf5e78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:49.153122 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-8019e418-07d8-4626-bd77-92f76adf5e78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:49.156286 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 996/1968] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 16:32:48 2022] DELETE /identity/v3/projects/2cf9674599f74a14bbda1e75d5bcb77e => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:32:49.158474 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8019e418-07d8-4626-bd77-92f76adf5e78 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:49.160275 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-8019e418-07d8-4626-bd77-92f76adf5e78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:49.163513 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4884add-4f79-44e7-90e5-ddd7215bc2e5 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:49.241738 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a52b4a0-8a68-410b-89d2-4da079459bbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:49.242406 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a52b4a0-8a68-410b-89d2-4da079459bbb admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:49.242688 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a52b4a0-8a68-410b-89d2-4da079459bbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:49.242966 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a52b4a0-8a68-410b-89d2-4da079459bbb admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:49.243603 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a52b4a0-8a68-410b-89d2-4da079459bbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:49.245286 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a52b4a0-8a68-410b-89d2-4da079459bbb admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:49.246965 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:32:49.247097 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:32:49.260065 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 973/1969] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:32:49 2022] GET /identity/v3/roles => generated 1420 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:32:49.260065 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a52b4a0-8a68-410b-89d2-4da079459bbb admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:49.262437 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-1a52b4a0-8a68-410b-89d2-4da079459bbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:49.264231 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8019e418-07d8-4626-bd77-92f76adf5e78 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:49.269311 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e17bd32-3b89-406b-8511-23f2fadfab37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:49.269911 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e17bd32-3b89-406b-8511-23f2fadfab37 admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:49.270186 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e17bd32-3b89-406b-8511-23f2fadfab37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:49.270483 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e17bd32-3b89-406b-8511-23f2fadfab37 admin admin] PATH_INFO: `/v3/users` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:49.271106 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e17bd32-3b89-406b-8511-23f2fadfab37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:49.273000 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e17bd32-3b89-406b-8511-23f2fadfab37 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:49.275471 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a52b4a0-8a68-410b-89d2-4da079459bbb admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:49.287589 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed883bd1-edee-46ff-80e2-d12c69b29442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:49.288491 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed883bd1-edee-46ff-80e2-d12c69b29442 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:49.288770 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed883bd1-edee-46ff-80e2-d12c69b29442 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:49.289174 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed883bd1-edee-46ff-80e2-d12c69b29442 admin admin] PATH_INFO: `/v3/users/737c38fb3eb54f268b82c280019daea3` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:49.290937 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed883bd1-edee-46ff-80e2-d12c69b29442 admin admin] RBAC: Authorizing `identity:delete_user(user_id=737c38fb3eb54f268b82c280019daea3)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:49.292850 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed883bd1-edee-46ff-80e2-d12c69b29442 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:49.296114 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 997/1970] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 16:32:49 2022] POST /identity/v3/users => generated 299 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:32:49.297016 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e17bd32-3b89-406b-8511-23f2fadfab37 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:49.301323 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-5e17bd32-3b89-406b-8511-23f2fadfab37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:49.313740 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e17bd32-3b89-406b-8511-23f2fadfab37 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:49.318832 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efc2841-85af-4301-86db-9e58ab03efb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:49.319477 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efc2841-85af-4301-86db-9e58ab03efb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:49.319805 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efc2841-85af-4301-86db-9e58ab03efb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:49.320084 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efc2841-85af-4301-86db-9e58ab03efb5 admin admin] PATH_INFO: `/v3/projects/47d9c45b398444faa4611a03435775b2/users/2a5ab4a4383b4845a01e41235b800709/roles/b38e84bf077846ee802e6bb1bad83522` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:49.335068 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efc2841-85af-4301-86db-9e58ab03efb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47d9c45b398444faa4611a03435775b2, user_id=2a5ab4a4383b4845a01e41235b800709, role_id=b38e84bf077846ee802e6bb1bad83522)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:49.337758 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efc2841-85af-4301-86db-9e58ab03efb5 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:49.341453 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-ed883bd1-edee-46ff-80e2-d12c69b29442 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '737c38fb3eb54f268b82c280019daea3'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:49.348738 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-ed883bd1-edee-46ff-80e2-d12c69b29442 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '737c38fb3eb54f268b82c280019daea3'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:49.349395 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-ed883bd1-edee-46ff-80e2-d12c69b29442 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '737c38fb3eb54f268b82c280019daea3'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:49.351676 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 998/1971] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 16:32:49 2022] PUT /identity/v3/projects/47d9c45b398444faa4611a03435775b2/users/2a5ab4a4383b4845a01e41235b800709/roles/b38e84bf077846ee802e6bb1bad83522 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:32:49.352498 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efc2841-85af-4301-86db-9e58ab03efb5 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:49.358025 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-ed883bd1-edee-46ff-80e2-d12c69b29442 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '737c38fb3eb54f268b82c280019daea3'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:49.371588 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-ed883bd1-edee-46ff-80e2-d12c69b29442 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '737c38fb3eb54f268b82c280019daea3'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:49.378473 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 974/1972] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 16:32:49 2022] DELETE /identity/v3/users/737c38fb3eb54f268b82c280019daea3 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:32:49.383090 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4a80be-44cd-4b3d-b6e2-8200904098e8 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:49.383362 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4a80be-44cd-4b3d-b6e2-8200904098e8 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:49.383637 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4a80be-44cd-4b3d-b6e2-8200904098e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:49.417871 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-6e4a80be-44cd-4b3d-b6e2-8200904098e8 None None] MFA Rules not processed for user `2a5ab4a4383b4845a01e41235b800709`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:32:49.420313 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-6e4a80be-44cd-4b3d-b6e2-8200904098e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:49.427683 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efc2841-85af-4301-86db-9e58ab03efb5 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:49.504432 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4c72ee-8010-4866-b594-299bd7db2754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:49.505422 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4c72ee-8010-4866-b594-299bd7db2754 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:49.505703 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4c72ee-8010-4866-b594-299bd7db2754 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:49.505970 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4c72ee-8010-4866-b594-299bd7db2754 admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:49.506479 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 975/1973] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:32:49 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:32:49.506722 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4c72ee-8010-4866-b594-299bd7db2754 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:49.508413 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4c72ee-8010-4866-b594-299bd7db2754 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:49.511809 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4a80be-44cd-4b3d-b6e2-8200904098e8 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:49.516880 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-6e4a80be-44cd-4b3d-b6e2-8200904098e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:49.521050 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 999/1974] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:32:49 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:32:49.525144 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4c72ee-8010-4866-b594-299bd7db2754 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:49.527088 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-6e4c72ee-8010-4866-b594-299bd7db2754 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:49.537183 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4a80be-44cd-4b3d-b6e2-8200904098e8 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:49.541051 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4c72ee-8010-4866-b594-299bd7db2754 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:49.546255 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de84cf23-9d4e-4a34-8a92-ea844953f22d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:49.548357 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de84cf23-9d4e-4a34-8a92-ea844953f22d admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:49.548515 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb202826-dd2b-4a53-b847-abebff82390f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:49.548616 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de84cf23-9d4e-4a34-8a92-ea844953f22d admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:49.548616 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de84cf23-9d4e-4a34-8a92-ea844953f22d admin admin] PATH_INFO: `/v3/projects` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:49.548744 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb202826-dd2b-4a53-b847-abebff82390f admin admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:49.548813 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de84cf23-9d4e-4a34-8a92-ea844953f22d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:49.548891 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb202826-dd2b-4a53-b847-abebff82390f admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:49.548891 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb202826-dd2b-4a53-b847-abebff82390f admin admin] PATH_INFO: `/v3/projects/92371ac304104116896ba28b2b7cdf3e/users/1c4659aa73d44893bf1bbce6473d7e99/roles/0a36d1be416f4089be19be979943b731` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:49.549995 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de84cf23-9d4e-4a34-8a92-ea844953f22d admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:49.566504 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb202826-dd2b-4a53-b847-abebff82390f admin admin] RBAC: Authorizing `identity:create_grant(project_id=92371ac304104116896ba28b2b7cdf3e, user_id=1c4659aa73d44893bf1bbce6473d7e99, role_id=0a36d1be416f4089be19be979943b731)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:49.569146 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb202826-dd2b-4a53-b847-abebff82390f admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:49.585131 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 976/1975] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 16:32:49 2022] POST /identity/v3/projects => generated 369 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:32:49.588364 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1000/1976] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 16:32:49 2022] PUT /identity/v3/projects/92371ac304104116896ba28b2b7cdf3e/users/1c4659aa73d44893bf1bbce6473d7e99/roles/0a36d1be416f4089be19be979943b731 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 16:32:49.589331 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de84cf23-9d4e-4a34-8a92-ea844953f22d admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:49.589447 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb202826-dd2b-4a53-b847-abebff82390f admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:49.638441 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:32:49.660540 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:32:49.688085 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de84cf23-9d4e-4a34-8a92-ea844953f22d admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:49.690418 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb202826-dd2b-4a53-b847-abebff82390f admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:49.695157 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a768958-9db5-4fce-98a3-b6f802b0b520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:49.695776 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a768958-9db5-4fce-98a3-b6f802b0b520 admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:49.696113 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a768958-9db5-4fce-98a3-b6f802b0b520 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:49.696314 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a768958-9db5-4fce-98a3-b6f802b0b520 admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:49.697015 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a768958-9db5-4fce-98a3-b6f802b0b520 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:49.697982 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec89e55-08fc-4d1b-9abb-dc6ea3f93d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:49.698788 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec89e55-08fc-4d1b-9abb-dc6ea3f93d88 admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:49.699056 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a768958-9db5-4fce-98a3-b6f802b0b520 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:49.699171 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec89e55-08fc-4d1b-9abb-dc6ea3f93d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:49.699505 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec89e55-08fc-4d1b-9abb-dc6ea3f93d88 admin admin] PATH_INFO: `/v3/users` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:49.700204 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec89e55-08fc-4d1b-9abb-dc6ea3f93d88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:49.703357 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec89e55-08fc-4d1b-9abb-dc6ea3f93d88 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:49.714501 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 977/1977] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:32:49 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:32:49.719181 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a768958-9db5-4fce-98a3-b6f802b0b520 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:49.733025 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a768958-9db5-4fce-98a3-b6f802b0b520 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:49.739997 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3466463a-220e-44f1-a8a9-fe5cb756eb6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:49.740751 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3466463a-220e-44f1-a8a9-fe5cb756eb6a admin admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:49.741103 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3466463a-220e-44f1-a8a9-fe5cb756eb6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:49.741470 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3466463a-220e-44f1-a8a9-fe5cb756eb6a admin admin] PATH_INFO: `/v3/projects/92371ac304104116896ba28b2b7cdf3e/users/1c4659aa73d44893bf1bbce6473d7e99/roles/0a36d1be416f4089be19be979943b731` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:49.743823 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3466463a-220e-44f1-a8a9-fe5cb756eb6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=92371ac304104116896ba28b2b7cdf3e, user_id=1c4659aa73d44893bf1bbce6473d7e99, role_id=0a36d1be416f4089be19be979943b731)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:49.746738 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3466463a-220e-44f1-a8a9-fe5cb756eb6a admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:49.750191 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1001/1978] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 16:32:49 2022] POST /identity/v3/users => generated 291 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:32:49.751755 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec89e55-08fc-4d1b-9abb-dc6ea3f93d88 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:49.753692 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-7ec89e55-08fc-4d1b-9abb-dc6ea3f93d88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:49.759793 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 978/1979] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 16:32:49 2022] PUT /identity/v3/projects/92371ac304104116896ba28b2b7cdf3e/users/1c4659aa73d44893bf1bbce6473d7e99/roles/0a36d1be416f4089be19be979943b731 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 16:32:49.761262 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3466463a-220e-44f1-a8a9-fe5cb756eb6a admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:49.774584 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec89e55-08fc-4d1b-9abb-dc6ea3f93d88 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:49.842512 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3466463a-220e-44f1-a8a9-fe5cb756eb6a admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:49.847066 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160f3846-aa58-41c5-8d99-0c2f57710783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:49.847497 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf339691-48c7-4be8-97c3-f2c113c766bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:49.847662 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160f3846-aa58-41c5-8d99-0c2f57710783 admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:49.847945 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160f3846-aa58-41c5-8d99-0c2f57710783 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:49.848211 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160f3846-aa58-41c5-8d99-0c2f57710783 admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:49.848320 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf339691-48c7-4be8-97c3-f2c113c766bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:49.848501 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf339691-48c7-4be8-97c3-f2c113c766bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:49.848765 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf339691-48c7-4be8-97c3-f2c113c766bf admin admin] PATH_INFO: `/v3/projects/4d90b179256044cf8593b400807df2a2` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:49.848877 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160f3846-aa58-41c5-8d99-0c2f57710783 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:49.849972 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf339691-48c7-4be8-97c3-f2c113c766bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d90b179256044cf8593b400807df2a2)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:49.850479 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160f3846-aa58-41c5-8d99-0c2f57710783 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:49.852657 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf339691-48c7-4be8-97c3-f2c113c766bf admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:49.861099 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 979/1980] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:32:49 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:32:49.862614 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c0147f-464f-484f-baa9-885fb7a063b5 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:49.862900 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c0147f-464f-484f-baa9-885fb7a063b5 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:49.863172 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c0147f-464f-484f-baa9-885fb7a063b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:49.891377 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-74c0147f-464f-484f-baa9-885fb7a063b5 None None] MFA Rules not processed for user `1c4659aa73d44893bf1bbce6473d7e99`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:32:49.892641 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-74c0147f-464f-484f-baa9-885fb7a063b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:49.903739 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-cf339691-48c7-4be8-97c3-f2c113c766bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d90b179256044cf8593b400807df2a2', 'request_id': 'req-cf339691-48c7-4be8-97c3-f2c113c766bf'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:49.916086 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-cf339691-48c7-4be8-97c3-f2c113c766bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d90b179256044cf8593b400807df2a2', 'request_id': 'req-cf339691-48c7-4be8-97c3-f2c113c766bf'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:49.924354 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-cf339691-48c7-4be8-97c3-f2c113c766bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d90b179256044cf8593b400807df2a2', 'request_id': 'req-cf339691-48c7-4be8-97c3-f2c113c766bf'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:49.937803 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-cf339691-48c7-4be8-97c3-f2c113c766bf admin admin] The token cache is being invalidate because project 4d90b179256044cf8593b400807df2a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81446) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 16:32:49.938093 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-cf339691-48c7-4be8-97c3-f2c113c766bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:49.938763 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-cf339691-48c7-4be8-97c3-f2c113c766bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:49.940339 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1002/1981] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 16:32:49 2022] DELETE /identity/v3/projects/4d90b179256044cf8593b400807df2a2 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:32:49.941627 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf339691-48c7-4be8-97c3-f2c113c766bf admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:49.942960 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-cf339691-48c7-4be8-97c3-f2c113c766bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:49.966140 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 980/1982] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:32:49 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:32:49.967408 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4619fa7-62bc-486e-8eb3-04769fd57ee6 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:49.967693 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4619fa7-62bc-486e-8eb3-04769fd57ee6 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:49.967964 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4619fa7-62bc-486e-8eb3-04769fd57ee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:49.987914 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-d4619fa7-62bc-486e-8eb3-04769fd57ee6 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:32:49.989028 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-d4619fa7-62bc-486e-8eb3-04769fd57ee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:49.998902 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:32:50.011530 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf339691-48c7-4be8-97c3-f2c113c766bf admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:50.017819 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf5739d-e564-4623-9b46-bc6dabb95dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:50.018494 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf5739d-e564-4623-9b46-bc6dabb95dc7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:50.018769 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf5739d-e564-4623-9b46-bc6dabb95dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:50.019056 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf5739d-e564-4623-9b46-bc6dabb95dc7 admin admin] PATH_INFO: `/v3/projects/456217aed12f412291f90ee033f3f780/users/4a077173dacd47f19b9b4135374c8cb8/roles/0a36d1be416f4089be19be979943b731` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:50.024233 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:32:50.034349 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf5739d-e564-4623-9b46-bc6dabb95dc7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=456217aed12f412291f90ee033f3f780, user_id=4a077173dacd47f19b9b4135374c8cb8, role_id=0a36d1be416f4089be19be979943b731)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:50.037000 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf5739d-e564-4623-9b46-bc6dabb95dc7 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:50.050564 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1003/1983] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 16:32:49 2022] PUT /identity/v3/projects/456217aed12f412291f90ee033f3f780/users/4a077173dacd47f19b9b4135374c8cb8/roles/0a36d1be416f4089be19be979943b731 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:32:50.053650 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf5739d-e564-4623-9b46-bc6dabb95dc7 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:50.053650 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-acf5739d-e564-4623-9b46-bc6dabb95dc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:50.053993 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 981/1984] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:32:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:32:50.054861 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4619fa7-62bc-486e-8eb3-04769fd57ee6 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:50.064647 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4619fa7-62bc-486e-8eb3-04769fd57ee6 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:50.117612 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf5739d-e564-4623-9b46-bc6dabb95dc7 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:50.121267 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c9469f-d490-4c5d-9b19-7261acc7d433 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8078e791ba68460f8b3aeafb4b79b73a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:50.121872 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c9469f-d490-4c5d-9b19-7261acc7d433 service cinder] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:50.122272 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c9469f-d490-4c5d-9b19-7261acc7d433 service cinder] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:50.122638 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c9469f-d490-4c5d-9b19-7261acc7d433 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:50.123881 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d111bd-a11e-4b55-8f08-e23bdca14180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:50.124390 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-02c9469f-d490-4c5d-9b19-7261acc7d433 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:50.124503 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d111bd-a11e-4b55-8f08-e23bdca14180 admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:50.124745 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d111bd-a11e-4b55-8f08-e23bdca14180 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:50.125013 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d111bd-a11e-4b55-8f08-e23bdca14180 admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:50.125644 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d111bd-a11e-4b55-8f08-e23bdca14180 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:50.127284 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d111bd-a11e-4b55-8f08-e23bdca14180 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:50.136837 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 982/1985] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:32:50 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:32:50.138700 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b15a49-238a-4da0-b011-84ee48d21d39 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:50.138916 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b15a49-238a-4da0-b011-84ee48d21d39 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:50.139190 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b15a49-238a-4da0-b011-84ee48d21d39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:50.158614 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-f6b15a49-238a-4da0-b011-84ee48d21d39 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:32:50.159795 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-f6b15a49-238a-4da0-b011-84ee48d21d39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:50.167812 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 983/1986] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:32:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:32:50.168648 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b15a49-238a-4da0-b011-84ee48d21d39 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:50.177958 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b15a49-238a-4da0-b011-84ee48d21d39 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:50.182475 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353b8a88-3323-4a4f-85e4-ded588b9ff5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:50.183103 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353b8a88-3323-4a4f-85e4-ded588b9ff5e admin admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:50.183375 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353b8a88-3323-4a4f-85e4-ded588b9ff5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:50.183640 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353b8a88-3323-4a4f-85e4-ded588b9ff5e admin admin] PATH_INFO: `/v3/projects/456217aed12f412291f90ee033f3f780/users/4a077173dacd47f19b9b4135374c8cb8/roles/0a36d1be416f4089be19be979943b731` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:50.184988 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c9469f-d490-4c5d-9b19-7261acc7d433 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:50.185528 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353b8a88-3323-4a4f-85e4-ded588b9ff5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=456217aed12f412291f90ee033f3f780, user_id=4a077173dacd47f19b9b4135374c8cb8, role_id=0a36d1be416f4089be19be979943b731)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:50.186510 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c9469f-d490-4c5d-9b19-7261acc7d433 service cinder] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:50.188152 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353b8a88-3323-4a4f-85e4-ded588b9ff5e admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:50.195828 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1004/1987] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:32:50 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:32:50.196567 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c9469f-d490-4c5d-9b19-7261acc7d433 service cinder] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:50.199176 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 984/1988] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 16:32:50 2022] PUT /identity/v3/projects/456217aed12f412291f90ee033f3f780/users/4a077173dacd47f19b9b4135374c8cb8/roles/0a36d1be416f4089be19be979943b731 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:32:50.207755 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c9469f-d490-4c5d-9b19-7261acc7d433 service cinder] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:50.211388 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2acaa54-5086-4fe9-a14e-27bd684ce538 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:50.211671 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2acaa54-5086-4fe9-a14e-27bd684ce538 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:50.211939 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2acaa54-5086-4fe9-a14e-27bd684ce538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:50.243115 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-d2acaa54-5086-4fe9-a14e-27bd684ce538 None None] MFA Rules not processed for user `4a077173dacd47f19b9b4135374c8cb8`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:32:50.244542 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-d2acaa54-5086-4fe9-a14e-27bd684ce538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:50.313900 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ab12dc-b83e-4621-9146-25a1fd718270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:50.315047 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ab12dc-b83e-4621-9146-25a1fd718270 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:50.315190 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ab12dc-b83e-4621-9146-25a1fd718270 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:50.317165 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ab12dc-b83e-4621-9146-25a1fd718270 admin admin] PATH_INFO: `/v3/domains` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:50.319811 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ab12dc-b83e-4621-9146-25a1fd718270 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:32:50.320194 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ab12dc-b83e-4621-9146-25a1fd718270 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:50.321821 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ab12dc-b83e-4621-9146-25a1fd718270 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:50.340254 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1005/1989] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Sep 9 16:32:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:32:50.344705 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ab12dc-b83e-4621-9146-25a1fd718270 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:50.358277 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ab12dc-b83e-4621-9146-25a1fd718270 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:50.374455 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 985/1990] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:32:50 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:32:50.380387 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cd0d15-d3f6-4c4e-abb6-d5a455971ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:50.380387 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cd0d15-d3f6-4c4e-abb6-d5a455971ae3 admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:50.380387 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cd0d15-d3f6-4c4e-abb6-d5a455971ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:50.380387 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cd0d15-d3f6-4c4e-abb6-d5a455971ae3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:50.381010 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cd0d15-d3f6-4c4e-abb6-d5a455971ae3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:50.383313 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cd0d15-d3f6-4c4e-abb6-d5a455971ae3 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:50.393078 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2acaa54-5086-4fe9-a14e-27bd684ce538 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:50.394807 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-d2acaa54-5086-4fe9-a14e-27bd684ce538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:50.421116 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1006/1991] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 16:32:50 2022] POST /identity/v3/projects => generated 369 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:32:50.433124 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cd0d15-d3f6-4c4e-abb6-d5a455971ae3 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:50.444825 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:32:50.465259 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:32:50.484692 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2acaa54-5086-4fe9-a14e-27bd684ce538 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:50.527165 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cd0d15-d3f6-4c4e-abb6-d5a455971ae3 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:50.534267 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200af9e7-4cab-4413-8442-1024d9d56d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:50.535379 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200af9e7-4cab-4413-8442-1024d9d56d5c admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:50.540694 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200af9e7-4cab-4413-8442-1024d9d56d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:50.542065 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200af9e7-4cab-4413-8442-1024d9d56d5c admin admin] PATH_INFO: `/v3/users` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:50.543027 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200af9e7-4cab-4413-8442-1024d9d56d5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:50.545979 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200af9e7-4cab-4413-8442-1024d9d56d5c admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:50.555512 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7438b67-c855-40c3-9d78-b06b8326e35e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8078e791ba68460f8b3aeafb4b79b73a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:50.556186 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7438b67-c855-40c3-9d78-b06b8326e35e service cinder] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:50.556530 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7438b67-c855-40c3-9d78-b06b8326e35e service cinder] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:50.556871 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7438b67-c855-40c3-9d78-b06b8326e35e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:50.573073 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1007/1992] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 16:32:50 2022] POST /identity/v3/users => generated 285 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:32:50.577711 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200af9e7-4cab-4413-8442-1024d9d56d5c admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:50.594738 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200af9e7-4cab-4413-8442-1024d9d56d5c admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:50.620168 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026a4966-75bf-419c-ba21-6c3a8c8d008b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:50.622086 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026a4966-75bf-419c-ba21-6c3a8c8d008b admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:50.622652 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026a4966-75bf-419c-ba21-6c3a8c8d008b admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:50.624152 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026a4966-75bf-419c-ba21-6c3a8c8d008b admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:50.625091 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026a4966-75bf-419c-ba21-6c3a8c8d008b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:50.627236 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026a4966-75bf-419c-ba21-6c3a8c8d008b admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:50.644241 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1008/1993] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:32:50 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 16:32:50.651257 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026a4966-75bf-419c-ba21-6c3a8c8d008b admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:50.667826 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026a4966-75bf-419c-ba21-6c3a8c8d008b admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:50.679647 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea32f64-dda7-4bc0-918b-bb73c67b7eeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:50.680266 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea32f64-dda7-4bc0-918b-bb73c67b7eeb admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:50.680546 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea32f64-dda7-4bc0-918b-bb73c67b7eeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:50.680816 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea32f64-dda7-4bc0-918b-bb73c67b7eeb admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:50.681908 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea32f64-dda7-4bc0-918b-bb73c67b7eeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:50.683705 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea32f64-dda7-4bc0-918b-bb73c67b7eeb admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:50.684987 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7438b67-c855-40c3-9d78-b06b8326e35e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:50.687217 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7438b67-c855-40c3-9d78-b06b8326e35e service cinder] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:50.699304 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 986/1994] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:32:50 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:32:50.702471 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1009/1995] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:32:50 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 16:32:50.707667 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7438b67-c855-40c3-9d78-b06b8326e35e service cinder] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:50.730476 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7438b67-c855-40c3-9d78-b06b8326e35e service cinder] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:50.737405 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c98dc00-761d-44b3-8716-163cc8e13d74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:50.738077 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c98dc00-761d-44b3-8716-163cc8e13d74 admin admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:50.738451 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c98dc00-761d-44b3-8716-163cc8e13d74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:50.738715 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c98dc00-761d-44b3-8716-163cc8e13d74 admin admin] PATH_INFO: `/v3/projects/91fa934d9f6c430bac6702b0d00b2fe1/users/c1c5114ec3694783b672e534785d59ea/roles/b38e84bf077846ee802e6bb1bad83522` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:50.766573 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c98dc00-761d-44b3-8716-163cc8e13d74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91fa934d9f6c430bac6702b0d00b2fe1, user_id=c1c5114ec3694783b672e534785d59ea, role_id=b38e84bf077846ee802e6bb1bad83522)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:50.770135 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c98dc00-761d-44b3-8716-163cc8e13d74 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:50.792679 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 987/1996] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 16:32:50 2022] PUT /identity/v3/projects/91fa934d9f6c430bac6702b0d00b2fe1/users/c1c5114ec3694783b672e534785d59ea/roles/b38e84bf077846ee802e6bb1bad83522 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:32:50.804014 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28f7bdd-c396-4537-ac72-7f6a194c8003 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:50.804318 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28f7bdd-c396-4537-ac72-7f6a194c8003 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:50.804824 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28f7bdd-c396-4537-ac72-7f6a194c8003 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:50.876672 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-b28f7bdd-c396-4537-ac72-7f6a194c8003 None None] MFA Rules not processed for user `c1c5114ec3694783b672e534785d59ea`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:32:50.878168 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-b28f7bdd-c396-4537-ac72-7f6a194c8003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:50.982093 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1010/1997] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:32:50 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:32:50.987023 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c98dc00-761d-44b3-8716-163cc8e13d74 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:51.127155 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c98dc00-761d-44b3-8716-163cc8e13d74 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:51.135254 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837564e5-a12c-4f1b-b509-6556482588b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:51.135878 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837564e5-a12c-4f1b-b509-6556482588b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:51.136164 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837564e5-a12c-4f1b-b509-6556482588b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:51.136476 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837564e5-a12c-4f1b-b509-6556482588b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:51.137314 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837564e5-a12c-4f1b-b509-6556482588b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:51.139838 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837564e5-a12c-4f1b-b509-6556482588b7 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:51.197084 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 988/1998] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 16:32:50 2022] POST /identity/v3/projects => generated 367 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:32:51.200892 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28f7bdd-c396-4537-ac72-7f6a194c8003 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:51.214926 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28f7bdd-c396-4537-ac72-7f6a194c8003 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:51.329439 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f4cb52-766b-42b6-93d1-29e0287d543f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:51.330071 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f4cb52-766b-42b6-93d1-29e0287d543f admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:51.330391 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f4cb52-766b-42b6-93d1-29e0287d543f admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:51.330649 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f4cb52-766b-42b6-93d1-29e0287d543f admin admin] PATH_INFO: `/v3/users` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:51.332061 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f4cb52-766b-42b6-93d1-29e0287d543f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:51.334897 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f4cb52-766b-42b6-93d1-29e0287d543f admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:51.348085 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:32:51.370128 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1011/1999] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 16:32:51 2022] POST /identity/v3/users => generated 290 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:32:51.374062 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837564e5-a12c-4f1b-b509-6556482588b7 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:51.387668 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837564e5-a12c-4f1b-b509-6556482588b7 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:51.396255 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2ea132-574f-481c-867b-a37b288b0eda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:51.397425 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2ea132-574f-481c-867b-a37b288b0eda admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:51.397706 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2ea132-574f-481c-867b-a37b288b0eda admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:51.398588 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2ea132-574f-481c-867b-a37b288b0eda admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:51.399438 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2ea132-574f-481c-867b-a37b288b0eda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:51.402540 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2ea132-574f-481c-867b-a37b288b0eda admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:51.407176 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:32:51.423160 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 989/2000] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:32:51 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:32:51.423945 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f4cb52-766b-42b6-93d1-29e0287d543f admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:51.434965 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f4cb52-766b-42b6-93d1-29e0287d543f admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:51.441874 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fa4bb0-7e48-4c45-9319-768d76808405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:51.442520 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fa4bb0-7e48-4c45-9319-768d76808405 admin admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:51.442933 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fa4bb0-7e48-4c45-9319-768d76808405 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:51.443206 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fa4bb0-7e48-4c45-9319-768d76808405 admin admin] PATH_INFO: `/v3/projects/5d8e878c0d5c4f918c51291598a6ebf8/users/3659e4a118ec42798a21fd06b1c91960/roles/0a36d1be416f4089be19be979943b731` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:51.469294 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fa4bb0-7e48-4c45-9319-768d76808405 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d8e878c0d5c4f918c51291598a6ebf8, user_id=3659e4a118ec42798a21fd06b1c91960, role_id=0a36d1be416f4089be19be979943b731)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:51.472639 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fa4bb0-7e48-4c45-9319-768d76808405 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:51.494257 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1012/2001] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 16:32:51 2022] PUT /identity/v3/projects/5d8e878c0d5c4f918c51291598a6ebf8/users/3659e4a118ec42798a21fd06b1c91960/roles/0a36d1be416f4089be19be979943b731 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 16:32:51.497481 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2ea132-574f-481c-867b-a37b288b0eda admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:51.511105 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2ea132-574f-481c-867b-a37b288b0eda admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:51.600773 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9a8a1d-c517-4344-ad4e-5bccff689a14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:51.601556 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9a8a1d-c517-4344-ad4e-5bccff689a14 admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:51.601903 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9a8a1d-c517-4344-ad4e-5bccff689a14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:51.602245 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9a8a1d-c517-4344-ad4e-5bccff689a14 admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:51.603151 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9a8a1d-c517-4344-ad4e-5bccff689a14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:51.604830 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9a8a1d-c517-4344-ad4e-5bccff689a14 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:51.622473 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 990/2002] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:32:51 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:32:51.624270 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fa4bb0-7e48-4c45-9319-768d76808405 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:51.636362 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fa4bb0-7e48-4c45-9319-768d76808405 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:51.642402 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3554a7f-ab33-4e34-9bf4-aeb7caf200db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:51.643190 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3554a7f-ab33-4e34-9bf4-aeb7caf200db admin admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:51.643467 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3554a7f-ab33-4e34-9bf4-aeb7caf200db admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:51.643772 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3554a7f-ab33-4e34-9bf4-aeb7caf200db admin admin] PATH_INFO: `/v3/projects/5d8e878c0d5c4f918c51291598a6ebf8/users/3659e4a118ec42798a21fd06b1c91960/roles/0a36d1be416f4089be19be979943b731` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:51.647322 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3554a7f-ab33-4e34-9bf4-aeb7caf200db admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d8e878c0d5c4f918c51291598a6ebf8, user_id=3659e4a118ec42798a21fd06b1c91960, role_id=0a36d1be416f4089be19be979943b731)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:51.651366 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3554a7f-ab33-4e34-9bf4-aeb7caf200db admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:51.677705 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3eb747-dc22-44c1-8052-572348a27e0c None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:51.678410 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3eb747-dc22-44c1-8052-572348a27e0c None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:51.678696 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3eb747-dc22-44c1-8052-572348a27e0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:51.680883 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1013/2003] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 16:32:51 2022] PUT /identity/v3/projects/5d8e878c0d5c4f918c51291598a6ebf8/users/3659e4a118ec42798a21fd06b1c91960/roles/0a36d1be416f4089be19be979943b731 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 16:32:51.725126 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-fd3eb747-dc22-44c1-8052-572348a27e0c None None] MFA Rules not processed for user `3659e4a118ec42798a21fd06b1c91960`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:32:51.730826 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-fd3eb747-dc22-44c1-8052-572348a27e0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:51.827013 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 991/2004] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:32:51 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 16:32:51.840401 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3554a7f-ab33-4e34-9bf4-aeb7caf200db admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:51.907597 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3554a7f-ab33-4e34-9bf4-aeb7caf200db admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:51.914620 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2489ba7a-2395-4a95-bce7-b7ffc10a155c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8078e791ba68460f8b3aeafb4b79b73a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:51.915255 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2489ba7a-2395-4a95-bce7-b7ffc10a155c service cinder] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:51.915548 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2489ba7a-2395-4a95-bce7-b7ffc10a155c service cinder] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:51.915816 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2489ba7a-2395-4a95-bce7-b7ffc10a155c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:51.929734 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2489ba7a-2395-4a95-bce7-b7ffc10a155c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:51.931374 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2489ba7a-2395-4a95-bce7-b7ffc10a155c service cinder] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:51.950435 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1014/2005] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:32:51 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:32:52.032494 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3eb747-dc22-44c1-8052-572348a27e0c None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:52.042692 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3eb747-dc22-44c1-8052-572348a27e0c None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:52.046619 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7995e37f-0f74-4865-9786-cbedc729662d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8078e791ba68460f8b3aeafb4b79b73a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:52.047235 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7995e37f-0f74-4865-9786-cbedc729662d service cinder] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:52.047513 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7995e37f-0f74-4865-9786-cbedc729662d service cinder] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:52.047790 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7995e37f-0f74-4865-9786-cbedc729662d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:52.108281 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2489ba7a-2395-4a95-bce7-b7ffc10a155c service cinder] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:52.119797 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2489ba7a-2395-4a95-bce7-b7ffc10a155c service cinder] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:52.128440 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0bef2a-a3ba-4ad2-90b6-4f44acac52bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8078e791ba68460f8b3aeafb4b79b73a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:52.128935 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0bef2a-a3ba-4ad2-90b6-4f44acac52bd service cinder] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:52.129217 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0bef2a-a3ba-4ad2-90b6-4f44acac52bd service cinder] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:52.129492 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0bef2a-a3ba-4ad2-90b6-4f44acac52bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:52.132125 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-0d0bef2a-a3ba-4ad2-90b6-4f44acac52bd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:52.140957 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7995e37f-0f74-4865-9786-cbedc729662d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:52.142562 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7995e37f-0f74-4865-9786-cbedc729662d service cinder] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:52.152531 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 992/2006] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:32:52 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:32:52.213586 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0bef2a-a3ba-4ad2-90b6-4f44acac52bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:52.215394 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0bef2a-a3ba-4ad2-90b6-4f44acac52bd service cinder] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:52.239293 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1015/2007] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:32:52 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:32:52.832275 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7995e37f-0f74-4865-9786-cbedc729662d service cinder] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:52.834262 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-7995e37f-0f74-4865-9786-cbedc729662d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:52.867928 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:32:52.965149 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7995e37f-0f74-4865-9786-cbedc729662d service cinder] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:52.973023 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6eb8c0-b7f4-48b6-9da6-332e86a8d785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:52.973784 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6eb8c0-b7f4-48b6-9da6-332e86a8d785 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:52.974526 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6eb8c0-b7f4-48b6-9da6-332e86a8d785 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:52.974942 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6eb8c0-b7f4-48b6-9da6-332e86a8d785 admin admin] PATH_INFO: `/v3/users/ffa74f50dd5540cdac3a66466bdcedac` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:52.978961 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6eb8c0-b7f4-48b6-9da6-332e86a8d785 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ffa74f50dd5540cdac3a66466bdcedac)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:52.978961 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6eb8c0-b7f4-48b6-9da6-332e86a8d785 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:53.070195 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-7b6eb8c0-b7f4-48b6-9da6-332e86a8d785 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ffa74f50dd5540cdac3a66466bdcedac'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:53.085910 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-7b6eb8c0-b7f4-48b6-9da6-332e86a8d785 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ffa74f50dd5540cdac3a66466bdcedac'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:53.086698 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-7b6eb8c0-b7f4-48b6-9da6-332e86a8d785 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ffa74f50dd5540cdac3a66466bdcedac'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:53.094204 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0bef2a-a3ba-4ad2-90b6-4f44acac52bd service cinder] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:53.105420 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-7b6eb8c0-b7f4-48b6-9da6-332e86a8d785 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ffa74f50dd5540cdac3a66466bdcedac'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:53.107097 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0bef2a-a3ba-4ad2-90b6-4f44acac52bd service cinder] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:53.115368 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaa63ac-1d42-4356-bbf2-da8ff02b3d5a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8078e791ba68460f8b3aeafb4b79b73a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:53.115990 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaa63ac-1d42-4356-bbf2-da8ff02b3d5a service cinder] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:53.118046 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaa63ac-1d42-4356-bbf2-da8ff02b3d5a service cinder] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:53.119243 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaa63ac-1d42-4356-bbf2-da8ff02b3d5a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:53.120380 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-7b6eb8c0-b7f4-48b6-9da6-332e86a8d785 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ffa74f50dd5540cdac3a66466bdcedac'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:53.127364 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 993/2008] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 16:32:52 2022] DELETE /identity/v3/users/ffa74f50dd5540cdac3a66466bdcedac => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:32:53.131859 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cc55bf-f1d6-4e3a-bc8b-1d6a8b7e4ec6 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:53.132376 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cc55bf-f1d6-4e3a-bc8b-1d6a8b7e4ec6 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:53.133439 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cc55bf-f1d6-4e3a-bc8b-1d6a8b7e4ec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:53.163275 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-24cc55bf-f1d6-4e3a-bc8b-1d6a8b7e4ec6 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:32:53.165784 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-24cc55bf-f1d6-4e3a-bc8b-1d6a8b7e4ec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:53.216501 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:32:53.248394 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaa63ac-1d42-4356-bbf2-da8ff02b3d5a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:53.249929 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaa63ac-1d42-4356-bbf2-da8ff02b3d5a service cinder] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:53.267611 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1016/2009] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:32:53 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 16:32:53.285850 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 994/2010] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:32:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:32:53.293998 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaa63ac-1d42-4356-bbf2-da8ff02b3d5a service cinder] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:53.295555 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-7eaa63ac-1d42-4356-bbf2-da8ff02b3d5a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:53.386488 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaa63ac-1d42-4356-bbf2-da8ff02b3d5a service cinder] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:53.484337 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5f292f-4f13-4a54-b2fd-99e5f38aaaf2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f44bfdd5214e8d84a2c0a5b1fd9b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:53.486573 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5f292f-4f13-4a54-b2fd-99e5f38aaaf2 service neutron] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:53.487031 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5f292f-4f13-4a54-b2fd-99e5f38aaaf2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:53.488124 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5f292f-4f13-4a54-b2fd-99e5f38aaaf2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:53.500938 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5f292f-4f13-4a54-b2fd-99e5f38aaaf2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:53.502590 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5f292f-4f13-4a54-b2fd-99e5f38aaaf2 service neutron] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:53.514762 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1017/2011] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:32:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:32:53.516422 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cc55bf-f1d6-4e3a-bc8b-1d6a8b7e4ec6 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:53.517990 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-24cc55bf-f1d6-4e3a-bc8b-1d6a8b7e4ec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:53.534907 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cc55bf-f1d6-4e3a-bc8b-1d6a8b7e4ec6 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:53.541588 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03a8c73-4cf3-4884-b9d6-f2813160e54e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:53.542705 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03a8c73-4cf3-4884-b9d6-f2813160e54e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:53.543006 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03a8c73-4cf3-4884-b9d6-f2813160e54e admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:53.543387 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03a8c73-4cf3-4884-b9d6-f2813160e54e admin admin] PATH_INFO: `/v3/users/2a5ab4a4383b4845a01e41235b800709` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:53.545464 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03a8c73-4cf3-4884-b9d6-f2813160e54e admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a5ab4a4383b4845a01e41235b800709)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:53.547553 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03a8c73-4cf3-4884-b9d6-f2813160e54e admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:53.626470 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:32:53.645301 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-b03a8c73-4cf3-4884-b9d6-f2813160e54e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a5ab4a4383b4845a01e41235b800709'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:53.654530 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-b03a8c73-4cf3-4884-b9d6-f2813160e54e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a5ab4a4383b4845a01e41235b800709'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:53.656065 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-b03a8c73-4cf3-4884-b9d6-f2813160e54e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a5ab4a4383b4845a01e41235b800709'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:53.663977 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-b03a8c73-4cf3-4884-b9d6-f2813160e54e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a5ab4a4383b4845a01e41235b800709'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:53.681725 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-b03a8c73-4cf3-4884-b9d6-f2813160e54e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a5ab4a4383b4845a01e41235b800709'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:53.688268 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 995/2012] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 16:32:53 2022] DELETE /identity/v3/users/2a5ab4a4383b4845a01e41235b800709 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:32:53.693223 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c19f1b5-dd9d-4777-b587-ba56c536b601 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:53.693514 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c19f1b5-dd9d-4777-b587-ba56c536b601 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:53.693794 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c19f1b5-dd9d-4777-b587-ba56c536b601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:53.713933 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-1c19f1b5-dd9d-4777-b587-ba56c536b601 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:32:53.715317 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-1c19f1b5-dd9d-4777-b587-ba56c536b601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:53.802434 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1018/2013] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:32:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:32:53.812551 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03a8c73-4cf3-4884-b9d6-f2813160e54e admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:53.814261 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-b03a8c73-4cf3-4884-b9d6-f2813160e54e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:53.890160 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03a8c73-4cf3-4884-b9d6-f2813160e54e admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:53.898527 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0f4e16-2d0a-40d8-9be0-84018f489435 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f44bfdd5214e8d84a2c0a5b1fd9b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:53.899147 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0f4e16-2d0a-40d8-9be0-84018f489435 service neutron] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:53.899426 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0f4e16-2d0a-40d8-9be0-84018f489435 service neutron] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:53.899694 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0f4e16-2d0a-40d8-9be0-84018f489435 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:53.910468 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0f4e16-2d0a-40d8-9be0-84018f489435 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:53.911995 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0f4e16-2d0a-40d8-9be0-84018f489435 service neutron] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:53.942838 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 996/2014] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:32:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:32:54.377020 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c19f1b5-dd9d-4777-b587-ba56c536b601 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:54.379591 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-1c19f1b5-dd9d-4777-b587-ba56c536b601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:54.395124 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c19f1b5-dd9d-4777-b587-ba56c536b601 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:54.401211 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1f734c-75d6-431f-adb2-251acf164d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:54.402150 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1f734c-75d6-431f-adb2-251acf164d1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:54.402655 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1f734c-75d6-431f-adb2-251acf164d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:54.403217 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1f734c-75d6-431f-adb2-251acf164d1c admin admin] PATH_INFO: `/v3/projects/47d9c45b398444faa4611a03435775b2` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:54.404805 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1f734c-75d6-431f-adb2-251acf164d1c admin admin] RBAC: Authorizing `identity:delete_project(project_id=47d9c45b398444faa4611a03435775b2)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:54.408572 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1f734c-75d6-431f-adb2-251acf164d1c admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:54.470503 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:32:54.485921 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-dd1f734c-75d6-431f-adb2-251acf164d1c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47d9c45b398444faa4611a03435775b2', 'request_id': 'req-dd1f734c-75d6-431f-adb2-251acf164d1c'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:54.494024 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-dd1f734c-75d6-431f-adb2-251acf164d1c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47d9c45b398444faa4611a03435775b2', 'request_id': 'req-dd1f734c-75d6-431f-adb2-251acf164d1c'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:54.504365 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-dd1f734c-75d6-431f-adb2-251acf164d1c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47d9c45b398444faa4611a03435775b2', 'request_id': 'req-dd1f734c-75d6-431f-adb2-251acf164d1c'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:54.517338 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0f4e16-2d0a-40d8-9be0-84018f489435 service neutron] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:54.520118 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-5f0f4e16-2d0a-40d8-9be0-84018f489435 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:54.528394 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-dd1f734c-75d6-431f-adb2-251acf164d1c admin admin] The token cache is being invalidate because project 47d9c45b398444faa4611a03435775b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81446) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 16:32:54.529011 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-dd1f734c-75d6-431f-adb2-251acf164d1c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:54.529990 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-dd1f734c-75d6-431f-adb2-251acf164d1c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:54.533122 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1019/2015] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 16:32:54 2022] DELETE /identity/v3/projects/47d9c45b398444faa4611a03435775b2 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:32:54.536689 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1f734c-75d6-431f-adb2-251acf164d1c admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:54.538283 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-dd1f734c-75d6-431f-adb2-251acf164d1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:54.563631 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0f4e16-2d0a-40d8-9be0-84018f489435 service neutron] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:54.642138 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1f734c-75d6-431f-adb2-251acf164d1c admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:54.648354 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71505396-f6f5-4f57-8284-2d157a3a8a78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:54.648991 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71505396-f6f5-4f57-8284-2d157a3a8a78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:54.649439 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71505396-f6f5-4f57-8284-2d157a3a8a78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:54.649716 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71505396-f6f5-4f57-8284-2d157a3a8a78 admin admin] PATH_INFO: `/v3/users/4a077173dacd47f19b9b4135374c8cb8` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:54.650939 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71505396-f6f5-4f57-8284-2d157a3a8a78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a077173dacd47f19b9b4135374c8cb8)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:54.653001 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71505396-f6f5-4f57-8284-2d157a3a8a78 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:54.659202 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c11f4c-bf05-490a-8860-b48c1b0b9126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:54.660823 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c11f4c-bf05-490a-8860-b48c1b0b9126 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:54.661187 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c11f4c-bf05-490a-8860-b48c1b0b9126 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:54.661568 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c11f4c-bf05-490a-8860-b48c1b0b9126 admin admin] PATH_INFO: `/v3/projects/3ee7494cbd584a208a40d6b2cc1cf15a` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:54.663781 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c11f4c-bf05-490a-8860-b48c1b0b9126 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ee7494cbd584a208a40d6b2cc1cf15a)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:54.666123 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c11f4c-bf05-490a-8860-b48c1b0b9126 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:54.742336 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-71505396-f6f5-4f57-8284-2d157a3a8a78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a077173dacd47f19b9b4135374c8cb8'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:54.759224 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-71505396-f6f5-4f57-8284-2d157a3a8a78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a077173dacd47f19b9b4135374c8cb8'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:54.768023 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-26c11f4c-bf05-490a-8860-b48c1b0b9126 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ee7494cbd584a208a40d6b2cc1cf15a', 'request_id': 'req-26c11f4c-bf05-490a-8860-b48c1b0b9126'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:54.776333 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-71505396-f6f5-4f57-8284-2d157a3a8a78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a077173dacd47f19b9b4135374c8cb8'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:54.794205 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-71505396-f6f5-4f57-8284-2d157a3a8a78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a077173dacd47f19b9b4135374c8cb8'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:54.795051 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-71505396-f6f5-4f57-8284-2d157a3a8a78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a077173dacd47f19b9b4135374c8cb8'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:54.806700 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-26c11f4c-bf05-490a-8860-b48c1b0b9126 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ee7494cbd584a208a40d6b2cc1cf15a', 'request_id': 'req-26c11f4c-bf05-490a-8860-b48c1b0b9126'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:54.807689 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1020/2016] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 16:32:54 2022] DELETE /identity/v3/users/4a077173dacd47f19b9b4135374c8cb8 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 16:32:54.811328 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:32:54.820152 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-26c11f4c-bf05-490a-8860-b48c1b0b9126 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ee7494cbd584a208a40d6b2cc1cf15a', 'request_id': 'req-26c11f4c-bf05-490a-8860-b48c1b0b9126'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:54.838825 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-26c11f4c-bf05-490a-8860-b48c1b0b9126 admin admin] The token cache is being invalidate because project 3ee7494cbd584a208a40d6b2cc1cf15a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81445) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 16:32:54.839210 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-26c11f4c-bf05-490a-8860-b48c1b0b9126 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:54.839955 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-26c11f4c-bf05-490a-8860-b48c1b0b9126 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:54.842518 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 997/2017] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 16:32:54 2022] DELETE /identity/v3/projects/3ee7494cbd584a208a40d6b2cc1cf15a => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:32:54.847549 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71505396-f6f5-4f57-8284-2d157a3a8a78 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:54.849604 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-71505396-f6f5-4f57-8284-2d157a3a8a78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:55.032025 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:32:55.070186 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71505396-f6f5-4f57-8284-2d157a3a8a78 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:55.085586 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b069863-b7cb-469e-86c4-35ddb8003e53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:55.086246 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b069863-b7cb-469e-86c4-35ddb8003e53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:55.086549 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b069863-b7cb-469e-86c4-35ddb8003e53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:55.086852 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b069863-b7cb-469e-86c4-35ddb8003e53 admin admin] PATH_INFO: `/v3/users/efbb1b4ac2f24e64a6fdf271a875e9e6` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:55.090422 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b069863-b7cb-469e-86c4-35ddb8003e53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=efbb1b4ac2f24e64a6fdf271a875e9e6)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:55.092567 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b069863-b7cb-469e-86c4-35ddb8003e53 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:55.198643 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-4b069863-b7cb-469e-86c4-35ddb8003e53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'efbb1b4ac2f24e64a6fdf271a875e9e6'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:55.212426 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-4b069863-b7cb-469e-86c4-35ddb8003e53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'efbb1b4ac2f24e64a6fdf271a875e9e6'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:55.248146 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-4b069863-b7cb-469e-86c4-35ddb8003e53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'efbb1b4ac2f24e64a6fdf271a875e9e6'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:55.262591 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c11f4c-bf05-490a-8860-b48c1b0b9126 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:55.265483 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-26c11f4c-bf05-490a-8860-b48c1b0b9126 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:55.278884 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-4b069863-b7cb-469e-86c4-35ddb8003e53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'efbb1b4ac2f24e64a6fdf271a875e9e6'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:55.279521 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-4b069863-b7cb-469e-86c4-35ddb8003e53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'efbb1b4ac2f24e64a6fdf271a875e9e6'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:55.287040 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1021/2018] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 16:32:54 2022] DELETE /identity/v3/users/efbb1b4ac2f24e64a6fdf271a875e9e6 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:32:55.387911 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c11f4c-bf05-490a-8860-b48c1b0b9126 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:55.471286 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ead745a-a97e-4b5a-be7b-db094e28059a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:55.471992 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ead745a-a97e-4b5a-be7b-db094e28059a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:55.472275 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ead745a-a97e-4b5a-be7b-db094e28059a admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:55.472753 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ead745a-a97e-4b5a-be7b-db094e28059a admin admin] PATH_INFO: `/v3/projects/456217aed12f412291f90ee033f3f780` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:55.474216 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ead745a-a97e-4b5a-be7b-db094e28059a admin admin] RBAC: Authorizing `identity:delete_project(project_id=456217aed12f412291f90ee033f3f780)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:55.476324 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ead745a-a97e-4b5a-be7b-db094e28059a admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:55.539433 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-7ead745a-a97e-4b5a-be7b-db094e28059a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '456217aed12f412291f90ee033f3f780', 'request_id': 'req-7ead745a-a97e-4b5a-be7b-db094e28059a'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:55.546556 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-7ead745a-a97e-4b5a-be7b-db094e28059a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '456217aed12f412291f90ee033f3f780', 'request_id': 'req-7ead745a-a97e-4b5a-be7b-db094e28059a'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:55.555229 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-7ead745a-a97e-4b5a-be7b-db094e28059a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '456217aed12f412291f90ee033f3f780', 'request_id': 'req-7ead745a-a97e-4b5a-be7b-db094e28059a'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:55.569365 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-7ead745a-a97e-4b5a-be7b-db094e28059a admin admin] The token cache is being invalidate because project 456217aed12f412291f90ee033f3f780 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81445) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 16:32:55.569653 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-7ead745a-a97e-4b5a-be7b-db094e28059a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:55.570352 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-7ead745a-a97e-4b5a-be7b-db094e28059a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:55.571936 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 998/2019] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 16:32:55 2022] DELETE /identity/v3/projects/456217aed12f412291f90ee033f3f780 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 16:32:55.576830 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51298e9d-7ee0-4935-9306-aef4b93016f6 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:55.578759 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51298e9d-7ee0-4935-9306-aef4b93016f6 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:55.578983 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51298e9d-7ee0-4935-9306-aef4b93016f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:55.601456 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-51298e9d-7ee0-4935-9306-aef4b93016f6 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:32:55.602793 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-51298e9d-7ee0-4935-9306-aef4b93016f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:55.668936 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1022/2020] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:32:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:32:55.678093 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59db143a-e0a6-4099-aa2c-cabd93720dc0 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:55.678411 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59db143a-e0a6-4099-aa2c-cabd93720dc0 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:55.678761 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59db143a-e0a6-4099-aa2c-cabd93720dc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:55.703895 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-59db143a-e0a6-4099-aa2c-cabd93720dc0 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:32:55.705518 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-59db143a-e0a6-4099-aa2c-cabd93720dc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:55.721405 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 999/2021] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:32:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:32:55.722795 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51298e9d-7ee0-4935-9306-aef4b93016f6 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:55.736554 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51298e9d-7ee0-4935-9306-aef4b93016f6 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:55.744092 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1f23b1-579d-4d88-96c8-0ecadc659d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:55.745629 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1f23b1-579d-4d88-96c8-0ecadc659d26 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:55.746119 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1f23b1-579d-4d88-96c8-0ecadc659d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:55.747183 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1f23b1-579d-4d88-96c8-0ecadc659d26 admin admin] PATH_INFO: `/v3/domains` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:55.748068 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1f23b1-579d-4d88-96c8-0ecadc659d26 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:32:55.748600 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1f23b1-579d-4d88-96c8-0ecadc659d26 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:55.751891 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1f23b1-579d-4d88-96c8-0ecadc659d26 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:55.772566 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1023/2022] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Sep 9 16:32:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:32:55.777201 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59db143a-e0a6-4099-aa2c-cabd93720dc0 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:55.788465 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59db143a-e0a6-4099-aa2c-cabd93720dc0 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:55.796534 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a388c33a-e1a6-405b-947e-552469094974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:55.797240 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a388c33a-e1a6-405b-947e-552469094974 admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:55.797519 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a388c33a-e1a6-405b-947e-552469094974 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:55.797797 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a388c33a-e1a6-405b-947e-552469094974 admin admin] PATH_INFO: `/v3/projects` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:55.798497 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a388c33a-e1a6-405b-947e-552469094974 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:55.800486 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a388c33a-e1a6-405b-947e-552469094974 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:55.812751 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:INSERT=2,keystone:DELETE=10,keystone:SELECT=88 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:32:55.841456 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1000/2023] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 16:32:55 2022] POST /identity/v3/projects => generated 399 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:32:55.847570 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1f23b1-579d-4d88-96c8-0ecadc659d26 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:55.860032 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1f23b1-579d-4d88-96c8-0ecadc659d26 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:55.861534 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a5ee83-3001-4e97-a195-58b60d243f0c None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:55.862259 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a5ee83-3001-4e97-a195-58b60d243f0c None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:55.862844 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a5ee83-3001-4e97-a195-58b60d243f0c None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:55.864764 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1001/2024] 10.222.0.27 () {54 vars in 921 bytes} [Fri Sep 9 16:32:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:32:55.897890 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c502dc11-b0b5-434f-bf2c-b06a71cf6c2d None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:55.898696 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c502dc11-b0b5-434f-bf2c-b06a71cf6c2d None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:55.899648 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c502dc11-b0b5-434f-bf2c-b06a71cf6c2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:55.931928 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:32:55.944369 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc08b81c-d1cd-4950-b67d-ffd1156eb5d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:55.946176 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc08b81c-d1cd-4950-b67d-ffd1156eb5d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:55.947196 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc08b81c-d1cd-4950-b67d-ffd1156eb5d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:55.948355 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc08b81c-d1cd-4950-b67d-ffd1156eb5d1 admin admin] PATH_INFO: `/v3/users` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:55.948649 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-c502dc11-b0b5-434f-bf2c-b06a71cf6c2d None None] MFA Rules not processed for user `2d73df92393c43b2b5ccc32a2d43d952`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:32:55.948932 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc08b81c-d1cd-4950-b67d-ffd1156eb5d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:55.950164 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-c502dc11-b0b5-434f-bf2c-b06a71cf6c2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:55.951878 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc08b81c-d1cd-4950-b67d-ffd1156eb5d1 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:56.024558 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1024/2025] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 16:32:55 2022] POST /identity/v3/users => generated 300 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:32:56.025784 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc08b81c-d1cd-4950-b67d-ffd1156eb5d1 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:56.042653 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-bc08b81c-d1cd-4950-b67d-ffd1156eb5d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:56.079217 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc08b81c-d1cd-4950-b67d-ffd1156eb5d1 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:56.085975 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1002/2026] 10.222.0.27 () {58 vars in 1018 bytes} [Fri Sep 9 16:32:55 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:32:56.087196 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c502dc11-b0b5-434f-bf2c-b06a71cf6c2d None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:56.092196 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d716e5f1-ada0-4252-ae14-3f87b53356f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:56.092963 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d716e5f1-ada0-4252-ae14-3f87b53356f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:56.094129 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d716e5f1-ada0-4252-ae14-3f87b53356f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:56.095642 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d716e5f1-ada0-4252-ae14-3f87b53356f5 admin admin] PATH_INFO: `/v3/users/262f8e59bf4e40648ff6c49e58dd86c9` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:56.097452 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d716e5f1-ada0-4252-ae14-3f87b53356f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=262f8e59bf4e40648ff6c49e58dd86c9)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:56.100561 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d716e5f1-ada0-4252-ae14-3f87b53356f5 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:56.107957 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c502dc11-b0b5-434f-bf2c-b06a71cf6c2d None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:56.120675 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437ec871-7c7e-46cc-9e21-dc34f9372041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:56.123423 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437ec871-7c7e-46cc-9e21-dc34f9372041 admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:56.123800 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437ec871-7c7e-46cc-9e21-dc34f9372041 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:56.124509 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437ec871-7c7e-46cc-9e21-dc34f9372041 admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:56.128879 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437ec871-7c7e-46cc-9e21-dc34f9372041 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:56.131426 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437ec871-7c7e-46cc-9e21-dc34f9372041 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:56.151126 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1003/2027] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:32:56 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:32:56.151126 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437ec871-7c7e-46cc-9e21-dc34f9372041 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:56.153334 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-437ec871-7c7e-46cc-9e21-dc34f9372041 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:56.178042 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437ec871-7c7e-46cc-9e21-dc34f9372041 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:56.184651 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52516714-79f7-4fd6-bbcf-f12ec8552cfe service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d73df92393c43b2b5ccc32a2d43d952', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:56.185344 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52516714-79f7-4fd6-bbcf-f12ec8552cfe service placement] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:56.185643 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52516714-79f7-4fd6-bbcf-f12ec8552cfe service placement] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:56.185889 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52516714-79f7-4fd6-bbcf-f12ec8552cfe service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:56.197098 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52516714-79f7-4fd6-bbcf-f12ec8552cfe service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:56.199906 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52516714-79f7-4fd6-bbcf-f12ec8552cfe service placement] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:56.210478 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-d716e5f1-ada0-4252-ae14-3f87b53356f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '262f8e59bf4e40648ff6c49e58dd86c9'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:56.214372 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1004/2028] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:32:56 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:32:56.215276 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52516714-79f7-4fd6-bbcf-f12ec8552cfe service placement] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:56.217000 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-52516714-79f7-4fd6-bbcf-f12ec8552cfe service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:56.229256 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-d716e5f1-ada0-4252-ae14-3f87b53356f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '262f8e59bf4e40648ff6c49e58dd86c9'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:56.233198 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52516714-79f7-4fd6-bbcf-f12ec8552cfe service placement] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:56.239291 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f6fefd-5ec0-4c06-99ab-7ecaf04c615f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:56.239909 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f6fefd-5ec0-4c06-99ab-7ecaf04c615f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:56.240185 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f6fefd-5ec0-4c06-99ab-7ecaf04c615f admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:56.240453 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f6fefd-5ec0-4c06-99ab-7ecaf04c615f admin admin] PATH_INFO: `/v3/users/c1c5114ec3694783b672e534785d59ea` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:56.241576 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f6fefd-5ec0-4c06-99ab-7ecaf04c615f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1c5114ec3694783b672e534785d59ea)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:56.243961 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f6fefd-5ec0-4c06-99ab-7ecaf04c615f admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:56.249848 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-d716e5f1-ada0-4252-ae14-3f87b53356f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '262f8e59bf4e40648ff6c49e58dd86c9'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:56.261084 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-d716e5f1-ada0-4252-ae14-3f87b53356f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '262f8e59bf4e40648ff6c49e58dd86c9'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:56.262189 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-d716e5f1-ada0-4252-ae14-3f87b53356f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '262f8e59bf4e40648ff6c49e58dd86c9'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:56.282621 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1025/2029] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 16:32:56 2022] DELETE /identity/v3/users/262f8e59bf4e40648ff6c49e58dd86c9 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:32:56.282621 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d716e5f1-ada0-4252-ae14-3f87b53356f5 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:56.282621 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-d716e5f1-ada0-4252-ae14-3f87b53356f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:56.337639 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-a3f6fefd-5ec0-4c06-99ab-7ecaf04c615f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1c5114ec3694783b672e534785d59ea'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:56.350319 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-a3f6fefd-5ec0-4c06-99ab-7ecaf04c615f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1c5114ec3694783b672e534785d59ea'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:56.351254 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-a3f6fefd-5ec0-4c06-99ab-7ecaf04c615f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1c5114ec3694783b672e534785d59ea'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:56.362596 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-a3f6fefd-5ec0-4c06-99ab-7ecaf04c615f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1c5114ec3694783b672e534785d59ea'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:56.377194 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d716e5f1-ada0-4252-ae14-3f87b53356f5 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:56.381366 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-a3f6fefd-5ec0-4c06-99ab-7ecaf04c615f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1c5114ec3694783b672e534785d59ea'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:56.384093 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba347df-d690-416e-9ca1-096a56fc3e5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:56.387389 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba347df-d690-416e-9ca1-096a56fc3e5d admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:56.387389 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba347df-d690-416e-9ca1-096a56fc3e5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:56.387389 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba347df-d690-416e-9ca1-096a56fc3e5d admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:56.387734 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba347df-d690-416e-9ca1-096a56fc3e5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:56.389437 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba347df-d690-416e-9ca1-096a56fc3e5d admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:56.389925 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1005/2030] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 16:32:56 2022] DELETE /identity/v3/users/c1c5114ec3694783b672e534785d59ea => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:32:56.391036 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f6fefd-5ec0-4c06-99ab-7ecaf04c615f admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:56.392326 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-a3f6fefd-5ec0-4c06-99ab-7ecaf04c615f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:56.406159 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1026/2031] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:32:56 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:32:56.408439 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ba57dc-a773-4fc4-9096-91591ed53550 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:56.408847 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ba57dc-a773-4fc4-9096-91591ed53550 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:56.409518 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ba57dc-a773-4fc4-9096-91591ed53550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:56.443005 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-d4ba57dc-a773-4fc4-9096-91591ed53550 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:32:56.444721 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-d4ba57dc-a773-4fc4-9096-91591ed53550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:56.452687 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:32:56.491234 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f6fefd-5ec0-4c06-99ab-7ecaf04c615f admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:56.500439 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8a953c-e730-4f85-a618-122c29b3a64c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:56.500439 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8a953c-e730-4f85-a618-122c29b3a64c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:56.500439 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8a953c-e730-4f85-a618-122c29b3a64c admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:56.500439 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8a953c-e730-4f85-a618-122c29b3a64c admin admin] PATH_INFO: `/v3/projects/555948e193c045e1a8fa7a63274b0a36` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:56.502513 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8a953c-e730-4f85-a618-122c29b3a64c admin admin] RBAC: Authorizing `identity:delete_project(project_id=555948e193c045e1a8fa7a63274b0a36)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:56.504851 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8a953c-e730-4f85-a618-122c29b3a64c admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:56.511489 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:32:56.545455 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1027/2032] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:32:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:32:56.545455 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ba57dc-a773-4fc4-9096-91591ed53550 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:56.546016 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-d4ba57dc-a773-4fc4-9096-91591ed53550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:56.558979 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ba57dc-a773-4fc4-9096-91591ed53550 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:56.576217 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-0e8a953c-e730-4f85-a618-122c29b3a64c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '555948e193c045e1a8fa7a63274b0a36', 'request_id': 'req-0e8a953c-e730-4f85-a618-122c29b3a64c'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:56.585527 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-0e8a953c-e730-4f85-a618-122c29b3a64c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '555948e193c045e1a8fa7a63274b0a36', 'request_id': 'req-0e8a953c-e730-4f85-a618-122c29b3a64c'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:56.594982 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-0e8a953c-e730-4f85-a618-122c29b3a64c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '555948e193c045e1a8fa7a63274b0a36', 'request_id': 'req-0e8a953c-e730-4f85-a618-122c29b3a64c'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:56.607452 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-0e8a953c-e730-4f85-a618-122c29b3a64c admin admin] The token cache is being invalidate because project 555948e193c045e1a8fa7a63274b0a36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81445) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 16:32:56.607652 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-0e8a953c-e730-4f85-a618-122c29b3a64c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:56.610429 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-0e8a953c-e730-4f85-a618-122c29b3a64c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:56.612349 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1006/2033] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 16:32:56 2022] DELETE /identity/v3/projects/555948e193c045e1a8fa7a63274b0a36 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:32:56.612981 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8a953c-e730-4f85-a618-122c29b3a64c admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:56.614379 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-0e8a953c-e730-4f85-a618-122c29b3a64c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:56.639384 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d396c17-51f6-49aa-97eb-5c04097a474e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:56.640043 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d396c17-51f6-49aa-97eb-5c04097a474e admin admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:56.640322 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d396c17-51f6-49aa-97eb-5c04097a474e admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:56.640593 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d396c17-51f6-49aa-97eb-5c04097a474e admin admin] PATH_INFO: `/v3/projects/761ee24414da4d7189d854277278fecb/users/74300e85e68a41a0b65595fc0ef92541/roles/b38e84bf077846ee802e6bb1bad83522` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:56.656351 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d396c17-51f6-49aa-97eb-5c04097a474e admin admin] RBAC: Authorizing `identity:create_grant(project_id=761ee24414da4d7189d854277278fecb, user_id=74300e85e68a41a0b65595fc0ef92541, role_id=b38e84bf077846ee802e6bb1bad83522)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:56.659136 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d396c17-51f6-49aa-97eb-5c04097a474e admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:56.673246 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1028/2034] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 16:32:56 2022] PUT /identity/v3/projects/761ee24414da4d7189d854277278fecb/users/74300e85e68a41a0b65595fc0ef92541/roles/b38e84bf077846ee802e6bb1bad83522 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:32:56.673818 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d396c17-51f6-49aa-97eb-5c04097a474e admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:56.675477 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-4d396c17-51f6-49aa-97eb-5c04097a474e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:56.683680 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8a953c-e730-4f85-a618-122c29b3a64c admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:56.740793 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d396c17-51f6-49aa-97eb-5c04097a474e admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:56.745368 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34baad05-e231-4b9e-ba12-944a43c6594a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f44bfdd5214e8d84a2c0a5b1fd9b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:56.745997 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34baad05-e231-4b9e-ba12-944a43c6594a service neutron] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:56.746326 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34baad05-e231-4b9e-ba12-944a43c6594a service neutron] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:56.746467 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c51af5-a6ba-4e13-acf3-d48d1b164164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:56.746613 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34baad05-e231-4b9e-ba12-944a43c6594a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:56.747106 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c51af5-a6ba-4e13-acf3-d48d1b164164 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:56.747476 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c51af5-a6ba-4e13-acf3-d48d1b164164 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:56.748335 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c51af5-a6ba-4e13-acf3-d48d1b164164 admin admin] PATH_INFO: `/v3/projects/da49ad38515a42ecac9714c58c3666a9` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:56.749175 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-34baad05-e231-4b9e-ba12-944a43c6594a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:56.749474 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c51af5-a6ba-4e13-acf3-d48d1b164164 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da49ad38515a42ecac9714c58c3666a9)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:56.751422 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c51af5-a6ba-4e13-acf3-d48d1b164164 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:56.761730 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34baad05-e231-4b9e-ba12-944a43c6594a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:56.763297 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34baad05-e231-4b9e-ba12-944a43c6594a service neutron] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:56.768831 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:32:56.774141 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1029/2035] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:32:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:32:56.775541 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34baad05-e231-4b9e-ba12-944a43c6594a service neutron] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:56.776858 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-34baad05-e231-4b9e-ba12-944a43c6594a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:56.790025 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34baad05-e231-4b9e-ba12-944a43c6594a service neutron] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:56.797386 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04ccb98-28d7-47a2-80b7-a25d097079ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:56.798496 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04ccb98-28d7-47a2-80b7-a25d097079ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:56.798874 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04ccb98-28d7-47a2-80b7-a25d097079ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:56.799648 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04ccb98-28d7-47a2-80b7-a25d097079ac admin admin] PATH_INFO: `/v3/users/fe3221c6e9a241f5913443c2354d5b78` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:56.801205 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04ccb98-28d7-47a2-80b7-a25d097079ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe3221c6e9a241f5913443c2354d5b78)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:56.803887 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04ccb98-28d7-47a2-80b7-a25d097079ac admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:56.808606 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-04c51af5-a6ba-4e13-acf3-d48d1b164164 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da49ad38515a42ecac9714c58c3666a9', 'request_id': 'req-04c51af5-a6ba-4e13-acf3-d48d1b164164'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:56.816652 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-04c51af5-a6ba-4e13-acf3-d48d1b164164 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da49ad38515a42ecac9714c58c3666a9', 'request_id': 'req-04c51af5-a6ba-4e13-acf3-d48d1b164164'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:56.833360 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-04c51af5-a6ba-4e13-acf3-d48d1b164164 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da49ad38515a42ecac9714c58c3666a9', 'request_id': 'req-04c51af5-a6ba-4e13-acf3-d48d1b164164'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:56.850403 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-04c51af5-a6ba-4e13-acf3-d48d1b164164 admin admin] The token cache is being invalidate because project da49ad38515a42ecac9714c58c3666a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81445) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 16:32:56.850700 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-04c51af5-a6ba-4e13-acf3-d48d1b164164 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:56.851672 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-04c51af5-a6ba-4e13-acf3-d48d1b164164 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:56.858471 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1007/2036] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 16:32:56 2022] DELETE /identity/v3/projects/da49ad38515a42ecac9714c58c3666a9 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:32:56.858471 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91973721-f623-4578-afde-8be0e987752a None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:56.858471 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91973721-f623-4578-afde-8be0e987752a None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:56.858471 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91973721-f623-4578-afde-8be0e987752a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:56.878017 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-e04ccb98-28d7-47a2-80b7-a25d097079ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe3221c6e9a241f5913443c2354d5b78'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:56.889927 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-e04ccb98-28d7-47a2-80b7-a25d097079ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe3221c6e9a241f5913443c2354d5b78'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:56.902271 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-91973721-f623-4578-afde-8be0e987752a None None] MFA Rules not processed for user `74300e85e68a41a0b65595fc0ef92541`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:32:56.905098 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-91973721-f623-4578-afde-8be0e987752a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:56.907201 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-e04ccb98-28d7-47a2-80b7-a25d097079ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe3221c6e9a241f5913443c2354d5b78'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:56.909500 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=90,keystone:INSERT=1,keystone:DELETE=9 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:32:56.923794 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-e04ccb98-28d7-47a2-80b7-a25d097079ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe3221c6e9a241f5913443c2354d5b78'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:56.925231 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-e04ccb98-28d7-47a2-80b7-a25d097079ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe3221c6e9a241f5913443c2354d5b78'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:56.932885 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1030/2037] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 16:32:56 2022] DELETE /identity/v3/users/fe3221c6e9a241f5913443c2354d5b78 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:32:56.934393 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b05aed-465e-43da-9ee8-7b136bc01d99 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:56.934667 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b05aed-465e-43da-9ee8-7b136bc01d99 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:56.934954 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b05aed-465e-43da-9ee8-7b136bc01d99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:56.963638 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-58b05aed-465e-43da-9ee8-7b136bc01d99 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:32:56.964868 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-58b05aed-465e-43da-9ee8-7b136bc01d99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:57.012599 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1008/2038] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:32:56 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:32:57.017866 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91973721-f623-4578-afde-8be0e987752a None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:57.020103 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-91973721-f623-4578-afde-8be0e987752a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:57.071226 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1031/2039] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:32:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:32:57.079187 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aff964-bfe1-47ed-8539-806f985ec53e None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:57.079549 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aff964-bfe1-47ed-8539-806f985ec53e None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:57.080046 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aff964-bfe1-47ed-8539-806f985ec53e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:57.101713 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-95aff964-bfe1-47ed-8539-806f985ec53e None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:32:57.104619 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-95aff964-bfe1-47ed-8539-806f985ec53e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:57.106592 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91973721-f623-4578-afde-8be0e987752a None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:57.112418 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80103ca-70cf-4714-8635-75ecaa36b4bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:57.113102 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80103ca-70cf-4714-8635-75ecaa36b4bb admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:57.113390 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80103ca-70cf-4714-8635-75ecaa36b4bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:57.113675 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80103ca-70cf-4714-8635-75ecaa36b4bb admin admin] PATH_INFO: `/v3/projects` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:57.114423 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80103ca-70cf-4714-8635-75ecaa36b4bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:57.116653 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80103ca-70cf-4714-8635-75ecaa36b4bb admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:57.117434 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1032/2040] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:32:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 16:32:57.121968 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95aff964-bfe1-47ed-8539-806f985ec53e None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:57.135720 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95aff964-bfe1-47ed-8539-806f985ec53e None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:57.141536 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880713b4-923a-4040-8827-de8f02a0e79f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:57.142136 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880713b4-923a-4040-8827-de8f02a0e79f admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:57.142755 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880713b4-923a-4040-8827-de8f02a0e79f admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:57.142887 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880713b4-923a-4040-8827-de8f02a0e79f admin admin] PATH_INFO: `/v3/domains` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:57.143428 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880713b4-923a-4040-8827-de8f02a0e79f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:32:57.143734 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880713b4-923a-4040-8827-de8f02a0e79f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:57.145769 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880713b4-923a-4040-8827-de8f02a0e79f admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:57.148013 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1009/2041] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 16:32:57 2022] POST /identity/v3/projects => generated 399 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:32:57.152307 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80103ca-70cf-4714-8635-75ecaa36b4bb admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:57.162977 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1033/2042] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Sep 9 16:32:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:32:57.167527 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880713b4-923a-4040-8827-de8f02a0e79f admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:57.179055 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880713b4-923a-4040-8827-de8f02a0e79f admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:57.183823 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:32:57.239072 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80103ca-70cf-4714-8635-75ecaa36b4bb admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:57.245738 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0e6a9c-aab1-4129-a220-a9a72376f449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:57.246721 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ae0cae-4817-4bae-9c60-2c1fba664023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:57.247331 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ae0cae-4817-4bae-9c60-2c1fba664023 admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:57.248344 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ae0cae-4817-4bae-9c60-2c1fba664023 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:57.248793 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ae0cae-4817-4bae-9c60-2c1fba664023 admin admin] PATH_INFO: `/v3/projects` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:57.249745 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ae0cae-4817-4bae-9c60-2c1fba664023 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:57.250279 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0e6a9c-aab1-4129-a220-a9a72376f449 admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:57.250639 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0e6a9c-aab1-4129-a220-a9a72376f449 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:57.250981 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0e6a9c-aab1-4129-a220-a9a72376f449 admin admin] PATH_INFO: `/v3/users` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:57.251679 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0e6a9c-aab1-4129-a220-a9a72376f449 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:57.252641 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ae0cae-4817-4bae-9c60-2c1fba664023 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:57.254020 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0e6a9c-aab1-4129-a220-a9a72376f449 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:57.287546 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1010/2043] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 16:32:57 2022] POST /identity/v3/users => generated 306 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:32:57.290957 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0e6a9c-aab1-4129-a220-a9a72376f449 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:57.292587 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-0c0e6a9c-aab1-4129-a220-a9a72376f449 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:57.313529 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1034/2044] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 16:32:57 2022] POST /identity/v3/projects => generated 365 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:32:57.313529 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ae0cae-4817-4bae-9c60-2c1fba664023 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:57.320702 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0e6a9c-aab1-4129-a220-a9a72376f449 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:57.386011 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:INSERT=2,keystone:DELETE=1,keystone:SELECT=97 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:32:57.391254 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ae0cae-4817-4bae-9c60-2c1fba664023 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:57.399000 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa00cd6d-31e3-4cf3-b74d-563c7a9340ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:57.400127 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa00cd6d-31e3-4cf3-b74d-563c7a9340ab admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:57.400552 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa00cd6d-31e3-4cf3-b74d-563c7a9340ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:57.401029 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa00cd6d-31e3-4cf3-b74d-563c7a9340ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:57.401968 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa00cd6d-31e3-4cf3-b74d-563c7a9340ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:57.403842 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ff4356-1dd5-46a1-a328-f382d27df121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:57.404621 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ff4356-1dd5-46a1-a328-f382d27df121 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:57.404997 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ff4356-1dd5-46a1-a328-f382d27df121 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:57.405324 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa00cd6d-31e3-4cf3-b74d-563c7a9340ab admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:57.405931 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ff4356-1dd5-46a1-a328-f382d27df121 admin admin] PATH_INFO: `/v3/projects/91fa934d9f6c430bac6702b0d00b2fe1` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:57.407263 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ff4356-1dd5-46a1-a328-f382d27df121 admin admin] RBAC: Authorizing `identity:delete_project(project_id=91fa934d9f6c430bac6702b0d00b2fe1)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:57.409562 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ff4356-1dd5-46a1-a328-f382d27df121 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:57.432334 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1035/2045] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:32:57 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:32:57.433587 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa00cd6d-31e3-4cf3-b74d-563c7a9340ab admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:57.450997 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa00cd6d-31e3-4cf3-b74d-563c7a9340ab admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:57.457257 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a06bc3-29e8-43d4-833f-407d89a7d867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:57.457928 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a06bc3-29e8-43d4-833f-407d89a7d867 admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:57.458204 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a06bc3-29e8-43d4-833f-407d89a7d867 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:57.458546 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a06bc3-29e8-43d4-833f-407d89a7d867 admin admin] PATH_INFO: `/v3/users` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:57.459258 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a06bc3-29e8-43d4-833f-407d89a7d867 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:57.461539 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a06bc3-29e8-43d4-833f-407d89a7d867 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:57.481177 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-38ff4356-1dd5-46a1-a328-f382d27df121 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91fa934d9f6c430bac6702b0d00b2fe1', 'request_id': 'req-38ff4356-1dd5-46a1-a328-f382d27df121'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:57.490207 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-38ff4356-1dd5-46a1-a328-f382d27df121 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91fa934d9f6c430bac6702b0d00b2fe1', 'request_id': 'req-38ff4356-1dd5-46a1-a328-f382d27df121'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:57.491046 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1036/2046] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 16:32:57 2022] POST /identity/v3/users => generated 283 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:32:57.492222 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a06bc3-29e8-43d4-833f-407d89a7d867 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:57.501696 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-38ff4356-1dd5-46a1-a328-f382d27df121 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91fa934d9f6c430bac6702b0d00b2fe1', 'request_id': 'req-38ff4356-1dd5-46a1-a328-f382d27df121'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:57.505302 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a06bc3-29e8-43d4-833f-407d89a7d867 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:57.514088 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-38ff4356-1dd5-46a1-a328-f382d27df121 admin admin] The token cache is being invalidate because project 91fa934d9f6c430bac6702b0d00b2fe1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81445) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 16:32:57.514530 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-38ff4356-1dd5-46a1-a328-f382d27df121 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:57.515408 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-38ff4356-1dd5-46a1-a328-f382d27df121 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:57.517108 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1011/2047] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 16:32:57 2022] DELETE /identity/v3/projects/91fa934d9f6c430bac6702b0d00b2fe1 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:32:57.518024 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ff4356-1dd5-46a1-a328-f382d27df121 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:57.519421 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-38ff4356-1dd5-46a1-a328-f382d27df121 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:57.561435 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:32:57.565628 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35319086-4fb6-4697-bb0d-4f2a92e6bb0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:57.566640 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35319086-4fb6-4697-bb0d-4f2a92e6bb0c admin admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:57.566932 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35319086-4fb6-4697-bb0d-4f2a92e6bb0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:57.567224 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35319086-4fb6-4697-bb0d-4f2a92e6bb0c admin admin] PATH_INFO: `/v3/projects/c1f0c594422848a3a96cb61f52e042c0/users/9690bb16f36e4b51abb8a12484f8382f/roles/0a36d1be416f4089be19be979943b731` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:57.582726 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35319086-4fb6-4697-bb0d-4f2a92e6bb0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1f0c594422848a3a96cb61f52e042c0, user_id=9690bb16f36e4b51abb8a12484f8382f, role_id=0a36d1be416f4089be19be979943b731)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:57.585354 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35319086-4fb6-4697-bb0d-4f2a92e6bb0c admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:57.586421 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ff4356-1dd5-46a1-a328-f382d27df121 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:57.591872 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348f2ad1-1745-44b7-a871-d71a4dd17959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:57.592594 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348f2ad1-1745-44b7-a871-d71a4dd17959 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:57.592902 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348f2ad1-1745-44b7-a871-d71a4dd17959 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:57.593198 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348f2ad1-1745-44b7-a871-d71a4dd17959 admin admin] PATH_INFO: `/v3/projects/0ca1280ed95146d4a34096709eb7591e` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:57.594437 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348f2ad1-1745-44b7-a871-d71a4dd17959 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ca1280ed95146d4a34096709eb7591e)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:57.596505 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348f2ad1-1745-44b7-a871-d71a4dd17959 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:57.600844 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1037/2048] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 16:32:57 2022] PUT /identity/v3/projects/c1f0c594422848a3a96cb61f52e042c0/users/9690bb16f36e4b51abb8a12484f8382f/roles/0a36d1be416f4089be19be979943b731 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:32:57.603968 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35319086-4fb6-4697-bb0d-4f2a92e6bb0c admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:57.603968 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-35319086-4fb6-4697-bb0d-4f2a92e6bb0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:57.646637 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-348f2ad1-1745-44b7-a871-d71a4dd17959 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ca1280ed95146d4a34096709eb7591e', 'request_id': 'req-348f2ad1-1745-44b7-a871-d71a4dd17959'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:57.653235 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-348f2ad1-1745-44b7-a871-d71a4dd17959 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ca1280ed95146d4a34096709eb7591e', 'request_id': 'req-348f2ad1-1745-44b7-a871-d71a4dd17959'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:57.663365 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-348f2ad1-1745-44b7-a871-d71a4dd17959 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ca1280ed95146d4a34096709eb7591e', 'request_id': 'req-348f2ad1-1745-44b7-a871-d71a4dd17959'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:57.676881 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-348f2ad1-1745-44b7-a871-d71a4dd17959 admin admin] The token cache is being invalidate because project 0ca1280ed95146d4a34096709eb7591e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81445) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 16:32:57.677183 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-348f2ad1-1745-44b7-a871-d71a4dd17959 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:57.677903 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-348f2ad1-1745-44b7-a871-d71a4dd17959 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:57.679628 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1012/2049] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 16:32:57 2022] DELETE /identity/v3/projects/0ca1280ed95146d4a34096709eb7591e => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:32:57.680143 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35319086-4fb6-4697-bb0d-4f2a92e6bb0c admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:57.680589 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348f2ad1-1745-44b7-a871-d71a4dd17959 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:57.681465 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-348f2ad1-1745-44b7-a871-d71a4dd17959 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:57.744845 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330a559f-c7d8-41b2-b1e4-0608f400c971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:57.745361 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330a559f-c7d8-41b2-b1e4-0608f400c971 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:57.745639 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330a559f-c7d8-41b2-b1e4-0608f400c971 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:57.745911 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330a559f-c7d8-41b2-b1e4-0608f400c971 admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:57.746590 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330a559f-c7d8-41b2-b1e4-0608f400c971 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:57.748731 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330a559f-c7d8-41b2-b1e4-0608f400c971 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:57.750443 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348f2ad1-1745-44b7-a871-d71a4dd17959 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:57.755040 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc413d6-7135-4c4d-84b3-ed3dcc1f51ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:57.755690 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc413d6-7135-4c4d-84b3-ed3dcc1f51ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:57.755983 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc413d6-7135-4c4d-84b3-ed3dcc1f51ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:57.756233 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc413d6-7135-4c4d-84b3-ed3dcc1f51ca admin admin] PATH_INFO: `/v3/users/3659e4a118ec42798a21fd06b1c91960` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:57.757367 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc413d6-7135-4c4d-84b3-ed3dcc1f51ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=3659e4a118ec42798a21fd06b1c91960)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:57.758658 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1038/2050] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:32:57 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:32:57.759438 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc413d6-7135-4c4d-84b3-ed3dcc1f51ca admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:57.759558 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330a559f-c7d8-41b2-b1e4-0608f400c971 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:57.761146 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-330a559f-c7d8-41b2-b1e4-0608f400c971 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:57.769109 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:32:57.774534 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330a559f-c7d8-41b2-b1e4-0608f400c971 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:57.784049 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffbd206-a50d-4187-9390-7095c95a2f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:57.784991 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffbd206-a50d-4187-9390-7095c95a2f46 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:57.785382 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffbd206-a50d-4187-9390-7095c95a2f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:57.785697 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffbd206-a50d-4187-9390-7095c95a2f46 admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:57.786806 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffbd206-a50d-4187-9390-7095c95a2f46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:57.789016 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffbd206-a50d-4187-9390-7095c95a2f46 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:57.800912 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1039/2051] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:32:57 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:32:57.803676 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec75543-e87f-4b87-b3b7-bd1e25a6d984 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:57.803967 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec75543-e87f-4b87-b3b7-bd1e25a6d984 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:57.804245 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec75543-e87f-4b87-b3b7-bd1e25a6d984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:57.811376 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-2dc413d6-7135-4c4d-84b3-ed3dcc1f51ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3659e4a118ec42798a21fd06b1c91960'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:57.819863 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-2dc413d6-7135-4c4d-84b3-ed3dcc1f51ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3659e4a118ec42798a21fd06b1c91960'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:57.820491 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-2dc413d6-7135-4c4d-84b3-ed3dcc1f51ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3659e4a118ec42798a21fd06b1c91960'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:57.825042 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-0ec75543-e87f-4b87-b3b7-bd1e25a6d984 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:32:57.826292 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-0ec75543-e87f-4b87-b3b7-bd1e25a6d984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:57.827454 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-2dc413d6-7135-4c4d-84b3-ed3dcc1f51ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3659e4a118ec42798a21fd06b1c91960'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:57.832560 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:32:57.834323 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1040/2052] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:32:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:32:57.835183 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec75543-e87f-4b87-b3b7-bd1e25a6d984 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:57.836399 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-0ec75543-e87f-4b87-b3b7-bd1e25a6d984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:57.845336 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-2dc413d6-7135-4c4d-84b3-ed3dcc1f51ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3659e4a118ec42798a21fd06b1c91960'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:57.849066 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec75543-e87f-4b87-b3b7-bd1e25a6d984 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:57.851457 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1013/2053] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 16:32:57 2022] DELETE /identity/v3/users/3659e4a118ec42798a21fd06b1c91960 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:32:57.852228 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc413d6-7135-4c4d-84b3-ed3dcc1f51ca admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:57.853507 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-2dc413d6-7135-4c4d-84b3-ed3dcc1f51ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:57.853696 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e3c43b-20ad-44d0-8352-7ddd4d92ef75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:57.854642 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e3c43b-20ad-44d0-8352-7ddd4d92ef75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:57.854856 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e3c43b-20ad-44d0-8352-7ddd4d92ef75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:57.855129 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e3c43b-20ad-44d0-8352-7ddd4d92ef75 admin admin] PATH_INFO: `/v3/users/c2eff9bc7f914f0fb4b354df01648743` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:57.856302 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e3c43b-20ad-44d0-8352-7ddd4d92ef75 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2eff9bc7f914f0fb4b354df01648743)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:57.858391 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e3c43b-20ad-44d0-8352-7ddd4d92ef75 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:57.912221 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-c8e3c43b-20ad-44d0-8352-7ddd4d92ef75 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2eff9bc7f914f0fb4b354df01648743'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:57.924623 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-c8e3c43b-20ad-44d0-8352-7ddd4d92ef75 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2eff9bc7f914f0fb4b354df01648743'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:57.936335 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc413d6-7135-4c4d-84b3-ed3dcc1f51ca admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:57.939427 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-c8e3c43b-20ad-44d0-8352-7ddd4d92ef75 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2eff9bc7f914f0fb4b354df01648743'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:57.942048 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf53c05-ada3-454f-8c91-44b379f56c2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:57.942693 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf53c05-ada3-454f-8c91-44b379f56c2b admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:57.942971 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf53c05-ada3-454f-8c91-44b379f56c2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:57.943234 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf53c05-ada3-454f-8c91-44b379f56c2b admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:57.943887 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf53c05-ada3-454f-8c91-44b379f56c2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:57.945662 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf53c05-ada3-454f-8c91-44b379f56c2b admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:57.947653 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-c8e3c43b-20ad-44d0-8352-7ddd4d92ef75 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2eff9bc7f914f0fb4b354df01648743'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:57.948992 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-c8e3c43b-20ad-44d0-8352-7ddd4d92ef75 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2eff9bc7f914f0fb4b354df01648743'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:57.956257 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1014/2054] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:32:57 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:32:57.957000 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1041/2055] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 16:32:57 2022] DELETE /identity/v3/users/c2eff9bc7f914f0fb4b354df01648743 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:32:57.960377 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf53c05-ada3-454f-8c91-44b379f56c2b admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:57.961538 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6ca5e7-3cbf-4621-a2d0-3a3f21122a53 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:57.962172 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6ca5e7-3cbf-4621-a2d0-3a3f21122a53 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:57.962327 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6ca5e7-3cbf-4621-a2d0-3a3f21122a53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:57.962627 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-cdf53c05-ada3-454f-8c91-44b379f56c2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:57.976883 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf53c05-ada3-454f-8c91-44b379f56c2b admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:57.989962 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-db6ca5e7-3cbf-4621-a2d0-3a3f21122a53 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:32:57.991460 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-db6ca5e7-3cbf-4621-a2d0-3a3f21122a53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:58.048973 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1430f5-b69f-4840-a6de-51ebc656b668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:58.049997 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1430f5-b69f-4840-a6de-51ebc656b668 admin admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:58.050256 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1430f5-b69f-4840-a6de-51ebc656b668 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:58.050719 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1430f5-b69f-4840-a6de-51ebc656b668 admin admin] PATH_INFO: `/v3/projects/c1f0c594422848a3a96cb61f52e042c0/users/9690bb16f36e4b51abb8a12484f8382f/roles/0a36d1be416f4089be19be979943b731` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:58.052774 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1430f5-b69f-4840-a6de-51ebc656b668 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1f0c594422848a3a96cb61f52e042c0, user_id=9690bb16f36e4b51abb8a12484f8382f, role_id=0a36d1be416f4089be19be979943b731)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:58.055633 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1430f5-b69f-4840-a6de-51ebc656b668 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:58.070767 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1015/2056] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 16:32:57 2022] PUT /identity/v3/projects/c1f0c594422848a3a96cb61f52e042c0/users/9690bb16f36e4b51abb8a12484f8382f/roles/0a36d1be416f4089be19be979943b731 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:32:58.070767 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1430f5-b69f-4840-a6de-51ebc656b668 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:58.071027 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1042/2057] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:32:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:32:58.071853 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a964993-1adc-4834-8cd6-857c37124534 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:58.072141 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a964993-1adc-4834-8cd6-857c37124534 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:58.072412 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a964993-1adc-4834-8cd6-857c37124534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:58.079902 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-aa1430f5-b69f-4840-a6de-51ebc656b668 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:58.094113 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-9a964993-1adc-4834-8cd6-857c37124534 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:32:58.095856 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-9a964993-1adc-4834-8cd6-857c37124534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:58.170427 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1430f5-b69f-4840-a6de-51ebc656b668 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:58.177380 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb65a34d-07bc-40cd-b93b-695b1f8b8f5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:58.178353 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb65a34d-07bc-40cd-b93b-695b1f8b8f5e admin admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:58.180755 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:32:58.186376 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb65a34d-07bc-40cd-b93b-695b1f8b8f5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:58.187050 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb65a34d-07bc-40cd-b93b-695b1f8b8f5e admin admin] PATH_INFO: `/v3/projects/7921ff592fc545bebb87b18429cc1287/users/9c2bf83d03614fb28262e1a49412da67/roles/b38e84bf077846ee802e6bb1bad83522` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:58.198672 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1043/2058] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:32:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:32:58.199683 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a964993-1adc-4834-8cd6-857c37124534 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:58.205576 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb65a34d-07bc-40cd-b93b-695b1f8b8f5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7921ff592fc545bebb87b18429cc1287, user_id=9c2bf83d03614fb28262e1a49412da67, role_id=b38e84bf077846ee802e6bb1bad83522)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:58.208302 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb65a34d-07bc-40cd-b93b-695b1f8b8f5e admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:58.217517 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a964993-1adc-4834-8cd6-857c37124534 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:58.220503 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=97,keystone:DELETE=1,keystone:INSERT=2 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:32:58.228605 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1016/2059] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 16:32:58 2022] PUT /identity/v3/projects/7921ff592fc545bebb87b18429cc1287/users/9c2bf83d03614fb28262e1a49412da67/roles/b38e84bf077846ee802e6bb1bad83522 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:32:58.230868 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e9a3b9-e2ef-4cb6-94ae-8b9d92d56ac3 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:58.231331 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e9a3b9-e2ef-4cb6-94ae-8b9d92d56ac3 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:58.232283 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e9a3b9-e2ef-4cb6-94ae-8b9d92d56ac3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:58.267688 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-e1e9a3b9-e2ef-4cb6-94ae-8b9d92d56ac3 None None] MFA Rules not processed for user `9690bb16f36e4b51abb8a12484f8382f`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:32:58.268997 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-e1e9a3b9-e2ef-4cb6-94ae-8b9d92d56ac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:58.292503 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7f04b5-ca7f-46f8-b465-cf1a64998f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:58.293110 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7f04b5-ca7f-46f8-b465-cf1a64998f8b admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:58.293385 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7f04b5-ca7f-46f8-b465-cf1a64998f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:58.293652 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7f04b5-ca7f-46f8-b465-cf1a64998f8b admin admin] PATH_INFO: `/v3/domains` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:58.294902 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7f04b5-ca7f-46f8-b465-cf1a64998f8b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:32:58.295559 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7f04b5-ca7f-46f8-b465-cf1a64998f8b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:58.297174 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7f04b5-ca7f-46f8-b465-cf1a64998f8b admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:58.309054 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1044/2060] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Sep 9 16:32:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:32:58.313854 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7f04b5-ca7f-46f8-b465-cf1a64998f8b admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:58.316099 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-3d7f04b5-ca7f-46f8-b465-cf1a64998f8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:58.328722 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7f04b5-ca7f-46f8-b465-cf1a64998f8b admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:58.333497 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdd943f-648a-46c1-9f6a-99d9f7e3c74b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:58.334105 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdd943f-648a-46c1-9f6a-99d9f7e3c74b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:58.334412 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdd943f-648a-46c1-9f6a-99d9f7e3c74b admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:58.334692 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdd943f-648a-46c1-9f6a-99d9f7e3c74b admin admin] PATH_INFO: `/v3/projects/5d8e878c0d5c4f918c51291598a6ebf8` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:58.335796 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdd943f-648a-46c1-9f6a-99d9f7e3c74b admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d8e878c0d5c4f918c51291598a6ebf8)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:58.337676 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdd943f-648a-46c1-9f6a-99d9f7e3c74b admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:58.347770 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1017/2061] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:32:58 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:32:58.348831 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e9a3b9-e2ef-4cb6-94ae-8b9d92d56ac3 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:58.350333 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-e1e9a3b9-e2ef-4cb6-94ae-8b9d92d56ac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:58.387077 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-ffdd943f-648a-46c1-9f6a-99d9f7e3c74b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d8e878c0d5c4f918c51291598a6ebf8', 'request_id': 'req-ffdd943f-648a-46c1-9f6a-99d9f7e3c74b'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:58.393885 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-ffdd943f-648a-46c1-9f6a-99d9f7e3c74b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d8e878c0d5c4f918c51291598a6ebf8', 'request_id': 'req-ffdd943f-648a-46c1-9f6a-99d9f7e3c74b'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:58.402626 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-ffdd943f-648a-46c1-9f6a-99d9f7e3c74b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d8e878c0d5c4f918c51291598a6ebf8', 'request_id': 'req-ffdd943f-648a-46c1-9f6a-99d9f7e3c74b'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:58.409728 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e9a3b9-e2ef-4cb6-94ae-8b9d92d56ac3 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:58.414387 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-ffdd943f-648a-46c1-9f6a-99d9f7e3c74b admin admin] The token cache is being invalidate because project 5d8e878c0d5c4f918c51291598a6ebf8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81446) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 16:32:58.414628 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-ffdd943f-648a-46c1-9f6a-99d9f7e3c74b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:58.415279 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-ffdd943f-648a-46c1-9f6a-99d9f7e3c74b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:58.416764 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1045/2062] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 16:32:58 2022] DELETE /identity/v3/projects/5d8e878c0d5c4f918c51291598a6ebf8 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:32:58.417926 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36afd185-783c-4779-9ae8-e09b812c7b48 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:58.418202 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36afd185-783c-4779-9ae8-e09b812c7b48 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:58.418494 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36afd185-783c-4779-9ae8-e09b812c7b48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:58.446480 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-36afd185-783c-4779-9ae8-e09b812c7b48 None None] MFA Rules not processed for user `9c2bf83d03614fb28262e1a49412da67`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:32:58.447687 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-36afd185-783c-4779-9ae8-e09b812c7b48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:58.463084 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7715f720-215d-44dc-8fa9-d0d2368b62fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f44bfdd5214e8d84a2c0a5b1fd9b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:58.463697 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7715f720-215d-44dc-8fa9-d0d2368b62fe service neutron] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:58.463973 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7715f720-215d-44dc-8fa9-d0d2368b62fe service neutron] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:58.464580 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7715f720-215d-44dc-8fa9-d0d2368b62fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:58.466784 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-7715f720-215d-44dc-8fa9-d0d2368b62fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:58.513007 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1046/2063] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:32:58 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:32:58.513745 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36afd185-783c-4779-9ae8-e09b812c7b48 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:58.517332 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-36afd185-783c-4779-9ae8-e09b812c7b48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:58.519317 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:32:58.524707 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:32:58.532951 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7715f720-215d-44dc-8fa9-d0d2368b62fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:58.534577 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7715f720-215d-44dc-8fa9-d0d2368b62fe service neutron] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:58.544180 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1018/2064] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:32:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:32:58.551258 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7715f720-215d-44dc-8fa9-d0d2368b62fe service neutron] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:58.552593 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-7715f720-215d-44dc-8fa9-d0d2368b62fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:58.594998 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36afd185-783c-4779-9ae8-e09b812c7b48 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:58.600672 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeb587e-911f-4469-a0ea-255db9816db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:58.602037 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeb587e-911f-4469-a0ea-255db9816db0 admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:58.602390 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeb587e-911f-4469-a0ea-255db9816db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:58.602630 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeb587e-911f-4469-a0ea-255db9816db0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:58.603345 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbeb587e-911f-4469-a0ea-255db9816db0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:58.605316 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbeb587e-911f-4469-a0ea-255db9816db0 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:58.617146 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7715f720-215d-44dc-8fa9-d0d2368b62fe service neutron] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:58.623195 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75d0882-a557-41fd-b9a5-e45b96198f94 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8078e791ba68460f8b3aeafb4b79b73a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:58.624106 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75d0882-a557-41fd-b9a5-e45b96198f94 service cinder] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:58.624233 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75d0882-a557-41fd-b9a5-e45b96198f94 service cinder] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:58.624528 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75d0882-a557-41fd-b9a5-e45b96198f94 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:58.626845 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-c75d0882-a557-41fd-b9a5-e45b96198f94 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:58.637814 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1047/2065] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 16:32:58 2022] POST /identity/v3/projects => generated 371 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:32:58.639328 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f94a18-80bc-4d96-8f00-b1b2344be629 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:58.639616 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f94a18-80bc-4d96-8f00-b1b2344be629 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:58.639892 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f94a18-80bc-4d96-8f00-b1b2344be629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:58.662794 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-d1f94a18-80bc-4d96-8f00-b1b2344be629 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:32:58.664025 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-d1f94a18-80bc-4d96-8f00-b1b2344be629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:58.704613 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75d0882-a557-41fd-b9a5-e45b96198f94 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:58.706171 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75d0882-a557-41fd-b9a5-e45b96198f94 service cinder] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:58.720031 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1019/2066] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:32:58 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:32:58.720862 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75d0882-a557-41fd-b9a5-e45b96198f94 service cinder] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:58.722470 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-c75d0882-a557-41fd-b9a5-e45b96198f94 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:58.737025 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75d0882-a557-41fd-b9a5-e45b96198f94 service cinder] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:58.737518 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1048/2067] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:32:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:32:58.738582 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f94a18-80bc-4d96-8f00-b1b2344be629 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:58.749379 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f94a18-80bc-4d96-8f00-b1b2344be629 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:58.753264 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bff3d2-5174-4644-840e-83528672ed64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:58.754005 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bff3d2-5174-4644-840e-83528672ed64 admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:58.755460 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12ede3d-92ea-41bf-ab05-27f60ba09e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:58.756154 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12ede3d-92ea-41bf-ab05-27f60ba09e29 admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:58.756565 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12ede3d-92ea-41bf-ab05-27f60ba09e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:58.756690 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bff3d2-5174-4644-840e-83528672ed64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:58.756781 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bff3d2-5174-4644-840e-83528672ed64 admin admin] PATH_INFO: `/v3/projects` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:58.756855 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12ede3d-92ea-41bf-ab05-27f60ba09e29 admin admin] PATH_INFO: `/v3/users` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:58.757573 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12ede3d-92ea-41bf-ab05-27f60ba09e29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:58.758373 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bff3d2-5174-4644-840e-83528672ed64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:58.759606 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12ede3d-92ea-41bf-ab05-27f60ba09e29 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:58.764158 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bff3d2-5174-4644-840e-83528672ed64 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:58.796615 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1049/2068] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 16:32:58 2022] POST /identity/v3/users => generated 286 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:32:58.798408 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e145fd7-dcb5-4ff6-9fb7-72372c25dd40 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:58.798683 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e145fd7-dcb5-4ff6-9fb7-72372c25dd40 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:58.798959 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e145fd7-dcb5-4ff6-9fb7-72372c25dd40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:58.806509 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1020/2069] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 16:32:58 2022] POST /identity/v3/projects => generated 365 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:32:58.808008 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bff3d2-5174-4644-840e-83528672ed64 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:58.830252 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-6e145fd7-dcb5-4ff6-9fb7-72372c25dd40 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:32:58.831752 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-6e145fd7-dcb5-4ff6-9fb7-72372c25dd40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:58.896470 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bff3d2-5174-4644-840e-83528672ed64 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:58.901483 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1da251-2b78-4997-90d7-82703164845b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:58.902094 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1da251-2b78-4997-90d7-82703164845b admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:58.902399 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1da251-2b78-4997-90d7-82703164845b admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:58.902674 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1da251-2b78-4997-90d7-82703164845b admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:58.903307 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1da251-2b78-4997-90d7-82703164845b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:58.905254 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1050/2070] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:32:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:32:58.905858 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e145fd7-dcb5-4ff6-9fb7-72372c25dd40 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:58.908301 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1da251-2b78-4997-90d7-82703164845b admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:58.917189 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e145fd7-dcb5-4ff6-9fb7-72372c25dd40 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:58.919934 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1021/2071] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:32:58 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:32:58.920732 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1da251-2b78-4997-90d7-82703164845b admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:58.924545 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdf8e74-8f8c-40b1-b87b-77fd1eb3d2d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:58.925227 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdf8e74-8f8c-40b1-b87b-77fd1eb3d2d8 admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:58.925417 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdf8e74-8f8c-40b1-b87b-77fd1eb3d2d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:58.925667 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdf8e74-8f8c-40b1-b87b-77fd1eb3d2d8 admin admin] PATH_INFO: `/v3/users` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:58.926353 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdf8e74-8f8c-40b1-b87b-77fd1eb3d2d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:58.928247 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdf8e74-8f8c-40b1-b87b-77fd1eb3d2d8 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:58.939996 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:32:58.941313 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:32:58.957298 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1051/2072] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 16:32:58 2022] POST /identity/v3/users => generated 289 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:32:58.957298 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdf8e74-8f8c-40b1-b87b-77fd1eb3d2d8 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:58.958639 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-7cdf8e74-8f8c-40b1-b87b-77fd1eb3d2d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:58.970761 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdf8e74-8f8c-40b1-b87b-77fd1eb3d2d8 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:58.975492 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c18c53-b99c-474e-b4e9-8f717fe4cd36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:58.976100 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c18c53-b99c-474e-b4e9-8f717fe4cd36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:58.976410 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c18c53-b99c-474e-b4e9-8f717fe4cd36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:58.976686 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c18c53-b99c-474e-b4e9-8f717fe4cd36 admin admin] PATH_INFO: `/v3/projects/7b74fca3d412400ca5865c7be7bd5e04` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:58.977854 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c18c53-b99c-474e-b4e9-8f717fe4cd36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b74fca3d412400ca5865c7be7bd5e04)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:58.979816 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c18c53-b99c-474e-b4e9-8f717fe4cd36 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:58.980384 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1da251-2b78-4997-90d7-82703164845b admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:58.984552 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d016d13-0fd2-45c0-a316-4b27818b6ad4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8078e791ba68460f8b3aeafb4b79b73a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:58.985151 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d016d13-0fd2-45c0-a316-4b27818b6ad4 service cinder] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:58.985424 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d016d13-0fd2-45c0-a316-4b27818b6ad4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:58.985690 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d016d13-0fd2-45c0-a316-4b27818b6ad4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:58.987459 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-3d016d13-0fd2-45c0-a316-4b27818b6ad4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:59.029053 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-19c18c53-b99c-474e-b4e9-8f717fe4cd36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b74fca3d412400ca5865c7be7bd5e04', 'request_id': 'req-19c18c53-b99c-474e-b4e9-8f717fe4cd36'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:59.035535 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-19c18c53-b99c-474e-b4e9-8f717fe4cd36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b74fca3d412400ca5865c7be7bd5e04', 'request_id': 'req-19c18c53-b99c-474e-b4e9-8f717fe4cd36'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:59.043111 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-19c18c53-b99c-474e-b4e9-8f717fe4cd36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b74fca3d412400ca5865c7be7bd5e04', 'request_id': 'req-19c18c53-b99c-474e-b4e9-8f717fe4cd36'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:59.049253 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d016d13-0fd2-45c0-a316-4b27818b6ad4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:59.050726 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d016d13-0fd2-45c0-a316-4b27818b6ad4 service cinder] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:59.057096 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-19c18c53-b99c-474e-b4e9-8f717fe4cd36 admin admin] The token cache is being invalidate because project 7b74fca3d412400ca5865c7be7bd5e04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81446) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 16:32:59.057387 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-19c18c53-b99c-474e-b4e9-8f717fe4cd36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:59.058055 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-19c18c53-b99c-474e-b4e9-8f717fe4cd36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:59.059747 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1022/2073] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:32:58 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:32:59.062702 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d016d13-0fd2-45c0-a316-4b27818b6ad4 service cinder] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:59.063119 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1052/2074] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 16:32:58 2022] DELETE /identity/v3/projects/7b74fca3d412400ca5865c7be7bd5e04 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:32:59.063896 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c18c53-b99c-474e-b4e9-8f717fe4cd36 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:59.065251 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-19c18c53-b99c-474e-b4e9-8f717fe4cd36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:59.073532 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d016d13-0fd2-45c0-a316-4b27818b6ad4 service cinder] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:59.136742 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2768dd-0749-4304-8ff4-9475ffd7bcf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:59.137343 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2768dd-0749-4304-8ff4-9475ffd7bcf0 admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:59.137618 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2768dd-0749-4304-8ff4-9475ffd7bcf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:59.137938 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2768dd-0749-4304-8ff4-9475ffd7bcf0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:59.138246 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c18c53-b99c-474e-b4e9-8f717fe4cd36 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:59.138570 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2768dd-0749-4304-8ff4-9475ffd7bcf0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:32:59.138872 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2768dd-0749-4304-8ff4-9475ffd7bcf0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:59.140586 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2768dd-0749-4304-8ff4-9475ffd7bcf0 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:59.143316 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ac6bbd-16f4-44ae-a012-efbd916c8b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:59.143926 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ac6bbd-16f4-44ae-a012-efbd916c8b85 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:59.144209 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ac6bbd-16f4-44ae-a012-efbd916c8b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:59.144481 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ac6bbd-16f4-44ae-a012-efbd916c8b85 admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:59.145537 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ac6bbd-16f4-44ae-a012-efbd916c8b85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:59.146800 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ac6bbd-16f4-44ae-a012-efbd916c8b85 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:59.153425 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1023/2075] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Sep 9 16:32:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:32:59.154503 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2768dd-0749-4304-8ff4-9475ffd7bcf0 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:59.156486 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-9a2768dd-0749-4304-8ff4-9475ffd7bcf0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:59.161936 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1053/2076] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:32:59 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:32:59.161936 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ac6bbd-16f4-44ae-a012-efbd916c8b85 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:59.163630 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-46ac6bbd-16f4-44ae-a012-efbd916c8b85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:59.170127 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2768dd-0749-4304-8ff4-9475ffd7bcf0 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:59.174841 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f29e217-2117-424f-960a-816be35257ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:59.175430 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f29e217-2117-424f-960a-816be35257ab admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:59.175702 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f29e217-2117-424f-960a-816be35257ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:59.175966 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f29e217-2117-424f-960a-816be35257ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:59.176586 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f29e217-2117-424f-960a-816be35257ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:59.178173 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f29e217-2117-424f-960a-816be35257ab admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:59.182832 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ac6bbd-16f4-44ae-a012-efbd916c8b85 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:59.187604 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0b390a-cf06-4454-b87a-0f65313b8396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:59.188226 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0b390a-cf06-4454-b87a-0f65313b8396 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:59.188504 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0b390a-cf06-4454-b87a-0f65313b8396 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:59.188776 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0b390a-cf06-4454-b87a-0f65313b8396 admin admin] PATH_INFO: `/v3/users/5ee59ae4e96541bb964841051ab33629` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:59.189422 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1024/2077] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:32:59 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:32:59.193027 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0b390a-cf06-4454-b87a-0f65313b8396 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ee59ae4e96541bb964841051ab33629)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:59.193107 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f29e217-2117-424f-960a-816be35257ab admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:59.193178 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0b390a-cf06-4454-b87a-0f65313b8396 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:59.195671 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-3f29e217-2117-424f-960a-816be35257ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:59.209756 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f29e217-2117-424f-960a-816be35257ab admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:59.215202 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8394b41a-eaeb-45ac-86f2-02fc23028a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:59.215829 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8394b41a-eaeb-45ac-86f2-02fc23028a42 admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:59.216221 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8394b41a-eaeb-45ac-86f2-02fc23028a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:59.216571 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8394b41a-eaeb-45ac-86f2-02fc23028a42 admin admin] PATH_INFO: `/v3/projects` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:59.217324 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8394b41a-eaeb-45ac-86f2-02fc23028a42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:59.219437 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8394b41a-eaeb-45ac-86f2-02fc23028a42 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:59.251510 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1025/2078] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 16:32:59 2022] POST /identity/v3/projects => generated 387 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:32:59.252730 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8394b41a-eaeb-45ac-86f2-02fc23028a42 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:59.252858 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-3b0b390a-cf06-4454-b87a-0f65313b8396 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ee59ae4e96541bb964841051ab33629'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:59.261703 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-3b0b390a-cf06-4454-b87a-0f65313b8396 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ee59ae4e96541bb964841051ab33629'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:59.277391 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:32:59.280204 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-3b0b390a-cf06-4454-b87a-0f65313b8396 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ee59ae4e96541bb964841051ab33629'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:59.296818 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-3b0b390a-cf06-4454-b87a-0f65313b8396 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ee59ae4e96541bb964841051ab33629'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:59.297076 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:32:59.297768 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-3b0b390a-cf06-4454-b87a-0f65313b8396 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ee59ae4e96541bb964841051ab33629'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:32:59.315348 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1054/2079] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 16:32:59 2022] DELETE /identity/v3/users/5ee59ae4e96541bb964841051ab33629 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:32:59.317198 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0b390a-cf06-4454-b87a-0f65313b8396 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:59.333134 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-3b0b390a-cf06-4454-b87a-0f65313b8396 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:59.335451 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8394b41a-eaeb-45ac-86f2-02fc23028a42 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:59.407168 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8bd867-06ab-4644-9995-c3aa1219f8a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:59.408156 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8bd867-06ab-4644-9995-c3aa1219f8a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:59.408452 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8bd867-06ab-4644-9995-c3aa1219f8a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:59.408837 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8bd867-06ab-4644-9995-c3aa1219f8a0 admin admin] PATH_INFO: `/v3/projects/da1c7d8ca03740e49d0e2a8a69879006/users/cc4f2b194cff4cffad7d4e474e4752f4/roles/b38e84bf077846ee802e6bb1bad83522` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:59.430433 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8bd867-06ab-4644-9995-c3aa1219f8a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da1c7d8ca03740e49d0e2a8a69879006, user_id=cc4f2b194cff4cffad7d4e474e4752f4, role_id=b38e84bf077846ee802e6bb1bad83522)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:59.435762 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8bd867-06ab-4644-9995-c3aa1219f8a0 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:59.457754 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1026/2080] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 16:32:59 2022] PUT /identity/v3/projects/da1c7d8ca03740e49d0e2a8a69879006/users/cc4f2b194cff4cffad7d4e474e4752f4/roles/b38e84bf077846ee802e6bb1bad83522 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:32:59.458832 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8bd867-06ab-4644-9995-c3aa1219f8a0 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:59.469778 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-af8bd867-06ab-4644-9995-c3aa1219f8a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:59.482660 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0b390a-cf06-4454-b87a-0f65313b8396 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:59.550695 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8bd867-06ab-4644-9995-c3aa1219f8a0 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:59.558064 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5027fbf9-37a6-447b-bddf-13cbf470c411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:59.558709 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5027fbf9-37a6-447b-bddf-13cbf470c411 admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:59.558985 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5027fbf9-37a6-447b-bddf-13cbf470c411 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:59.559103 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dc13a3-e0f7-4e5e-b6cf-e6097fd241c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:59.559302 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5027fbf9-37a6-447b-bddf-13cbf470c411 admin admin] PATH_INFO: `/v3/users` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:59.559659 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dc13a3-e0f7-4e5e-b6cf-e6097fd241c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:59.560390 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5027fbf9-37a6-447b-bddf-13cbf470c411 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:59.560499 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dc13a3-e0f7-4e5e-b6cf-e6097fd241c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:59.560733 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dc13a3-e0f7-4e5e-b6cf-e6097fd241c9 admin admin] PATH_INFO: `/v3/projects/252e09743b8344fc93bad1e14878b271/users/36d9f8cab81c43cc8a176db2e78dda36/roles/0a36d1be416f4089be19be979943b731` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:59.562337 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5027fbf9-37a6-447b-bddf-13cbf470c411 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:59.580608 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dc13a3-e0f7-4e5e-b6cf-e6097fd241c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=252e09743b8344fc93bad1e14878b271, user_id=36d9f8cab81c43cc8a176db2e78dda36, role_id=0a36d1be416f4089be19be979943b731)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:59.583316 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dc13a3-e0f7-4e5e-b6cf-e6097fd241c9 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:59.588025 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1027/2081] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 16:32:59 2022] POST /identity/v3/users => generated 294 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:32:59.589794 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42736a46-42e5-4d7c-8b14-bc11327273dc None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:59.590115 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42736a46-42e5-4d7c-8b14-bc11327273dc None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:59.590736 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42736a46-42e5-4d7c-8b14-bc11327273dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:59.603486 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1055/2082] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 16:32:59 2022] PUT /identity/v3/projects/252e09743b8344fc93bad1e14878b271/users/36d9f8cab81c43cc8a176db2e78dda36/roles/0a36d1be416f4089be19be979943b731 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:32:59.604309 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dc13a3-e0f7-4e5e-b6cf-e6097fd241c9 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:59.629914 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-42736a46-42e5-4d7c-8b14-bc11327273dc None None] MFA Rules not processed for user `cc4f2b194cff4cffad7d4e474e4752f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:32:59.631356 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-42736a46-42e5-4d7c-8b14-bc11327273dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:59.687768 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dc13a3-e0f7-4e5e-b6cf-e6097fd241c9 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:59.694129 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4593fd-2a46-4e71-92ea-bec919b0e187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:59.694865 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4593fd-2a46-4e71-92ea-bec919b0e187 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:59.695301 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4593fd-2a46-4e71-92ea-bec919b0e187 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:59.695849 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:32:59.695981 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4593fd-2a46-4e71-92ea-bec919b0e187 admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:59.696586 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4593fd-2a46-4e71-92ea-bec919b0e187 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:59.698820 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4593fd-2a46-4e71-92ea-bec919b0e187 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:59.715052 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1056/2083] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:32:59 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:32:59.715975 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4593fd-2a46-4e71-92ea-bec919b0e187 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:59.726739 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1028/2084] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:32:59 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:32:59.726930 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4593fd-2a46-4e71-92ea-bec919b0e187 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:59.732283 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42736a46-42e5-4d7c-8b14-bc11327273dc None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:59.733602 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad51980-f0b2-462a-9a0f-df087743296f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:59.734352 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad51980-f0b2-462a-9a0f-df087743296f admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:59.734710 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad51980-f0b2-462a-9a0f-df087743296f admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:59.735039 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad51980-f0b2-462a-9a0f-df087743296f admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:59.735966 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad51980-f0b2-462a-9a0f-df087743296f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:59.737553 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad51980-f0b2-462a-9a0f-df087743296f admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:59.745318 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42736a46-42e5-4d7c-8b14-bc11327273dc None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:59.749267 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1057/2085] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:32:59 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:32:59.749893 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad51980-f0b2-462a-9a0f-df087743296f admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:59.751889 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-2ad51980-f0b2-462a-9a0f-df087743296f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:59.753619 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4c9df3-381d-426f-b047-780475fc7816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:59.754264 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4c9df3-381d-426f-b047-780475fc7816 admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:59.754569 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4c9df3-381d-426f-b047-780475fc7816 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:59.754839 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4c9df3-381d-426f-b047-780475fc7816 admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:59.755473 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4c9df3-381d-426f-b047-780475fc7816 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:59.757109 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4c9df3-381d-426f-b047-780475fc7816 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:59.757579 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:DELETE=2,keystone:SELECT=96,keystone:INSERT=2 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:32:59.773320 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1029/2086] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:32:59 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:32:59.773320 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4c9df3-381d-426f-b047-780475fc7816 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:59.784001 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4c9df3-381d-426f-b047-780475fc7816 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:59.789784 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ba91c5-07eb-4bcf-88b4-1f91717a0a73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:59.790761 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ba91c5-07eb-4bcf-88b4-1f91717a0a73 admin admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:59.790963 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ba91c5-07eb-4bcf-88b4-1f91717a0a73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:59.791359 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ba91c5-07eb-4bcf-88b4-1f91717a0a73 admin admin] PATH_INFO: `/v3/projects/252e09743b8344fc93bad1e14878b271/users/36d9f8cab81c43cc8a176db2e78dda36/roles/0a36d1be416f4089be19be979943b731` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:59.793894 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ba91c5-07eb-4bcf-88b4-1f91717a0a73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=252e09743b8344fc93bad1e14878b271, user_id=36d9f8cab81c43cc8a176db2e78dda36, role_id=0a36d1be416f4089be19be979943b731)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:59.797192 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ba91c5-07eb-4bcf-88b4-1f91717a0a73 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:59.809432 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1030/2087] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 16:32:59 2022] PUT /identity/v3/projects/252e09743b8344fc93bad1e14878b271/users/36d9f8cab81c43cc8a176db2e78dda36/roles/0a36d1be416f4089be19be979943b731 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:32:59.819394 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ba91c5-07eb-4bcf-88b4-1f91717a0a73 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:59.834124 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad51980-f0b2-462a-9a0f-df087743296f admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:59.882695 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ba91c5-07eb-4bcf-88b4-1f91717a0a73 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:32:59.884350 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa240f9e-3854-4504-af51-051e2eb94a00 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8078e791ba68460f8b3aeafb4b79b73a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:59.884986 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa240f9e-3854-4504-af51-051e2eb94a00 service cinder] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:59.885264 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa240f9e-3854-4504-af51-051e2eb94a00 service cinder] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:59.885535 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa240f9e-3854-4504-af51-051e2eb94a00 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:59.889472 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c896fb-372d-4c51-b323-9663c39e5fbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:32:59.890128 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c896fb-372d-4c51-b323-9663c39e5fbc admin admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:59.890444 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c896fb-372d-4c51-b323-9663c39e5fbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:59.890742 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c896fb-372d-4c51-b323-9663c39e5fbc admin admin] PATH_INFO: `/v3/projects/a299406e76b64a1fa2f28c84c574e152/users/59993d76e1e2405d896c9f8fcacb6087/roles/b38e84bf077846ee802e6bb1bad83522` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:59.905917 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c896fb-372d-4c51-b323-9663c39e5fbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=a299406e76b64a1fa2f28c84c574e152, user_id=59993d76e1e2405d896c9f8fcacb6087, role_id=b38e84bf077846ee802e6bb1bad83522)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:59.908587 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c896fb-372d-4c51-b323-9663c39e5fbc admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:59.923637 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1031/2088] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 16:32:59 2022] PUT /identity/v3/projects/a299406e76b64a1fa2f28c84c574e152/users/59993d76e1e2405d896c9f8fcacb6087/roles/b38e84bf077846ee802e6bb1bad83522 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:32:59.924524 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c896fb-372d-4c51-b323-9663c39e5fbc admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:32:59.926213 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-a7c896fb-372d-4c51-b323-9663c39e5fbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:32:59.946028 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa240f9e-3854-4504-af51-051e2eb94a00 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:32:59.947530 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa240f9e-3854-4504-af51-051e2eb94a00 service cinder] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:32:59.956349 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1058/2089] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:32:59 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:32:59.957620 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43b4f13-0ee2-46f3-92cb-1d2d04c4f4be None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:32:59.957910 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43b4f13-0ee2-46f3-92cb-1d2d04c4f4be None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:32:59.958287 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43b4f13-0ee2-46f3-92cb-1d2d04c4f4be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:32:59.990276 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-b43b4f13-0ee2-46f3-92cb-1d2d04c4f4be None None] MFA Rules not processed for user `36d9f8cab81c43cc8a176db2e78dda36`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:32:59.991502 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-b43b4f13-0ee2-46f3-92cb-1d2d04c4f4be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:00.001100 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c896fb-372d-4c51-b323-9663c39e5fbc admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:00.005733 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ba87b7-4d08-4337-959b-b461a1f88d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:00.006385 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ba87b7-4d08-4337-959b-b461a1f88d38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:00.006665 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ba87b7-4d08-4337-959b-b461a1f88d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:00.006934 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ba87b7-4d08-4337-959b-b461a1f88d38 admin admin] PATH_INFO: `/v3/projects/cb911304574d4bccbe6b543ff994833a` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:00.008036 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ba87b7-4d08-4337-959b-b461a1f88d38 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb911304574d4bccbe6b543ff994833a)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:00.010560 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ba87b7-4d08-4337-959b-b461a1f88d38 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:00.053340 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:33:00.057189 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:33:00.062527 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1059/2090] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:32:59 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:33:00.063582 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198b0548-a589-4ea8-8034-147d579b73fc None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:00.064011 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198b0548-a589-4ea8-8034-147d579b73fc None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:00.064284 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198b0548-a589-4ea8-8034-147d579b73fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:00.066745 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-c5ba87b7-4d08-4337-959b-b461a1f88d38 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb911304574d4bccbe6b543ff994833a', 'request_id': 'req-c5ba87b7-4d08-4337-959b-b461a1f88d38'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:00.074246 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-c5ba87b7-4d08-4337-959b-b461a1f88d38 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb911304574d4bccbe6b543ff994833a', 'request_id': 'req-c5ba87b7-4d08-4337-959b-b461a1f88d38'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:00.082167 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-c5ba87b7-4d08-4337-959b-b461a1f88d38 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb911304574d4bccbe6b543ff994833a', 'request_id': 'req-c5ba87b7-4d08-4337-959b-b461a1f88d38'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:00.093121 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-198b0548-a589-4ea8-8034-147d579b73fc None None] MFA Rules not processed for user `59993d76e1e2405d896c9f8fcacb6087`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:33:00.093405 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-c5ba87b7-4d08-4337-959b-b461a1f88d38 admin admin] The token cache is being invalidate because project cb911304574d4bccbe6b543ff994833a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81445) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 16:33:00.093690 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-c5ba87b7-4d08-4337-959b-b461a1f88d38 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:00.094346 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-c5ba87b7-4d08-4337-959b-b461a1f88d38 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:00.094453 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-198b0548-a589-4ea8-8034-147d579b73fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:00.095895 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1032/2091] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 16:32:59 2022] DELETE /identity/v3/projects/cb911304574d4bccbe6b543ff994833a => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:33:00.096652 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ba87b7-4d08-4337-959b-b461a1f88d38 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:00.097899 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-c5ba87b7-4d08-4337-959b-b461a1f88d38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:00.162772 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1060/2092] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:33:00 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:33:00.163998 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198b0548-a589-4ea8-8034-147d579b73fc None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:00.165283 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-198b0548-a589-4ea8-8034-147d579b73fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:00.168657 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ba87b7-4d08-4337-959b-b461a1f88d38 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:00.173775 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b07c089-ebca-4e80-8b5f-e2558b8f6e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:00.174447 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b07c089-ebca-4e80-8b5f-e2558b8f6e5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:00.174720 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b07c089-ebca-4e80-8b5f-e2558b8f6e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:00.174982 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b07c089-ebca-4e80-8b5f-e2558b8f6e5f admin admin] PATH_INFO: `/v3/users/cc4f2b194cff4cffad7d4e474e4752f4` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:00.176096 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b07c089-ebca-4e80-8b5f-e2558b8f6e5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc4f2b194cff4cffad7d4e474e4752f4)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:00.177999 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b07c089-ebca-4e80-8b5f-e2558b8f6e5f admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:00.223990 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-6b07c089-ebca-4e80-8b5f-e2558b8f6e5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc4f2b194cff4cffad7d4e474e4752f4'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:00.224854 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198b0548-a589-4ea8-8034-147d579b73fc None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:00.228693 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7727ee3-d41e-4d4a-a377-54c80aeb41be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8078e791ba68460f8b3aeafb4b79b73a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:00.229314 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7727ee3-d41e-4d4a-a377-54c80aeb41be service cinder] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:00.229585 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7727ee3-d41e-4d4a-a377-54c80aeb41be service cinder] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:00.229851 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7727ee3-d41e-4d4a-a377-54c80aeb41be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:00.231344 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-6b07c089-ebca-4e80-8b5f-e2558b8f6e5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc4f2b194cff4cffad7d4e474e4752f4'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:00.231808 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-e7727ee3-d41e-4d4a-a377-54c80aeb41be service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:00.232162 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-6b07c089-ebca-4e80-8b5f-e2558b8f6e5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc4f2b194cff4cffad7d4e474e4752f4'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:00.240559 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-6b07c089-ebca-4e80-8b5f-e2558b8f6e5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc4f2b194cff4cffad7d4e474e4752f4'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:00.252698 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-6b07c089-ebca-4e80-8b5f-e2558b8f6e5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc4f2b194cff4cffad7d4e474e4752f4'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:00.258595 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1033/2093] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 16:33:00 2022] DELETE /identity/v3/users/cc4f2b194cff4cffad7d4e474e4752f4 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:33:00.259358 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b07c089-ebca-4e80-8b5f-e2558b8f6e5f admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:00.260702 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-6b07c089-ebca-4e80-8b5f-e2558b8f6e5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:00.304387 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7727ee3-d41e-4d4a-a377-54c80aeb41be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:00.305842 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7727ee3-d41e-4d4a-a377-54c80aeb41be service cinder] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:00.316235 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1061/2094] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:33:00 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:33:00.316389 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:33:00.316930 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7727ee3-d41e-4d4a-a377-54c80aeb41be service cinder] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:00.318477 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-e7727ee3-d41e-4d4a-a377-54c80aeb41be service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:00.332176 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7727ee3-d41e-4d4a-a377-54c80aeb41be service cinder] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:00.337391 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b07c089-ebca-4e80-8b5f-e2558b8f6e5f admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:00.338248 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833227a2-6116-40db-aefd-18786c96a0c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:00.338883 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833227a2-6116-40db-aefd-18786c96a0c5 admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:00.339288 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833227a2-6116-40db-aefd-18786c96a0c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:00.339566 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833227a2-6116-40db-aefd-18786c96a0c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:00.340628 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833227a2-6116-40db-aefd-18786c96a0c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:00.344057 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833227a2-6116-40db-aefd-18786c96a0c5 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:00.344795 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238205e4-db51-47a9-ad63-128e85594aa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:00.345497 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238205e4-db51-47a9-ad63-128e85594aa8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:00.345859 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238205e4-db51-47a9-ad63-128e85594aa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:00.346146 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238205e4-db51-47a9-ad63-128e85594aa8 admin admin] PATH_INFO: `/v3/users/1c4659aa73d44893bf1bbce6473d7e99` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:00.347514 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238205e4-db51-47a9-ad63-128e85594aa8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c4659aa73d44893bf1bbce6473d7e99)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:00.349482 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238205e4-db51-47a9-ad63-128e85594aa8 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:00.379313 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1062/2095] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 16:33:00 2022] POST /identity/v3/projects => generated 387 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:33:00.380528 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48924d81-ad25-43df-9a9a-757584efb105 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:00.380811 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48924d81-ad25-43df-9a9a-757584efb105 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:00.381077 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48924d81-ad25-43df-9a9a-757584efb105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:00.402163 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-48924d81-ad25-43df-9a9a-757584efb105 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:33:00.403414 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-48924d81-ad25-43df-9a9a-757584efb105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:00.404533 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-238205e4-db51-47a9-ad63-128e85594aa8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c4659aa73d44893bf1bbce6473d7e99'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:00.412124 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-238205e4-db51-47a9-ad63-128e85594aa8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c4659aa73d44893bf1bbce6473d7e99'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:00.412825 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-238205e4-db51-47a9-ad63-128e85594aa8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c4659aa73d44893bf1bbce6473d7e99'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:00.420960 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-238205e4-db51-47a9-ad63-128e85594aa8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c4659aa73d44893bf1bbce6473d7e99'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:00.424172 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:33:00.435124 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-238205e4-db51-47a9-ad63-128e85594aa8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c4659aa73d44893bf1bbce6473d7e99'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:00.441478 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1034/2096] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 16:33:00 2022] DELETE /identity/v3/users/1c4659aa73d44893bf1bbce6473d7e99 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:33:00.442245 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238205e4-db51-47a9-ad63-128e85594aa8 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:00.443750 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-238205e4-db51-47a9-ad63-128e85594aa8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:00.486688 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1063/2097] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:33:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:33:00.487483 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48924d81-ad25-43df-9a9a-757584efb105 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:00.489153 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-48924d81-ad25-43df-9a9a-757584efb105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:00.525087 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238205e4-db51-47a9-ad63-128e85594aa8 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:00.532454 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41cfee7-98ab-46fa-a60c-2961f76bbee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:00.542457 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41cfee7-98ab-46fa-a60c-2961f76bbee0 admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:00.542457 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41cfee7-98ab-46fa-a60c-2961f76bbee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:00.542457 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41cfee7-98ab-46fa-a60c-2961f76bbee0 admin admin] PATH_INFO: `/v3/users` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:00.542457 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41cfee7-98ab-46fa-a60c-2961f76bbee0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:00.542457 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41cfee7-98ab-46fa-a60c-2961f76bbee0 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:00.570165 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1035/2098] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 16:33:00 2022] POST /identity/v3/users => generated 300 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:33:00.571124 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41cfee7-98ab-46fa-a60c-2961f76bbee0 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:00.573455 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-e41cfee7-98ab-46fa-a60c-2961f76bbee0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:00.587907 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48924d81-ad25-43df-9a9a-757584efb105 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:00.668523 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41cfee7-98ab-46fa-a60c-2961f76bbee0 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:00.676157 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a79deb-0c6b-47d0-a628-667333995827 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f44bfdd5214e8d84a2c0a5b1fd9b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:00.676935 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a79deb-0c6b-47d0-a628-667333995827 service neutron] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:00.677316 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a79deb-0c6b-47d0-a628-667333995827 service neutron] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:00.677596 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a79deb-0c6b-47d0-a628-667333995827 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:00.689117 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a79deb-0c6b-47d0-a628-667333995827 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:00.690596 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a79deb-0c6b-47d0-a628-667333995827 service neutron] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:00.692968 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cec367-81aa-4632-b871-edef42b8b0dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8078e791ba68460f8b3aeafb4b79b73a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:00.693662 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cec367-81aa-4632-b871-edef42b8b0dc service cinder] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:00.694008 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cec367-81aa-4632-b871-edef42b8b0dc service cinder] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:00.695001 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cec367-81aa-4632-b871-edef42b8b0dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:00.696322 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:33:00.698802 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-c8cec367-81aa-4632-b871-edef42b8b0dc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:00.717540 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1036/2099] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:33:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:33:00.718361 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a79deb-0c6b-47d0-a628-667333995827 service neutron] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:00.731597 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a79deb-0c6b-47d0-a628-667333995827 service neutron] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:00.737396 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72f74c0-002c-42d5-b97f-e3547e2e5f0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:00.737548 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72f74c0-002c-42d5-b97f-e3547e2e5f0d admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:00.737780 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72f74c0-002c-42d5-b97f-e3547e2e5f0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:00.738247 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72f74c0-002c-42d5-b97f-e3547e2e5f0d admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:00.739055 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72f74c0-002c-42d5-b97f-e3547e2e5f0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:00.741273 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72f74c0-002c-42d5-b97f-e3547e2e5f0d admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:00.758061 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1037/2100] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:33:00 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:33:00.759102 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72f74c0-002c-42d5-b97f-e3547e2e5f0d admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:00.770739 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72f74c0-002c-42d5-b97f-e3547e2e5f0d admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:00.775919 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc39645-4293-4407-9e57-5df6538a93aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:00.776570 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc39645-4293-4407-9e57-5df6538a93aa admin admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:00.776847 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc39645-4293-4407-9e57-5df6538a93aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:00.777114 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc39645-4293-4407-9e57-5df6538a93aa admin admin] PATH_INFO: `/v3/projects/0d2a3494f9884708bea0480f0c1b0d4b/users/3aa06e577b854fe18227fd2ed444cecf/roles/0a36d1be416f4089be19be979943b731` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:00.795135 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc39645-4293-4407-9e57-5df6538a93aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d2a3494f9884708bea0480f0c1b0d4b, user_id=3aa06e577b854fe18227fd2ed444cecf, role_id=0a36d1be416f4089be19be979943b731)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:00.797819 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc39645-4293-4407-9e57-5df6538a93aa admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:00.816368 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cec367-81aa-4632-b871-edef42b8b0dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:00.818051 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cec367-81aa-4632-b871-edef42b8b0dc service cinder] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:00.825158 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1038/2101] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 16:33:00 2022] PUT /identity/v3/projects/0d2a3494f9884708bea0480f0c1b0d4b/users/3aa06e577b854fe18227fd2ed444cecf/roles/0a36d1be416f4089be19be979943b731 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:33:00.829797 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc39645-4293-4407-9e57-5df6538a93aa admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:00.831109 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1064/2102] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:33:00 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:33:00.831808 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-fcc39645-4293-4407-9e57-5df6538a93aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:00.832737 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cec367-81aa-4632-b871-edef42b8b0dc service cinder] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:00.861046 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cec367-81aa-4632-b871-edef42b8b0dc service cinder] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:00.894366 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:33:00.932569 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc39645-4293-4407-9e57-5df6538a93aa admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:00.939353 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf9e083-bc56-4ee4-97b4-e63e84bbef10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:00.940209 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf9e083-bc56-4ee4-97b4-e63e84bbef10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:00.940585 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf9e083-bc56-4ee4-97b4-e63e84bbef10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:00.941344 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf9e083-bc56-4ee4-97b4-e63e84bbef10 admin admin] PATH_INFO: `/v3/projects/92371ac304104116896ba28b2b7cdf3e` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:00.942856 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf9e083-bc56-4ee4-97b4-e63e84bbef10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=92371ac304104116896ba28b2b7cdf3e)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:00.943202 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb208710-f2ea-4147-840f-5e013677c35b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:00.943809 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb208710-f2ea-4147-840f-5e013677c35b admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:00.944086 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb208710-f2ea-4147-840f-5e013677c35b admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:00.944350 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb208710-f2ea-4147-840f-5e013677c35b admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:00.945086 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb208710-f2ea-4147-840f-5e013677c35b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:00.947571 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb208710-f2ea-4147-840f-5e013677c35b admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:00.947757 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf9e083-bc56-4ee4-97b4-e63e84bbef10 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:00.962861 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1065/2103] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:33:00 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:33:00.964748 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb208710-f2ea-4147-840f-5e013677c35b admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:00.991420 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb208710-f2ea-4147-840f-5e013677c35b admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:01.000787 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cf5b3b-94ed-4b00-bd1e-7ab3e1408e0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:01.001525 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cf5b3b-94ed-4b00-bd1e-7ab3e1408e0b admin admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:01.001742 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cf5b3b-94ed-4b00-bd1e-7ab3e1408e0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:01.002015 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cf5b3b-94ed-4b00-bd1e-7ab3e1408e0b admin admin] PATH_INFO: `/v3/projects/0d2a3494f9884708bea0480f0c1b0d4b/users/3aa06e577b854fe18227fd2ed444cecf/roles/0a36d1be416f4089be19be979943b731` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:01.005480 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cf5b3b-94ed-4b00-bd1e-7ab3e1408e0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d2a3494f9884708bea0480f0c1b0d4b, user_id=3aa06e577b854fe18227fd2ed444cecf, role_id=0a36d1be416f4089be19be979943b731)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:01.009442 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cf5b3b-94ed-4b00-bd1e-7ab3e1408e0b admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:01.023873 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-aaf9e083-bc56-4ee4-97b4-e63e84bbef10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92371ac304104116896ba28b2b7cdf3e', 'request_id': 'req-aaf9e083-bc56-4ee4-97b4-e63e84bbef10'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:01.025784 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1066/2104] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 16:33:00 2022] PUT /identity/v3/projects/0d2a3494f9884708bea0480f0c1b0d4b/users/3aa06e577b854fe18227fd2ed444cecf/roles/0a36d1be416f4089be19be979943b731 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:33:01.032779 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-aaf9e083-bc56-4ee4-97b4-e63e84bbef10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92371ac304104116896ba28b2b7cdf3e', 'request_id': 'req-aaf9e083-bc56-4ee4-97b4-e63e84bbef10'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:01.036639 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c26e612-cad8-47b4-a1c2-656ca92e128b None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:01.036983 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c26e612-cad8-47b4-a1c2-656ca92e128b None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:01.037517 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c26e612-cad8-47b4-a1c2-656ca92e128b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:01.046640 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-aaf9e083-bc56-4ee4-97b4-e63e84bbef10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92371ac304104116896ba28b2b7cdf3e', 'request_id': 'req-aaf9e083-bc56-4ee4-97b4-e63e84bbef10'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:01.065760 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-aaf9e083-bc56-4ee4-97b4-e63e84bbef10 admin admin] The token cache is being invalidate because project 92371ac304104116896ba28b2b7cdf3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81445) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 16:33:01.065760 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-aaf9e083-bc56-4ee4-97b4-e63e84bbef10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:01.067422 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-aaf9e083-bc56-4ee4-97b4-e63e84bbef10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:01.069532 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1039/2105] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 16:33:00 2022] DELETE /identity/v3/projects/92371ac304104116896ba28b2b7cdf3e => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:33:01.084350 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4c0020-8d88-4ea4-a048-b0780bebb868 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:01.084695 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4c0020-8d88-4ea4-a048-b0780bebb868 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:01.084973 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4c0020-8d88-4ea4-a048-b0780bebb868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:01.101398 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-3c26e612-cad8-47b4-a1c2-656ca92e128b None None] MFA Rules not processed for user `3aa06e577b854fe18227fd2ed444cecf`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:33:01.102924 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-3c26e612-cad8-47b4-a1c2-656ca92e128b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:01.112045 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-bf4c0020-8d88-4ea4-a048-b0780bebb868 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:33:01.113400 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-bf4c0020-8d88-4ea4-a048-b0780bebb868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:01.182426 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:33:01.211190 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1040/2106] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:33:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 16:33:01.213644 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0b25ed-3569-47fe-a5d8-17f8e550d1b9 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:01.214096 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0b25ed-3569-47fe-a5d8-17f8e550d1b9 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:01.214416 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0b25ed-3569-47fe-a5d8-17f8e550d1b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:01.233300 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1067/2107] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:33:01 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:33:01.242430 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c26e612-cad8-47b4-a1c2-656ca92e128b None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:01.244543 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-3c26e612-cad8-47b4-a1c2-656ca92e128b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:01.244662 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-4a0b25ed-3569-47fe-a5d8-17f8e550d1b9 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:33:01.246050 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-4a0b25ed-3569-47fe-a5d8-17f8e550d1b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:01.283479 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1041/2108] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:33:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:33:01.284799 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0b25ed-3569-47fe-a5d8-17f8e550d1b9 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:01.304826 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0b25ed-3569-47fe-a5d8-17f8e550d1b9 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:01.319173 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf0cf0e-ea56-4dc2-9283-cd3d9c82be25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:01.319809 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf0cf0e-ea56-4dc2-9283-cd3d9c82be25 admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:01.320085 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf0cf0e-ea56-4dc2-9283-cd3d9c82be25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:01.320437 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf0cf0e-ea56-4dc2-9283-cd3d9c82be25 admin admin] PATH_INFO: `/v3/domains` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:01.321156 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf0cf0e-ea56-4dc2-9283-cd3d9c82be25 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:33:01.321733 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf0cf0e-ea56-4dc2-9283-cd3d9c82be25 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:01.326994 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf0cf0e-ea56-4dc2-9283-cd3d9c82be25 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:01.349541 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c26e612-cad8-47b4-a1c2-656ca92e128b None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:01.360639 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1042/2109] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Sep 9 16:33:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:33:01.360639 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf0cf0e-ea56-4dc2-9283-cd3d9c82be25 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:01.361762 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-9bf0cf0e-ea56-4dc2-9283-cd3d9c82be25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:01.363526 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1a8382-e26c-4b73-8dfb-ea980a51912d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8078e791ba68460f8b3aeafb4b79b73a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:01.364157 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1a8382-e26c-4b73-8dfb-ea980a51912d service cinder] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:01.364435 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1a8382-e26c-4b73-8dfb-ea980a51912d service cinder] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:01.364708 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1a8382-e26c-4b73-8dfb-ea980a51912d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:01.377811 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf0cf0e-ea56-4dc2-9283-cd3d9c82be25 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:01.380238 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1a8382-e26c-4b73-8dfb-ea980a51912d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:01.382673 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1a8382-e26c-4b73-8dfb-ea980a51912d service cinder] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:01.382811 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eedcab-c49f-4be1-b756-e9b7d95a45a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:01.383425 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eedcab-c49f-4be1-b756-e9b7d95a45a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:01.383733 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eedcab-c49f-4be1-b756-e9b7d95a45a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:01.383999 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eedcab-c49f-4be1-b756-e9b7d95a45a5 admin admin] PATH_INFO: `/v3/projects/da1c7d8ca03740e49d0e2a8a69879006` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:01.385167 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65eedcab-c49f-4be1-b756-e9b7d95a45a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da1c7d8ca03740e49d0e2a8a69879006)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:01.387112 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65eedcab-c49f-4be1-b756-e9b7d95a45a5 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:01.395272 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1068/2110] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:33:01 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 16:33:01.396508 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1a8382-e26c-4b73-8dfb-ea980a51912d service cinder] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:01.409029 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1a8382-e26c-4b73-8dfb-ea980a51912d service cinder] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:01.414038 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d68b29-bbe6-471b-a790-feac90d92a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:01.414676 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d68b29-bbe6-471b-a790-feac90d92a91 admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:01.414959 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d68b29-bbe6-471b-a790-feac90d92a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:01.415234 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d68b29-bbe6-471b-a790-feac90d92a91 admin admin] PATH_INFO: `/v3/projects` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:01.415861 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d68b29-bbe6-471b-a790-feac90d92a91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:01.417754 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d68b29-bbe6-471b-a790-feac90d92a91 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:01.445293 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-65eedcab-c49f-4be1-b756-e9b7d95a45a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da1c7d8ca03740e49d0e2a8a69879006', 'request_id': 'req-65eedcab-c49f-4be1-b756-e9b7d95a45a5'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:01.451875 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1069/2111] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 16:33:01 2022] POST /identity/v3/projects => generated 373 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:33:01.452734 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-65eedcab-c49f-4be1-b756-e9b7d95a45a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da1c7d8ca03740e49d0e2a8a69879006', 'request_id': 'req-65eedcab-c49f-4be1-b756-e9b7d95a45a5'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:01.452881 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d68b29-bbe6-471b-a790-feac90d92a91 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:01.454407 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-44d68b29-bbe6-471b-a790-feac90d92a91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:01.461828 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-65eedcab-c49f-4be1-b756-e9b7d95a45a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da1c7d8ca03740e49d0e2a8a69879006', 'request_id': 'req-65eedcab-c49f-4be1-b756-e9b7d95a45a5'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:01.472699 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-65eedcab-c49f-4be1-b756-e9b7d95a45a5 admin admin] The token cache is being invalidate because project da1c7d8ca03740e49d0e2a8a69879006 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81445) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 16:33:01.473042 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-65eedcab-c49f-4be1-b756-e9b7d95a45a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:01.473195 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:33:01.473688 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-65eedcab-c49f-4be1-b756-e9b7d95a45a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:01.475571 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1043/2112] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 16:33:01 2022] DELETE /identity/v3/projects/da1c7d8ca03740e49d0e2a8a69879006 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:33:01.476307 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eedcab-c49f-4be1-b756-e9b7d95a45a5 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:01.477836 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-65eedcab-c49f-4be1-b756-e9b7d95a45a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:01.526605 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d68b29-bbe6-471b-a790-feac90d92a91 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:01.531381 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62be954f-921f-4226-9789-0f00572db749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:01.532011 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62be954f-921f-4226-9789-0f00572db749 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:01.532286 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62be954f-921f-4226-9789-0f00572db749 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:01.532554 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62be954f-921f-4226-9789-0f00572db749 admin admin] PATH_INFO: `/v3/users/59993d76e1e2405d896c9f8fcacb6087` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:01.533716 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62be954f-921f-4226-9789-0f00572db749 admin admin] RBAC: Authorizing `identity:delete_user(user_id=59993d76e1e2405d896c9f8fcacb6087)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:01.535673 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62be954f-921f-4226-9789-0f00572db749 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:01.544047 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eedcab-c49f-4be1-b756-e9b7d95a45a5 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:01.549153 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63592dc-2faa-4d76-95ff-b1aa2f347f3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:01.549751 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63592dc-2faa-4d76-95ff-b1aa2f347f3f admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:01.550028 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63592dc-2faa-4d76-95ff-b1aa2f347f3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:01.550298 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63592dc-2faa-4d76-95ff-b1aa2f347f3f admin admin] PATH_INFO: `/v3/users` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:01.550949 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63592dc-2faa-4d76-95ff-b1aa2f347f3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:01.552984 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63592dc-2faa-4d76-95ff-b1aa2f347f3f admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:01.580327 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1044/2113] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 16:33:01 2022] POST /identity/v3/users => generated 287 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:33:01.580327 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199027bc-2342-4902-b9b2-a14b0e0a2421 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:01.580327 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199027bc-2342-4902-b9b2-a14b0e0a2421 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:01.580327 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199027bc-2342-4902-b9b2-a14b0e0a2421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:01.586063 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-62be954f-921f-4226-9789-0f00572db749 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59993d76e1e2405d896c9f8fcacb6087'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:01.594297 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-62be954f-921f-4226-9789-0f00572db749 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59993d76e1e2405d896c9f8fcacb6087'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:01.599511 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-199027bc-2342-4902-b9b2-a14b0e0a2421 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:33:01.600714 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-199027bc-2342-4902-b9b2-a14b0e0a2421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:01.608150 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-62be954f-921f-4226-9789-0f00572db749 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59993d76e1e2405d896c9f8fcacb6087'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:01.609275 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1045/2114] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:33:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:33:01.610029 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199027bc-2342-4902-b9b2-a14b0e0a2421 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:01.621628 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199027bc-2342-4902-b9b2-a14b0e0a2421 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:01.623006 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-62be954f-921f-4226-9789-0f00572db749 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59993d76e1e2405d896c9f8fcacb6087'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:01.623905 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-62be954f-921f-4226-9789-0f00572db749 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59993d76e1e2405d896c9f8fcacb6087'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:01.627383 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b63602-079c-4638-9946-9eea56a9ad90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:01.628013 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b63602-079c-4638-9946-9eea56a9ad90 admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:01.628437 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b63602-079c-4638-9946-9eea56a9ad90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:01.628797 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b63602-079c-4638-9946-9eea56a9ad90 admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:01.629454 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b63602-079c-4638-9946-9eea56a9ad90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:01.631248 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1070/2115] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 16:33:01 2022] DELETE /identity/v3/users/59993d76e1e2405d896c9f8fcacb6087 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:33:01.631386 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b63602-079c-4638-9946-9eea56a9ad90 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:01.632250 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91e081a-eafb-48ab-a49c-082c131236f0 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:01.632537 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91e081a-eafb-48ab-a49c-082c131236f0 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:01.632809 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91e081a-eafb-48ab-a49c-082c131236f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:01.641850 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1046/2116] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:33:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:33:01.646033 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea41b19-bde0-4ef4-b4d0-b2b476bb3eb2 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:01.646333 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea41b19-bde0-4ef4-b4d0-b2b476bb3eb2 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:01.646607 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea41b19-bde0-4ef4-b4d0-b2b476bb3eb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:01.652058 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-f91e081a-eafb-48ab-a49c-082c131236f0 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:33:01.653271 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-f91e081a-eafb-48ab-a49c-082c131236f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:01.665155 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-1ea41b19-bde0-4ef4-b4d0-b2b476bb3eb2 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:33:01.666334 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-1ea41b19-bde0-4ef4-b4d0-b2b476bb3eb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:01.692430 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:33:01.715105 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1071/2117] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:33:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:33:01.716774 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91e081a-eafb-48ab-a49c-082c131236f0 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:01.718067 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-f91e081a-eafb-48ab-a49c-082c131236f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:01.729329 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91e081a-eafb-48ab-a49c-082c131236f0 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:01.736263 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1047/2118] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:33:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:33:01.736263 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea41b19-bde0-4ef4-b4d0-b2b476bb3eb2 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:01.736491 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4581ebe6-7f49-484b-aa92-3aee21a09a85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:01.736491 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4581ebe6-7f49-484b-aa92-3aee21a09a85 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:01.736491 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4581ebe6-7f49-484b-aa92-3aee21a09a85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:01.736491 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4581ebe6-7f49-484b-aa92-3aee21a09a85 admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:01.736870 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4581ebe6-7f49-484b-aa92-3aee21a09a85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:01.737803 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4581ebe6-7f49-484b-aa92-3aee21a09a85 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:01.743359 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea41b19-bde0-4ef4-b4d0-b2b476bb3eb2 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:01.748031 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a115c2c5-3393-47e3-bbe1-6b2aeb6b4c59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:01.748161 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1072/2119] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:33:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:33:01.748619 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a115c2c5-3393-47e3-bbe1-6b2aeb6b4c59 admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:01.748840 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4581ebe6-7f49-484b-aa92-3aee21a09a85 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:01.748957 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a115c2c5-3393-47e3-bbe1-6b2aeb6b4c59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:01.749207 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a115c2c5-3393-47e3-bbe1-6b2aeb6b4c59 admin admin] PATH_INFO: `/v3/domains` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:01.749781 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a115c2c5-3393-47e3-bbe1-6b2aeb6b4c59 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:33:01.750053 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a115c2c5-3393-47e3-bbe1-6b2aeb6b4c59 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:01.751045 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-4581ebe6-7f49-484b-aa92-3aee21a09a85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:01.751671 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a115c2c5-3393-47e3-bbe1-6b2aeb6b4c59 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:01.766740 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1048/2120] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Sep 9 16:33:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:33:01.766740 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a115c2c5-3393-47e3-bbe1-6b2aeb6b4c59 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:01.775680 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a115c2c5-3393-47e3-bbe1-6b2aeb6b4c59 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:01.779042 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:33:01.781347 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdbe85f-2078-414d-9085-c00a34488e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:01.781971 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdbe85f-2078-414d-9085-c00a34488e42 admin admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:01.782253 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdbe85f-2078-414d-9085-c00a34488e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:01.782545 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdbe85f-2078-414d-9085-c00a34488e42 admin admin] PATH_INFO: `/v3/projects/68978627495f475baec711ba54a958f1/users/926c5c9f099448b08abdee386231a13d/roles/b38e84bf077846ee802e6bb1bad83522` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:01.797752 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdbe85f-2078-414d-9085-c00a34488e42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68978627495f475baec711ba54a958f1, user_id=926c5c9f099448b08abdee386231a13d, role_id=b38e84bf077846ee802e6bb1bad83522)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:01.800431 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdbe85f-2078-414d-9085-c00a34488e42 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:01.812969 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4581ebe6-7f49-484b-aa92-3aee21a09a85 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:01.813467 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1049/2121] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 16:33:01 2022] PUT /identity/v3/projects/68978627495f475baec711ba54a958f1/users/926c5c9f099448b08abdee386231a13d/roles/b38e84bf077846ee802e6bb1bad83522 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:33:01.822497 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdbe85f-2078-414d-9085-c00a34488e42 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:01.865661 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9821b813-48d7-4553-af21-290dab858e8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f44bfdd5214e8d84a2c0a5b1fd9b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:01.866192 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9821b813-48d7-4553-af21-290dab858e8f service neutron] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:01.866471 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9821b813-48d7-4553-af21-290dab858e8f service neutron] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:01.866734 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9821b813-48d7-4553-af21-290dab858e8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:01.879643 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdbe85f-2078-414d-9085-c00a34488e42 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:01.884389 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961b36e2-3e41-4c9a-9426-0594820a6075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:01.884987 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961b36e2-3e41-4c9a-9426-0594820a6075 admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:01.885266 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961b36e2-3e41-4c9a-9426-0594820a6075 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:01.885772 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961b36e2-3e41-4c9a-9426-0594820a6075 admin admin] PATH_INFO: `/v3/projects` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:01.886423 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961b36e2-3e41-4c9a-9426-0594820a6075 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:01.888451 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961b36e2-3e41-4c9a-9426-0594820a6075 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:01.916370 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1050/2122] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 16:33:01 2022] POST /identity/v3/projects => generated 375 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:33:01.917717 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63ac0f9-d0cf-410c-a3a4-1a1286caceed None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:01.918002 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63ac0f9-d0cf-410c-a3a4-1a1286caceed None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:01.918295 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63ac0f9-d0cf-410c-a3a4-1a1286caceed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:01.929450 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9821b813-48d7-4553-af21-290dab858e8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:01.930949 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9821b813-48d7-4553-af21-290dab858e8f service neutron] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:01.941474 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1073/2123] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:33:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:33:01.942348 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9821b813-48d7-4553-af21-290dab858e8f service neutron] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:01.951102 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-d63ac0f9-d0cf-410c-a3a4-1a1286caceed None None] MFA Rules not processed for user `926c5c9f099448b08abdee386231a13d`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:33:01.951728 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9821b813-48d7-4553-af21-290dab858e8f service neutron] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:01.952399 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-d63ac0f9-d0cf-410c-a3a4-1a1286caceed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:02.026264 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c592a2-db92-4067-892d-ccea0f2db3a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:02.027166 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c592a2-db92-4067-892d-ccea0f2db3a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:02.027712 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c592a2-db92-4067-892d-ccea0f2db3a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:02.028202 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c592a2-db92-4067-892d-ccea0f2db3a6 admin admin] PATH_INFO: `/v3/users` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:02.029401 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c592a2-db92-4067-892d-ccea0f2db3a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:02.032279 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c592a2-db92-4067-892d-ccea0f2db3a6 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:02.041773 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1051/2124] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:33:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:33:02.068483 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63ac0f9-d0cf-410c-a3a4-1a1286caceed None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:02.068483 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-d63ac0f9-d0cf-410c-a3a4-1a1286caceed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:02.073818 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1074/2125] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 16:33:01 2022] POST /identity/v3/users => generated 288 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:33:02.079775 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c592a2-db92-4067-892d-ccea0f2db3a6 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:02.080827 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:33:02.123718 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c592a2-db92-4067-892d-ccea0f2db3a6 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:02.135966 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d391e3b9-33e4-4575-9d3e-e436cf8c1e8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:02.136611 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d391e3b9-33e4-4575-9d3e-e436cf8c1e8b admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:02.136836 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d391e3b9-33e4-4575-9d3e-e436cf8c1e8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:02.137111 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d391e3b9-33e4-4575-9d3e-e436cf8c1e8b admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:02.138478 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d391e3b9-33e4-4575-9d3e-e436cf8c1e8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:02.142999 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d391e3b9-33e4-4575-9d3e-e436cf8c1e8b admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:02.167914 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1075/2126] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:33:02 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:33:02.176075 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d391e3b9-33e4-4575-9d3e-e436cf8c1e8b admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:02.178279 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63ac0f9-d0cf-410c-a3a4-1a1286caceed None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:02.182821 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd444fa-da77-40d1-9512-c2cfe6ab6af7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8078e791ba68460f8b3aeafb4b79b73a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:02.183651 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd444fa-da77-40d1-9512-c2cfe6ab6af7 service cinder] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:02.184117 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd444fa-da77-40d1-9512-c2cfe6ab6af7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:02.184598 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd444fa-da77-40d1-9512-c2cfe6ab6af7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:02.195318 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd444fa-da77-40d1-9512-c2cfe6ab6af7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:02.197023 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd444fa-da77-40d1-9512-c2cfe6ab6af7 service cinder] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:02.198123 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d391e3b9-33e4-4575-9d3e-e436cf8c1e8b admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:02.207711 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dac5bff-228c-4a3c-8bd4-a26bebabe01e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:02.208326 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dac5bff-228c-4a3c-8bd4-a26bebabe01e admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:02.208609 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dac5bff-228c-4a3c-8bd4-a26bebabe01e admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:02.208884 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dac5bff-228c-4a3c-8bd4-a26bebabe01e admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:02.209530 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dac5bff-228c-4a3c-8bd4-a26bebabe01e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:02.211300 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dac5bff-228c-4a3c-8bd4-a26bebabe01e admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:02.212828 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1052/2127] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:33:02 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 16:33:02.213955 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:33:02.229337 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1076/2128] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:33:02 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:33:02.231466 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd444fa-da77-40d1-9512-c2cfe6ab6af7 service cinder] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:02.247420 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd444fa-da77-40d1-9512-c2cfe6ab6af7 service cinder] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:02.253906 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfcfe0e-dd30-4902-ab9c-50be76c90704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:02.254825 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfcfe0e-dd30-4902-ab9c-50be76c90704 admin admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:02.255203 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfcfe0e-dd30-4902-ab9c-50be76c90704 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:02.255569 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfcfe0e-dd30-4902-ab9c-50be76c90704 admin admin] PATH_INFO: `/v3/projects/287b3cfb830f4ae99aea938d62c14c80/users/e82d7742d0164d6f9819dd6981f89ee9/roles/b38e84bf077846ee802e6bb1bad83522` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:02.292260 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfcfe0e-dd30-4902-ab9c-50be76c90704 admin admin] RBAC: Authorizing `identity:create_grant(project_id=287b3cfb830f4ae99aea938d62c14c80, user_id=e82d7742d0164d6f9819dd6981f89ee9, role_id=b38e84bf077846ee802e6bb1bad83522)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:02.300533 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfcfe0e-dd30-4902-ab9c-50be76c90704 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:02.313048 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dac5bff-228c-4a3c-8bd4-a26bebabe01e admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:02.315360 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-1dac5bff-228c-4a3c-8bd4-a26bebabe01e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:02.323182 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1053/2129] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 16:33:02 2022] PUT /identity/v3/projects/287b3cfb830f4ae99aea938d62c14c80/users/e82d7742d0164d6f9819dd6981f89ee9/roles/b38e84bf077846ee802e6bb1bad83522 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:33:02.335657 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a2e2bb-4f28-48b8-a91f-2590b6ee2b61 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:02.336151 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a2e2bb-4f28-48b8-a91f-2590b6ee2b61 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:02.337100 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a2e2bb-4f28-48b8-a91f-2590b6ee2b61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:02.348224 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dac5bff-228c-4a3c-8bd4-a26bebabe01e admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:02.411846 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-d1a2e2bb-4f28-48b8-a91f-2590b6ee2b61 None None] MFA Rules not processed for user `e82d7742d0164d6f9819dd6981f89ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:33:02.413094 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-d1a2e2bb-4f28-48b8-a91f-2590b6ee2b61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:02.468143 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7888e0e-b005-470f-bfea-d39b049999e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:02.468762 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7888e0e-b005-470f-bfea-d39b049999e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:02.469048 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7888e0e-b005-470f-bfea-d39b049999e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:02.469320 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7888e0e-b005-470f-bfea-d39b049999e6 admin admin] PATH_INFO: `/v3/projects/a299406e76b64a1fa2f28c84c574e152` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:02.470508 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7888e0e-b005-470f-bfea-d39b049999e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a299406e76b64a1fa2f28c84c574e152)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:02.472650 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7888e0e-b005-470f-bfea-d39b049999e6 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:02.537038 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-a7888e0e-b005-470f-bfea-d39b049999e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a299406e76b64a1fa2f28c84c574e152', 'request_id': 'req-a7888e0e-b005-470f-bfea-d39b049999e6'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:02.542690 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1054/2130] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:33:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:33:02.549031 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-a7888e0e-b005-470f-bfea-d39b049999e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a299406e76b64a1fa2f28c84c574e152', 'request_id': 'req-a7888e0e-b005-470f-bfea-d39b049999e6'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:02.559437 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-a7888e0e-b005-470f-bfea-d39b049999e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a299406e76b64a1fa2f28c84c574e152', 'request_id': 'req-a7888e0e-b005-470f-bfea-d39b049999e6'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:02.560084 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a2e2bb-4f28-48b8-a91f-2590b6ee2b61 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:02.562990 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-d1a2e2bb-4f28-48b8-a91f-2590b6ee2b61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:02.585741 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-a7888e0e-b005-470f-bfea-d39b049999e6 admin admin] The token cache is being invalidate because project a299406e76b64a1fa2f28c84c574e152 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81446) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 16:33:02.586206 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-a7888e0e-b005-470f-bfea-d39b049999e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:02.586997 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-a7888e0e-b005-470f-bfea-d39b049999e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:02.592345 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1077/2131] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 16:33:02 2022] DELETE /identity/v3/projects/a299406e76b64a1fa2f28c84c574e152 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:33:02.594576 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7888e0e-b005-470f-bfea-d39b049999e6 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:02.596308 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-a7888e0e-b005-470f-bfea-d39b049999e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:02.676851 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a2e2bb-4f28-48b8-a91f-2590b6ee2b61 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:02.686723 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7888e0e-b005-470f-bfea-d39b049999e6 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:02.690239 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:33:02.695305 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10135258-b530-4cc7-9409-63257c622540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:02.696283 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10135258-b530-4cc7-9409-63257c622540 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:02.697588 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10135258-b530-4cc7-9409-63257c622540 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:02.698134 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10135258-b530-4cc7-9409-63257c622540 admin admin] PATH_INFO: `/v3/users/3aa06e577b854fe18227fd2ed444cecf` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:02.713838 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10135258-b530-4cc7-9409-63257c622540 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3aa06e577b854fe18227fd2ed444cecf)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:02.713838 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10135258-b530-4cc7-9409-63257c622540 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:02.770871 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:33:02.772244 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086e975c-03f3-4679-b32b-982409b4c0bf service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ddd42508eee4412ae139cb8526090d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:02.772948 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086e975c-03f3-4679-b32b-982409b4c0bf service glance] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:02.773348 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086e975c-03f3-4679-b32b-982409b4c0bf service glance] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:02.773700 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086e975c-03f3-4679-b32b-982409b4c0bf service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:02.776155 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-086e975c-03f3-4679-b32b-982409b4c0bf service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:02.798247 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-10135258-b530-4cc7-9409-63257c622540 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3aa06e577b854fe18227fd2ed444cecf'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:02.807818 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-10135258-b530-4cc7-9409-63257c622540 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3aa06e577b854fe18227fd2ed444cecf'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:02.837727 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-10135258-b530-4cc7-9409-63257c622540 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3aa06e577b854fe18227fd2ed444cecf'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:02.847324 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-10135258-b530-4cc7-9409-63257c622540 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3aa06e577b854fe18227fd2ed444cecf'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:02.848123 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-10135258-b530-4cc7-9409-63257c622540 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3aa06e577b854fe18227fd2ed444cecf'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:02.854463 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086e975c-03f3-4679-b32b-982409b4c0bf service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:02.855171 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1078/2132] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 16:33:02 2022] DELETE /identity/v3/users/3aa06e577b854fe18227fd2ed444cecf => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:33:02.856449 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086e975c-03f3-4679-b32b-982409b4c0bf service glance] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:02.867216 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1055/2133] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:33:02 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 16:33:03.145891 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10135258-b530-4cc7-9409-63257c622540 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:03.148033 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-10135258-b530-4cc7-9409-63257c622540 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:03.229061 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10135258-b530-4cc7-9409-63257c622540 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:03.234687 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accbcb26-e645-439a-863a-50eb1494b004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:03.235533 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accbcb26-e645-439a-863a-50eb1494b004 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:03.235812 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accbcb26-e645-439a-863a-50eb1494b004 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:03.236086 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accbcb26-e645-439a-863a-50eb1494b004 admin admin] PATH_INFO: `/v3/projects/0d2a3494f9884708bea0480f0c1b0d4b` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:03.237210 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accbcb26-e645-439a-863a-50eb1494b004 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d2a3494f9884708bea0480f0c1b0d4b)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:03.239323 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accbcb26-e645-439a-863a-50eb1494b004 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:03.296144 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-accbcb26-e645-439a-863a-50eb1494b004 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d2a3494f9884708bea0480f0c1b0d4b', 'request_id': 'req-accbcb26-e645-439a-863a-50eb1494b004'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:03.302270 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-accbcb26-e645-439a-863a-50eb1494b004 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d2a3494f9884708bea0480f0c1b0d4b', 'request_id': 'req-accbcb26-e645-439a-863a-50eb1494b004'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:03.312534 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-accbcb26-e645-439a-863a-50eb1494b004 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d2a3494f9884708bea0480f0c1b0d4b', 'request_id': 'req-accbcb26-e645-439a-863a-50eb1494b004'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:03.328212 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-accbcb26-e645-439a-863a-50eb1494b004 admin admin] The token cache is being invalidate because project 0d2a3494f9884708bea0480f0c1b0d4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81446) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 16:33:03.328828 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-accbcb26-e645-439a-863a-50eb1494b004 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:03.329893 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-accbcb26-e645-439a-863a-50eb1494b004 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:03.335541 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1079/2134] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 16:33:03 2022] DELETE /identity/v3/projects/0d2a3494f9884708bea0480f0c1b0d4b => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:33:03.337371 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decf541e-4866-434e-a418-3801df93ee3e None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:03.337709 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decf541e-4866-434e-a418-3801df93ee3e None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:03.337990 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decf541e-4866-434e-a418-3801df93ee3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:03.360560 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-decf541e-4866-434e-a418-3801df93ee3e None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:33:03.361762 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-decf541e-4866-434e-a418-3801df93ee3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:03.438986 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1056/2135] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:33:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:33:03.440568 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5712714c-b0bf-49af-9961-13894aeb71be None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:03.441134 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5712714c-b0bf-49af-9961-13894aeb71be None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:03.441409 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5712714c-b0bf-49af-9961-13894aeb71be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:03.470994 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-5712714c-b0bf-49af-9961-13894aeb71be None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:33:03.470994 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-5712714c-b0bf-49af-9961-13894aeb71be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:03.484388 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1080/2136] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:33:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:33:03.489578 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decf541e-4866-434e-a418-3801df93ee3e None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:03.501331 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decf541e-4866-434e-a418-3801df93ee3e None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:03.509412 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a869287-91c4-4293-8611-73e6b9820e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:03.510033 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a869287-91c4-4293-8611-73e6b9820e42 admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:03.510379 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a869287-91c4-4293-8611-73e6b9820e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:03.510624 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a869287-91c4-4293-8611-73e6b9820e42 admin admin] PATH_INFO: `/v3/domains` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:03.511251 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a869287-91c4-4293-8611-73e6b9820e42 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:33:03.511556 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a869287-91c4-4293-8611-73e6b9820e42 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:03.513223 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a869287-91c4-4293-8611-73e6b9820e42 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:03.526914 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1057/2137] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Sep 9 16:33:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:33:03.532226 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5712714c-b0bf-49af-9961-13894aeb71be None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:03.542993 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5712714c-b0bf-49af-9961-13894aeb71be None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:03.548842 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c06707-25f1-4971-9b0c-0ee9267ced9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:03.549509 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c06707-25f1-4971-9b0c-0ee9267ced9b admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:03.549788 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c06707-25f1-4971-9b0c-0ee9267ced9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:03.550057 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c06707-25f1-4971-9b0c-0ee9267ced9b admin admin] PATH_INFO: `/v3/projects` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:03.550728 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c06707-25f1-4971-9b0c-0ee9267ced9b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:03.552737 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c06707-25f1-4971-9b0c-0ee9267ced9b admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:03.585685 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1081/2138] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 16:33:03 2022] POST /identity/v3/projects => generated 383 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 16:33:03.589767 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a869287-91c4-4293-8611-73e6b9820e42 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:03.591816 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c06707-25f1-4971-9b0c-0ee9267ced9b admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:03.593687 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-a8c06707-25f1-4971-9b0c-0ee9267ced9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:03.601759 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a869287-91c4-4293-8611-73e6b9820e42 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:03.610468 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:33:03.658442 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:33:03.667111 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b97e7b-8f39-4b4d-aeed-3142251af426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:03.667722 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b97e7b-8f39-4b4d-aeed-3142251af426 admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:03.668001 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b97e7b-8f39-4b4d-aeed-3142251af426 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:03.668273 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b97e7b-8f39-4b4d-aeed-3142251af426 admin admin] PATH_INFO: `/v3/users` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:03.668928 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b97e7b-8f39-4b4d-aeed-3142251af426 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:03.671765 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b97e7b-8f39-4b4d-aeed-3142251af426 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:03.681631 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c06707-25f1-4971-9b0c-0ee9267ced9b admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:03.689864 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1463ec-17d4-48f7-a691-22498f7f71e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:03.690561 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1463ec-17d4-48f7-a691-22498f7f71e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:03.691208 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1463ec-17d4-48f7-a691-22498f7f71e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:03.691399 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1463ec-17d4-48f7-a691-22498f7f71e1 admin admin] PATH_INFO: `/v3/users/74300e85e68a41a0b65595fc0ef92541` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:03.692543 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1463ec-17d4-48f7-a691-22498f7f71e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=74300e85e68a41a0b65595fc0ef92541)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:03.694559 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1463ec-17d4-48f7-a691-22498f7f71e1 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:03.698085 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1058/2139] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 16:33:03 2022] POST /identity/v3/users => generated 292 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:33:03.699144 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b97e7b-8f39-4b4d-aeed-3142251af426 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:03.708533 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b97e7b-8f39-4b4d-aeed-3142251af426 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:03.713534 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df315fb-48d7-4cdf-bd26-754f8abd3d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:03.714113 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df315fb-48d7-4cdf-bd26-754f8abd3d2c admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:03.714422 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df315fb-48d7-4cdf-bd26-754f8abd3d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:03.714692 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df315fb-48d7-4cdf-bd26-754f8abd3d2c admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:03.715342 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df315fb-48d7-4cdf-bd26-754f8abd3d2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:03.717456 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df315fb-48d7-4cdf-bd26-754f8abd3d2c admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:03.731514 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1059/2140] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:33:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 16:33:03.734377 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df315fb-48d7-4cdf-bd26-754f8abd3d2c admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:03.744638 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df315fb-48d7-4cdf-bd26-754f8abd3d2c admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:03.748566 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-1f1463ec-17d4-48f7-a691-22498f7f71e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74300e85e68a41a0b65595fc0ef92541'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:03.751333 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706d1fd8-6f9e-47b3-9006-7437c79a4c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:03.751934 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706d1fd8-6f9e-47b3-9006-7437c79a4c50 admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:03.752501 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706d1fd8-6f9e-47b3-9006-7437c79a4c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:03.752892 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706d1fd8-6f9e-47b3-9006-7437c79a4c50 admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:03.753630 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706d1fd8-6f9e-47b3-9006-7437c79a4c50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:03.755364 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706d1fd8-6f9e-47b3-9006-7437c79a4c50 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:03.756621 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-1f1463ec-17d4-48f7-a691-22498f7f71e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74300e85e68a41a0b65595fc0ef92541'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:03.767502 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1060/2141] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:33:03 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 16:33:03.771466 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706d1fd8-6f9e-47b3-9006-7437c79a4c50 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:03.774941 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-1f1463ec-17d4-48f7-a691-22498f7f71e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74300e85e68a41a0b65595fc0ef92541'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:03.783832 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706d1fd8-6f9e-47b3-9006-7437c79a4c50 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:03.785545 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-1f1463ec-17d4-48f7-a691-22498f7f71e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74300e85e68a41a0b65595fc0ef92541'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:03.786275 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-1f1463ec-17d4-48f7-a691-22498f7f71e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74300e85e68a41a0b65595fc0ef92541'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:03.789811 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12189fc4-f392-439e-a50b-cf9c3cff45fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:03.790510 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12189fc4-f392-439e-a50b-cf9c3cff45fa admin admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:03.790887 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12189fc4-f392-439e-a50b-cf9c3cff45fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:03.791203 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12189fc4-f392-439e-a50b-cf9c3cff45fa admin admin] PATH_INFO: `/v3/projects/5d6acd144f2f4d79a460916316c878da/users/44588dd50c5541e0a595ed6a11939d30/roles/b38e84bf077846ee802e6bb1bad83522` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:03.798518 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1082/2142] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 16:33:03 2022] DELETE /identity/v3/users/74300e85e68a41a0b65595fc0ef92541 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:33:03.802970 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5098fae8-6b82-43b0-bbb4-119d9d306a99 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:03.803295 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5098fae8-6b82-43b0-bbb4-119d9d306a99 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:03.803587 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5098fae8-6b82-43b0-bbb4-119d9d306a99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:03.811785 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12189fc4-f392-439e-a50b-cf9c3cff45fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d6acd144f2f4d79a460916316c878da, user_id=44588dd50c5541e0a595ed6a11939d30, role_id=b38e84bf077846ee802e6bb1bad83522)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:03.814911 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12189fc4-f392-439e-a50b-cf9c3cff45fa admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:03.829997 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-5098fae8-6b82-43b0-bbb4-119d9d306a99 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:33:03.831622 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-5098fae8-6b82-43b0-bbb4-119d9d306a99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:03.845422 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1061/2143] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 16:33:03 2022] PUT /identity/v3/projects/5d6acd144f2f4d79a460916316c878da/users/44588dd50c5541e0a595ed6a11939d30/roles/b38e84bf077846ee802e6bb1bad83522 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 16:33:03.864583 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ed6a86-17ed-4b0d-bca2-b006c0b9b9e7 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:03.865104 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ed6a86-17ed-4b0d-bca2-b006c0b9b9e7 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:03.865828 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ed6a86-17ed-4b0d-bca2-b006c0b9b9e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:03.915990 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-53ed6a86-17ed-4b0d-bca2-b006c0b9b9e7 None None] MFA Rules not processed for user `44588dd50c5541e0a595ed6a11939d30`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:33:03.915990 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-53ed6a86-17ed-4b0d-bca2-b006c0b9b9e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:03.934194 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1083/2144] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:33:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 16:33:03.945318 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5098fae8-6b82-43b0-bbb4-119d9d306a99 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:03.947092 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-5098fae8-6b82-43b0-bbb4-119d9d306a99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:03.995224 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:33:04.042856 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5098fae8-6b82-43b0-bbb4-119d9d306a99 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:04.048212 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795e2b5d-63b6-4f68-b098-c9a7f232041b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f44bfdd5214e8d84a2c0a5b1fd9b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:04.049183 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795e2b5d-63b6-4f68-b098-c9a7f232041b service neutron] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:04.049710 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795e2b5d-63b6-4f68-b098-c9a7f232041b service neutron] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:04.050226 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795e2b5d-63b6-4f68-b098-c9a7f232041b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:04.067860 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1062/2145] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:33:03 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:33:04.072510 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ed6a86-17ed-4b0d-bca2-b006c0b9b9e7 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:04.074426 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795e2b5d-63b6-4f68-b098-c9a7f232041b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:04.076454 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795e2b5d-63b6-4f68-b098-c9a7f232041b service neutron] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:04.077382 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-53ed6a86-17ed-4b0d-bca2-b006c0b9b9e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:04.089561 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1084/2146] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:33:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 16:33:04.102246 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ed6a86-17ed-4b0d-bca2-b006c0b9b9e7 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:04.110750 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6fd79f-2591-4f45-bbad-89020b841cc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:04.111933 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6fd79f-2591-4f45-bbad-89020b841cc6 admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:04.112372 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6fd79f-2591-4f45-bbad-89020b841cc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:04.112869 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6fd79f-2591-4f45-bbad-89020b841cc6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:04.113822 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6fd79f-2591-4f45-bbad-89020b841cc6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:04.116221 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6fd79f-2591-4f45-bbad-89020b841cc6 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:04.172355 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1063/2147] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 16:33:04 2022] POST /identity/v3/projects => generated 381 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:33:04.176805 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795e2b5d-63b6-4f68-b098-c9a7f232041b service neutron] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:04.189650 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795e2b5d-63b6-4f68-b098-c9a7f232041b service neutron] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:04.347308 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4ed6d0-85d9-41a1-bc84-9c455832c61b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:04.348140 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4ed6d0-85d9-41a1-bc84-9c455832c61b admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:04.348524 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4ed6d0-85d9-41a1-bc84-9c455832c61b admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:04.348901 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4ed6d0-85d9-41a1-bc84-9c455832c61b admin admin] PATH_INFO: `/v3/users` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:04.349698 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4ed6d0-85d9-41a1-bc84-9c455832c61b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:04.352766 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4ed6d0-85d9-41a1-bc84-9c455832c61b admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:04.397675 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1085/2148] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 16:33:04 2022] POST /identity/v3/users => generated 297 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 16:33:04.399081 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6fd79f-2591-4f45-bbad-89020b841cc6 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:04.414040 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6fd79f-2591-4f45-bbad-89020b841cc6 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:04.427869 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44730ac6-8208-47b9-ba48-0cea6080217d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:04.428780 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44730ac6-8208-47b9-ba48-0cea6080217d admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:04.429353 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44730ac6-8208-47b9-ba48-0cea6080217d admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:04.429656 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44730ac6-8208-47b9-ba48-0cea6080217d admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:04.430656 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44730ac6-8208-47b9-ba48-0cea6080217d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:04.432317 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44730ac6-8208-47b9-ba48-0cea6080217d admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:04.449482 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1064/2149] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:33:04 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 16:33:04.454746 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4ed6d0-85d9-41a1-bc84-9c455832c61b admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:04.485181 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4ed6d0-85d9-41a1-bc84-9c455832c61b admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:04.490410 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c75a039-af3b-4e78-b575-60ec96db4193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:04.491481 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c75a039-af3b-4e78-b575-60ec96db4193 admin admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:04.491933 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c75a039-af3b-4e78-b575-60ec96db4193 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:04.492371 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c75a039-af3b-4e78-b575-60ec96db4193 admin admin] PATH_INFO: `/v3/projects/24acf4ac92714234bb6dfba2e861b94f/users/dcc80e5c427f4cb6af57a281ba8b1879/roles/0a36d1be416f4089be19be979943b731` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:04.514515 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c75a039-af3b-4e78-b575-60ec96db4193 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24acf4ac92714234bb6dfba2e861b94f, user_id=dcc80e5c427f4cb6af57a281ba8b1879, role_id=0a36d1be416f4089be19be979943b731)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:04.515239 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c75a039-af3b-4e78-b575-60ec96db4193 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:04.530955 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1086/2150] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 16:33:04 2022] PUT /identity/v3/projects/24acf4ac92714234bb6dfba2e861b94f/users/dcc80e5c427f4cb6af57a281ba8b1879/roles/0a36d1be416f4089be19be979943b731 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:33:04.535049 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44730ac6-8208-47b9-ba48-0cea6080217d admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:04.543350 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c75a039-af3b-4e78-b575-60ec96db4193 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:04.545177 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-7c75a039-af3b-4e78-b575-60ec96db4193 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:04.559026 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44730ac6-8208-47b9-ba48-0cea6080217d admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:04.627957 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:33:04.628128 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c75a039-af3b-4e78-b575-60ec96db4193 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:04.631889 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d9d150-64a6-4fad-b4f7-19e873d06df4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:04.632889 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d9d150-64a6-4fad-b4f7-19e873d06df4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:04.633131 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d9d150-64a6-4fad-b4f7-19e873d06df4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:04.633392 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d9d150-64a6-4fad-b4f7-19e873d06df4 admin admin] PATH_INFO: `/v3/projects/761ee24414da4d7189d854277278fecb` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:04.634574 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d9d150-64a6-4fad-b4f7-19e873d06df4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=761ee24414da4d7189d854277278fecb)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:04.636538 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d9d150-64a6-4fad-b4f7-19e873d06df4 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:04.638702 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2325749-1844-48ce-a2b9-584239ef7dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:04.639309 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2325749-1844-48ce-a2b9-584239ef7dcf admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:04.639581 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2325749-1844-48ce-a2b9-584239ef7dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:04.640230 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2325749-1844-48ce-a2b9-584239ef7dcf admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:04.641098 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2325749-1844-48ce-a2b9-584239ef7dcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:04.643572 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2325749-1844-48ce-a2b9-584239ef7dcf admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:04.665424 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1065/2151] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:33:04 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:33:04.673053 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2325749-1844-48ce-a2b9-584239ef7dcf admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:04.682367 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2325749-1844-48ce-a2b9-584239ef7dcf admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:04.690708 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:33:04.704649 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-78d9d150-64a6-4fad-b4f7-19e873d06df4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '761ee24414da4d7189d854277278fecb', 'request_id': 'req-78d9d150-64a6-4fad-b4f7-19e873d06df4'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:04.713192 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-78d9d150-64a6-4fad-b4f7-19e873d06df4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '761ee24414da4d7189d854277278fecb', 'request_id': 'req-78d9d150-64a6-4fad-b4f7-19e873d06df4'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:04.724530 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-78d9d150-64a6-4fad-b4f7-19e873d06df4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '761ee24414da4d7189d854277278fecb', 'request_id': 'req-78d9d150-64a6-4fad-b4f7-19e873d06df4'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:04.748471 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-78d9d150-64a6-4fad-b4f7-19e873d06df4 admin admin] The token cache is being invalidate because project 761ee24414da4d7189d854277278fecb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81446) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 16:33:04.749239 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-78d9d150-64a6-4fad-b4f7-19e873d06df4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:04.750176 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-78d9d150-64a6-4fad-b4f7-19e873d06df4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:04.752804 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1087/2152] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 16:33:04 2022] DELETE /identity/v3/projects/761ee24414da4d7189d854277278fecb => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:33:04.756605 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d9d150-64a6-4fad-b4f7-19e873d06df4 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:04.758945 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-78d9d150-64a6-4fad-b4f7-19e873d06df4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:04.769623 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ac04ca-2730-4a8d-ac10-3d4aa9b76b2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:04.770896 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ac04ca-2730-4a8d-ac10-3d4aa9b76b2a admin admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:04.771227 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ac04ca-2730-4a8d-ac10-3d4aa9b76b2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:04.771505 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ac04ca-2730-4a8d-ac10-3d4aa9b76b2a admin admin] PATH_INFO: `/v3/projects/24acf4ac92714234bb6dfba2e861b94f/users/dcc80e5c427f4cb6af57a281ba8b1879/roles/0a36d1be416f4089be19be979943b731` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:04.773502 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ac04ca-2730-4a8d-ac10-3d4aa9b76b2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=24acf4ac92714234bb6dfba2e861b94f, user_id=dcc80e5c427f4cb6af57a281ba8b1879, role_id=0a36d1be416f4089be19be979943b731)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:04.776431 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ac04ca-2730-4a8d-ac10-3d4aa9b76b2a admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:04.790690 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1066/2153] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 16:33:04 2022] PUT /identity/v3/projects/24acf4ac92714234bb6dfba2e861b94f/users/dcc80e5c427f4cb6af57a281ba8b1879/roles/0a36d1be416f4089be19be979943b731 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:33:04.803442 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920e9e65-dbc1-4a3e-87f4-0a1ea46b6735 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:04.803861 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920e9e65-dbc1-4a3e-87f4-0a1ea46b6735 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:04.804086 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920e9e65-dbc1-4a3e-87f4-0a1ea46b6735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:04.842157 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-920e9e65-dbc1-4a3e-87f4-0a1ea46b6735 None None] MFA Rules not processed for user `dcc80e5c427f4cb6af57a281ba8b1879`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:33:04.843573 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-920e9e65-dbc1-4a3e-87f4-0a1ea46b6735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:04.903280 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d9d150-64a6-4fad-b4f7-19e873d06df4 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:04.944376 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1067/2154] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:33:04 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:33:04.956503 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920e9e65-dbc1-4a3e-87f4-0a1ea46b6735 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:04.958201 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-920e9e65-dbc1-4a3e-87f4-0a1ea46b6735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:04.992096 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ccbcdb-3dc2-413a-b371-8ac07250f180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:04.992730 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ccbcdb-3dc2-413a-b371-8ac07250f180 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:04.993011 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ccbcdb-3dc2-413a-b371-8ac07250f180 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:04.993309 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ccbcdb-3dc2-413a-b371-8ac07250f180 admin admin] PATH_INFO: `/v3/users/9690bb16f36e4b51abb8a12484f8382f` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:04.994487 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ccbcdb-3dc2-413a-b371-8ac07250f180 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9690bb16f36e4b51abb8a12484f8382f)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:04.996433 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ccbcdb-3dc2-413a-b371-8ac07250f180 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:05.032661 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920e9e65-dbc1-4a3e-87f4-0a1ea46b6735 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:05.036635 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15bedc2-2ad4-48ed-8c43-4365cd664f5b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8078e791ba68460f8b3aeafb4b79b73a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:05.037230 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15bedc2-2ad4-48ed-8c43-4365cd664f5b service cinder] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:05.037578 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15bedc2-2ad4-48ed-8c43-4365cd664f5b service cinder] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:05.037787 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15bedc2-2ad4-48ed-8c43-4365cd664f5b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:05.047940 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15bedc2-2ad4-48ed-8c43-4365cd664f5b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:05.049427 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15bedc2-2ad4-48ed-8c43-4365cd664f5b service cinder] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:05.049831 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-b2ccbcdb-3dc2-413a-b371-8ac07250f180 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9690bb16f36e4b51abb8a12484f8382f'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:05.061899 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-b2ccbcdb-3dc2-413a-b371-8ac07250f180 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9690bb16f36e4b51abb8a12484f8382f'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:05.064014 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1068/2155] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:33:04 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 16:33:05.076513 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-b2ccbcdb-3dc2-413a-b371-8ac07250f180 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9690bb16f36e4b51abb8a12484f8382f'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:05.079588 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:33:05.088387 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-b2ccbcdb-3dc2-413a-b371-8ac07250f180 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9690bb16f36e4b51abb8a12484f8382f'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:05.090204 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-b2ccbcdb-3dc2-413a-b371-8ac07250f180 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9690bb16f36e4b51abb8a12484f8382f'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:05.101888 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1088/2156] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 16:33:04 2022] DELETE /identity/v3/users/9690bb16f36e4b51abb8a12484f8382f => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 16:33:05.181247 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15bedc2-2ad4-48ed-8c43-4365cd664f5b service cinder] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:05.183488 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-d15bedc2-2ad4-48ed-8c43-4365cd664f5b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:05.199835 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15bedc2-2ad4-48ed-8c43-4365cd664f5b service cinder] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:05.213884 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:33:05.264147 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868445c4-2046-49d5-a8a8-fdb838425601 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8078e791ba68460f8b3aeafb4b79b73a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:05.264882 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868445c4-2046-49d5-a8a8-fdb838425601 service cinder] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:05.265175 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868445c4-2046-49d5-a8a8-fdb838425601 service cinder] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:05.265458 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868445c4-2046-49d5-a8a8-fdb838425601 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:05.267954 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-868445c4-2046-49d5-a8a8-fdb838425601 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:05.344083 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868445c4-2046-49d5-a8a8-fdb838425601 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:05.345601 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868445c4-2046-49d5-a8a8-fdb838425601 service cinder] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:05.356701 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1069/2157] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:33:05 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:33:05.424695 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ccbcdb-3dc2-413a-b371-8ac07250f180 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:05.429107 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-b2ccbcdb-3dc2-413a-b371-8ac07250f180 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:05.547890 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ccbcdb-3dc2-413a-b371-8ac07250f180 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:05.553054 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8b4936-3024-489c-8660-2e7a516a0be7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:05.553859 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8b4936-3024-489c-8660-2e7a516a0be7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:05.554141 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8b4936-3024-489c-8660-2e7a516a0be7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:05.554477 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8b4936-3024-489c-8660-2e7a516a0be7 admin admin] PATH_INFO: `/v3/projects/c1f0c594422848a3a96cb61f52e042c0` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:05.555806 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8b4936-3024-489c-8660-2e7a516a0be7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1f0c594422848a3a96cb61f52e042c0)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:05.558595 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8b4936-3024-489c-8660-2e7a516a0be7 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:05.621484 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-fc8b4936-3024-489c-8660-2e7a516a0be7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1f0c594422848a3a96cb61f52e042c0', 'request_id': 'req-fc8b4936-3024-489c-8660-2e7a516a0be7'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:05.628168 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-fc8b4936-3024-489c-8660-2e7a516a0be7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1f0c594422848a3a96cb61f52e042c0', 'request_id': 'req-fc8b4936-3024-489c-8660-2e7a516a0be7'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:05.642125 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-fc8b4936-3024-489c-8660-2e7a516a0be7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1f0c594422848a3a96cb61f52e042c0', 'request_id': 'req-fc8b4936-3024-489c-8660-2e7a516a0be7'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:05.681317 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-fc8b4936-3024-489c-8660-2e7a516a0be7 admin admin] The token cache is being invalidate because project c1f0c594422848a3a96cb61f52e042c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81446) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 16:33:05.681614 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-fc8b4936-3024-489c-8660-2e7a516a0be7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:05.686724 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-fc8b4936-3024-489c-8660-2e7a516a0be7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:05.693250 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1089/2158] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 16:33:05 2022] DELETE /identity/v3/projects/c1f0c594422848a3a96cb61f52e042c0 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 16:33:05.701350 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e438a63e-b51d-4299-97a3-72b858c5b112 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:05.701350 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e438a63e-b51d-4299-97a3-72b858c5b112 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:05.701350 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e438a63e-b51d-4299-97a3-72b858c5b112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:05.733646 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-e438a63e-b51d-4299-97a3-72b858c5b112 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:33:05.735183 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-e438a63e-b51d-4299-97a3-72b858c5b112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:05.809321 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1070/2159] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:33:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:33:05.818326 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc510ea-9e39-4a6a-8432-595a01ada385 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:05.818601 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc510ea-9e39-4a6a-8432-595a01ada385 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:05.818871 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc510ea-9e39-4a6a-8432-595a01ada385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:05.839407 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-6dc510ea-9e39-4a6a-8432-595a01ada385 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:33:05.840629 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-6dc510ea-9e39-4a6a-8432-595a01ada385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:05.849166 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1090/2160] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:33:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:33:05.853390 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e438a63e-b51d-4299-97a3-72b858c5b112 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:05.863861 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e438a63e-b51d-4299-97a3-72b858c5b112 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:05.868821 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5226297-0f6e-4d0f-879d-3a711c164c5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:05.869674 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5226297-0f6e-4d0f-879d-3a711c164c5e admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:05.869957 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5226297-0f6e-4d0f-879d-3a711c164c5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:05.870393 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5226297-0f6e-4d0f-879d-3a711c164c5e admin admin] PATH_INFO: `/v3/domains` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:05.872913 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5226297-0f6e-4d0f-879d-3a711c164c5e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:33:05.873232 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5226297-0f6e-4d0f-879d-3a711c164c5e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:05.874895 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5226297-0f6e-4d0f-879d-3a711c164c5e admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:05.887769 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1071/2161] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Sep 9 16:33:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 16:33:05.892330 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc510ea-9e39-4a6a-8432-595a01ada385 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:05.903319 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc510ea-9e39-4a6a-8432-595a01ada385 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:05.909913 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79a7816-90bd-4f6a-a23d-3cb055c43a83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:05.910638 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79a7816-90bd-4f6a-a23d-3cb055c43a83 admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:05.910988 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79a7816-90bd-4f6a-a23d-3cb055c43a83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:05.911350 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79a7816-90bd-4f6a-a23d-3cb055c43a83 admin admin] PATH_INFO: `/v3/projects` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:05.912057 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79a7816-90bd-4f6a-a23d-3cb055c43a83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:05.914120 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79a7816-90bd-4f6a-a23d-3cb055c43a83 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:05.954328 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1091/2162] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 16:33:05 2022] POST /identity/v3/projects => generated 373 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:33:05.954543 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5226297-0f6e-4d0f-879d-3a711c164c5e admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:05.967551 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5226297-0f6e-4d0f-879d-3a711c164c5e admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:06.022761 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:33:06.030134 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d719ddc-efa3-4df1-9773-07351ca78c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:06.031393 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d719ddc-efa3-4df1-9773-07351ca78c3d admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:06.031544 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d719ddc-efa3-4df1-9773-07351ca78c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:06.033069 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d719ddc-efa3-4df1-9773-07351ca78c3d admin admin] PATH_INFO: `/v3/users` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:06.033702 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d719ddc-efa3-4df1-9773-07351ca78c3d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:06.035661 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d719ddc-efa3-4df1-9773-07351ca78c3d admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:06.059351 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1072/2163] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 16:33:05 2022] POST /identity/v3/users => generated 287 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:33:06.064082 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79a7816-90bd-4f6a-a23d-3cb055c43a83 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:06.075594 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79a7816-90bd-4f6a-a23d-3cb055c43a83 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:06.080381 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305b2b95-204f-478a-9da3-14afc658c92b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:06.081147 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305b2b95-204f-478a-9da3-14afc658c92b admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:06.081448 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305b2b95-204f-478a-9da3-14afc658c92b admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:06.081725 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305b2b95-204f-478a-9da3-14afc658c92b admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:06.082450 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305b2b95-204f-478a-9da3-14afc658c92b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:06.084032 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305b2b95-204f-478a-9da3-14afc658c92b admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:06.096121 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1092/2164] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:33:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:33:06.099946 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d719ddc-efa3-4df1-9773-07351ca78c3d admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:06.110503 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d719ddc-efa3-4df1-9773-07351ca78c3d admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:06.115443 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a3c244-f3a9-4756-8ec1-4b6350eeaa21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:06.116225 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a3c244-f3a9-4756-8ec1-4b6350eeaa21 admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:06.116534 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a3c244-f3a9-4756-8ec1-4b6350eeaa21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:06.116811 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a3c244-f3a9-4756-8ec1-4b6350eeaa21 admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:06.117488 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a3c244-f3a9-4756-8ec1-4b6350eeaa21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:06.119464 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a3c244-f3a9-4756-8ec1-4b6350eeaa21 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:06.136783 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1073/2165] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:33:06 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:33:06.138125 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305b2b95-204f-478a-9da3-14afc658c92b admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:06.148246 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305b2b95-204f-478a-9da3-14afc658c92b admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:06.153023 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c075bba-85bd-43a5-9396-183c9bb01de7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:06.154222 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c075bba-85bd-43a5-9396-183c9bb01de7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:06.154521 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c075bba-85bd-43a5-9396-183c9bb01de7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:06.154792 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c075bba-85bd-43a5-9396-183c9bb01de7 admin admin] PATH_INFO: `/v3/projects/85fd5a6a43d249198db3c83820656204/users/ceddde89c72747d784316e7b2fb44d19/roles/b38e84bf077846ee802e6bb1bad83522` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:06.170438 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c075bba-85bd-43a5-9396-183c9bb01de7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85fd5a6a43d249198db3c83820656204, user_id=ceddde89c72747d784316e7b2fb44d19, role_id=b38e84bf077846ee802e6bb1bad83522)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:06.173305 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c075bba-85bd-43a5-9396-183c9bb01de7 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:06.188942 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1093/2166] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 16:33:06 2022] PUT /identity/v3/projects/85fd5a6a43d249198db3c83820656204/users/ceddde89c72747d784316e7b2fb44d19/roles/b38e84bf077846ee802e6bb1bad83522 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 16:33:06.202078 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12addbb3-33bf-4555-9d2b-25ded93b0b8a None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:06.202392 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12addbb3-33bf-4555-9d2b-25ded93b0b8a None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:06.202666 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12addbb3-33bf-4555-9d2b-25ded93b0b8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:06.231417 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-12addbb3-33bf-4555-9d2b-25ded93b0b8a None None] MFA Rules not processed for user `ceddde89c72747d784316e7b2fb44d19`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:33:06.233298 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-12addbb3-33bf-4555-9d2b-25ded93b0b8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:06.314899 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1074/2167] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:33:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:33:06.326862 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c075bba-85bd-43a5-9396-183c9bb01de7 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:06.328649 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-0c075bba-85bd-43a5-9396-183c9bb01de7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:06.360561 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:DELETE=8,keystone:SELECT=89,keystone:INSERT=3 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:33:06.405042 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c075bba-85bd-43a5-9396-183c9bb01de7 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:06.408948 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5a7976-da45-4f21-b1df-c96519fab4f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8078e791ba68460f8b3aeafb4b79b73a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:06.409622 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5a7976-da45-4f21-b1df-c96519fab4f2 service cinder] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:06.409815 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5a7976-da45-4f21-b1df-c96519fab4f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:06.410085 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5a7976-da45-4f21-b1df-c96519fab4f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:06.418798 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5a7976-da45-4f21-b1df-c96519fab4f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:06.421188 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5a7976-da45-4f21-b1df-c96519fab4f2 service cinder] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:06.421328 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12addbb3-33bf-4555-9d2b-25ded93b0b8a None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:06.422674 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-12addbb3-33bf-4555-9d2b-25ded93b0b8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:06.430423 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1094/2168] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:33:06 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:33:06.494526 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12addbb3-33bf-4555-9d2b-25ded93b0b8a None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:06.503824 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487b6232-80bf-4791-b5ce-db71069e56ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:06.504463 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487b6232-80bf-4791-b5ce-db71069e56ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:06.504738 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487b6232-80bf-4791-b5ce-db71069e56ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:06.505006 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487b6232-80bf-4791-b5ce-db71069e56ec admin admin] PATH_INFO: `/v3/users/9c2bf83d03614fb28262e1a49412da67` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:06.506138 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487b6232-80bf-4791-b5ce-db71069e56ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c2bf83d03614fb28262e1a49412da67)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:06.508126 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487b6232-80bf-4791-b5ce-db71069e56ec admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:06.564964 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-487b6232-80bf-4791-b5ce-db71069e56ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c2bf83d03614fb28262e1a49412da67'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:06.575972 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-487b6232-80bf-4791-b5ce-db71069e56ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c2bf83d03614fb28262e1a49412da67'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:06.576695 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-487b6232-80bf-4791-b5ce-db71069e56ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c2bf83d03614fb28262e1a49412da67'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:06.587549 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-487b6232-80bf-4791-b5ce-db71069e56ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c2bf83d03614fb28262e1a49412da67'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:06.593636 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:33:06.613305 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-487b6232-80bf-4791-b5ce-db71069e56ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c2bf83d03614fb28262e1a49412da67'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:06.620860 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1075/2169] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 16:33:06 2022] DELETE /identity/v3/users/9c2bf83d03614fb28262e1a49412da67 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:33:06.625752 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98953a89-7fba-4438-8f65-4d18d1e83da2 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:06.626262 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98953a89-7fba-4438-8f65-4d18d1e83da2 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:06.626963 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98953a89-7fba-4438-8f65-4d18d1e83da2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:06.649666 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-98953a89-7fba-4438-8f65-4d18d1e83da2 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:33:06.650890 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-98953a89-7fba-4438-8f65-4d18d1e83da2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:06.724041 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1095/2170] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:33:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:33:06.734042 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487b6232-80bf-4791-b5ce-db71069e56ec admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:06.735762 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-487b6232-80bf-4791-b5ce-db71069e56ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:06.827618 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487b6232-80bf-4791-b5ce-db71069e56ec admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:06.831422 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215479cd-cd38-4797-9ee2-957da38a3283 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f44bfdd5214e8d84a2c0a5b1fd9b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:06.832019 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215479cd-cd38-4797-9ee2-957da38a3283 service neutron] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:06.832291 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215479cd-cd38-4797-9ee2-957da38a3283 service neutron] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:06.832580 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215479cd-cd38-4797-9ee2-957da38a3283 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:06.842853 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215479cd-cd38-4797-9ee2-957da38a3283 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:06.843782 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215479cd-cd38-4797-9ee2-957da38a3283 service neutron] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:06.854842 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1076/2171] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:33:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 16:33:07.190793 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98953a89-7fba-4438-8f65-4d18d1e83da2 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:07.192790 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-98953a89-7fba-4438-8f65-4d18d1e83da2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:07.211652 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98953a89-7fba-4438-8f65-4d18d1e83da2 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:07.221294 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b398f51-ed13-4dde-85f3-b0605e91fcbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:07.222589 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b398f51-ed13-4dde-85f3-b0605e91fcbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:07.222782 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b398f51-ed13-4dde-85f3-b0605e91fcbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:07.223132 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b398f51-ed13-4dde-85f3-b0605e91fcbc admin admin] PATH_INFO: `/v3/projects/7921ff592fc545bebb87b18429cc1287` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:07.224396 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b398f51-ed13-4dde-85f3-b0605e91fcbc admin admin] RBAC: Authorizing `identity:delete_project(project_id=7921ff592fc545bebb87b18429cc1287)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:07.226985 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b398f51-ed13-4dde-85f3-b0605e91fcbc admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:07.328497 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-9b398f51-ed13-4dde-85f3-b0605e91fcbc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7921ff592fc545bebb87b18429cc1287', 'request_id': 'req-9b398f51-ed13-4dde-85f3-b0605e91fcbc'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:07.336567 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-9b398f51-ed13-4dde-85f3-b0605e91fcbc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7921ff592fc545bebb87b18429cc1287', 'request_id': 'req-9b398f51-ed13-4dde-85f3-b0605e91fcbc'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:07.349892 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-9b398f51-ed13-4dde-85f3-b0605e91fcbc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7921ff592fc545bebb87b18429cc1287', 'request_id': 'req-9b398f51-ed13-4dde-85f3-b0605e91fcbc'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:07.363640 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-9b398f51-ed13-4dde-85f3-b0605e91fcbc admin admin] The token cache is being invalidate because project 7921ff592fc545bebb87b18429cc1287 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81446) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 16:33:07.364018 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-9b398f51-ed13-4dde-85f3-b0605e91fcbc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:07.364746 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-9b398f51-ed13-4dde-85f3-b0605e91fcbc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:07.366619 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1096/2172] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 16:33:07 2022] DELETE /identity/v3/projects/7921ff592fc545bebb87b18429cc1287 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:33:07.370868 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215479cd-cd38-4797-9ee2-957da38a3283 service neutron] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:07.381078 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215479cd-cd38-4797-9ee2-957da38a3283 service neutron] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:07.444285 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993949dd-8314-46aa-84f3-9e7f3427534e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:07.444961 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993949dd-8314-46aa-84f3-9e7f3427534e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:07.445243 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993949dd-8314-46aa-84f3-9e7f3427534e admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:07.445515 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993949dd-8314-46aa-84f3-9e7f3427534e admin admin] PATH_INFO: `/v3/users/36d9f8cab81c43cc8a176db2e78dda36` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:07.446908 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993949dd-8314-46aa-84f3-9e7f3427534e admin admin] RBAC: Authorizing `identity:delete_user(user_id=36d9f8cab81c43cc8a176db2e78dda36)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:07.448862 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993949dd-8314-46aa-84f3-9e7f3427534e admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:07.500560 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-993949dd-8314-46aa-84f3-9e7f3427534e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36d9f8cab81c43cc8a176db2e78dda36'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:07.508564 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-993949dd-8314-46aa-84f3-9e7f3427534e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36d9f8cab81c43cc8a176db2e78dda36'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:07.513030 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-993949dd-8314-46aa-84f3-9e7f3427534e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36d9f8cab81c43cc8a176db2e78dda36'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:07.521511 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-993949dd-8314-46aa-84f3-9e7f3427534e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36d9f8cab81c43cc8a176db2e78dda36'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:07.534556 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-993949dd-8314-46aa-84f3-9e7f3427534e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36d9f8cab81c43cc8a176db2e78dda36'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:07.540715 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1077/2173] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 16:33:07 2022] DELETE /identity/v3/users/36d9f8cab81c43cc8a176db2e78dda36 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 16:33:07.864398 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b398f51-ed13-4dde-85f3-b0605e91fcbc admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:07.867070 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-9b398f51-ed13-4dde-85f3-b0605e91fcbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:07.886711 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b398f51-ed13-4dde-85f3-b0605e91fcbc admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:07.952944 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:33:07.978439 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8225f5c6-ea2a-41e3-8e6b-e4150b4f86b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:07.979063 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8225f5c6-ea2a-41e3-8e6b-e4150b4f86b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:07.979343 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8225f5c6-ea2a-41e3-8e6b-e4150b4f86b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:07.979643 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8225f5c6-ea2a-41e3-8e6b-e4150b4f86b4 admin admin] PATH_INFO: `/v3/projects/252e09743b8344fc93bad1e14878b271` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:07.982980 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8225f5c6-ea2a-41e3-8e6b-e4150b4f86b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=252e09743b8344fc93bad1e14878b271)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:07.983792 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8225f5c6-ea2a-41e3-8e6b-e4150b4f86b4 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:08.056991 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-8225f5c6-ea2a-41e3-8e6b-e4150b4f86b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '252e09743b8344fc93bad1e14878b271', 'request_id': 'req-8225f5c6-ea2a-41e3-8e6b-e4150b4f86b4'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:08.066879 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-8225f5c6-ea2a-41e3-8e6b-e4150b4f86b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '252e09743b8344fc93bad1e14878b271', 'request_id': 'req-8225f5c6-ea2a-41e3-8e6b-e4150b4f86b4'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:08.081943 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-8225f5c6-ea2a-41e3-8e6b-e4150b4f86b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '252e09743b8344fc93bad1e14878b271', 'request_id': 'req-8225f5c6-ea2a-41e3-8e6b-e4150b4f86b4'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:08.102720 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-8225f5c6-ea2a-41e3-8e6b-e4150b4f86b4 admin admin] The token cache is being invalidate because project 252e09743b8344fc93bad1e14878b271 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81446) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 16:33:08.103242 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-8225f5c6-ea2a-41e3-8e6b-e4150b4f86b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:08.103525 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993949dd-8314-46aa-84f3-9e7f3427534e admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:08.104921 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-8225f5c6-ea2a-41e3-8e6b-e4150b4f86b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:08.105048 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-993949dd-8314-46aa-84f3-9e7f3427534e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:08.107063 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1097/2174] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 16:33:07 2022] DELETE /identity/v3/projects/252e09743b8344fc93bad1e14878b271 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:33:08.111825 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ac90f4-1ada-46ef-9c48-428b81e9c446 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:08.112179 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ac90f4-1ada-46ef-9c48-428b81e9c446 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:08.112577 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ac90f4-1ada-46ef-9c48-428b81e9c446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:08.122090 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:33:08.130952 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993949dd-8314-46aa-84f3-9e7f3427534e admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:08.135477 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-d3ac90f4-1ada-46ef-9c48-428b81e9c446 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:33:08.136795 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-d3ac90f4-1ada-46ef-9c48-428b81e9c446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:08.214876 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1098/2175] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:33:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 16:33:08.222859 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e951e3-6164-4021-b22b-ec5b30c0ba5f None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:08.223294 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e951e3-6164-4021-b22b-ec5b30c0ba5f None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:08.223704 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e951e3-6164-4021-b22b-ec5b30c0ba5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:08.234339 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b908d4-d68c-4da0-9d2b-e4ec234cdb2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:08.235144 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b908d4-d68c-4da0-9d2b-e4ec234cdb2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:08.235729 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b908d4-d68c-4da0-9d2b-e4ec234cdb2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:08.236076 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b908d4-d68c-4da0-9d2b-e4ec234cdb2d admin admin] PATH_INFO: `/v3/users/44588dd50c5541e0a595ed6a11939d30` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:08.237588 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b908d4-d68c-4da0-9d2b-e4ec234cdb2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=44588dd50c5541e0a595ed6a11939d30)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:08.240272 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b908d4-d68c-4da0-9d2b-e4ec234cdb2d admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:08.246235 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-a2e951e3-6164-4021-b22b-ec5b30c0ba5f None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:33:08.248465 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-a2e951e3-6164-4021-b22b-ec5b30c0ba5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:08.261361 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1099/2176] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:33:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:33:08.265467 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e951e3-6164-4021-b22b-ec5b30c0ba5f None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:08.275193 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e951e3-6164-4021-b22b-ec5b30c0ba5f None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:08.296197 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d932e103-cf61-4a0b-8c0f-12ed1cd7fdba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:08.302521 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d932e103-cf61-4a0b-8c0f-12ed1cd7fdba admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:08.302521 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d932e103-cf61-4a0b-8c0f-12ed1cd7fdba admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:08.302521 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d932e103-cf61-4a0b-8c0f-12ed1cd7fdba admin admin] PATH_INFO: `/v3/domains` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:08.302521 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d932e103-cf61-4a0b-8c0f-12ed1cd7fdba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:33:08.302521 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d932e103-cf61-4a0b-8c0f-12ed1cd7fdba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:08.303091 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d932e103-cf61-4a0b-8c0f-12ed1cd7fdba admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:08.322559 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1100/2177] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Sep 9 16:33:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 16:33:08.327913 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d932e103-cf61-4a0b-8c0f-12ed1cd7fdba admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:08.336187 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-42b908d4-d68c-4da0-9d2b-e4ec234cdb2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44588dd50c5541e0a595ed6a11939d30'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:08.347332 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d932e103-cf61-4a0b-8c0f-12ed1cd7fdba admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:08.348261 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-42b908d4-d68c-4da0-9d2b-e4ec234cdb2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44588dd50c5541e0a595ed6a11939d30'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:08.349323 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-42b908d4-d68c-4da0-9d2b-e4ec234cdb2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44588dd50c5541e0a595ed6a11939d30'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:08.354624 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b50ba3-7511-431c-886e-610347424809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:08.355365 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b50ba3-7511-431c-886e-610347424809 admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:08.355767 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b50ba3-7511-431c-886e-610347424809 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:08.356142 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b50ba3-7511-431c-886e-610347424809 admin admin] PATH_INFO: `/v3/projects` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:08.358758 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b50ba3-7511-431c-886e-610347424809 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:08.361137 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b50ba3-7511-431c-886e-610347424809 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:08.368169 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-42b908d4-d68c-4da0-9d2b-e4ec234cdb2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44588dd50c5541e0a595ed6a11939d30'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:08.396498 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-42b908d4-d68c-4da0-9d2b-e4ec234cdb2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44588dd50c5541e0a595ed6a11939d30'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:08.406342 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1101/2178] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 16:33:08 2022] POST /identity/v3/projects => generated 385 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:33:08.413047 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b50ba3-7511-431c-886e-610347424809 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:08.414011 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1078/2179] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 16:33:08 2022] DELETE /identity/v3/users/44588dd50c5541e0a595ed6a11939d30 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 16:33:08.414991 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-d9b50ba3-7511-431c-886e-610347424809 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:08.418352 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352ba520-594b-4703-81ca-efb9eed30f6e None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:08.418787 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352ba520-594b-4703-81ca-efb9eed30f6e None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:08.419121 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352ba520-594b-4703-81ca-efb9eed30f6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:08.445576 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-352ba520-594b-4703-81ca-efb9eed30f6e None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:33:08.447118 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-352ba520-594b-4703-81ca-efb9eed30f6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:08.489846 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:33:08.541575 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1079/2180] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:33:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:33:08.553437 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352ba520-594b-4703-81ca-efb9eed30f6e None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:08.553831 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b50ba3-7511-431c-886e-610347424809 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:08.555349 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-352ba520-594b-4703-81ca-efb9eed30f6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:08.560406 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ef3a8d-3d01-4c62-84bd-d83e6687ae05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:08.561370 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ef3a8d-3d01-4c62-84bd-d83e6687ae05 admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:08.561730 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ef3a8d-3d01-4c62-84bd-d83e6687ae05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:08.562184 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ef3a8d-3d01-4c62-84bd-d83e6687ae05 admin admin] PATH_INFO: `/v3/users` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:08.563586 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ef3a8d-3d01-4c62-84bd-d83e6687ae05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:08.565604 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ef3a8d-3d01-4c62-84bd-d83e6687ae05 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:08.592810 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1102/2181] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 16:33:08 2022] POST /identity/v3/users => generated 293 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:33:08.598220 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ef3a8d-3d01-4c62-84bd-d83e6687ae05 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:08.619918 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ef3a8d-3d01-4c62-84bd-d83e6687ae05 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:08.631557 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:33:08.636080 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b5164a-273a-4bb0-b3e1-445ee9f9af26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:08.636746 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b5164a-273a-4bb0-b3e1-445ee9f9af26 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:08.637029 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b5164a-273a-4bb0-b3e1-445ee9f9af26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:08.637302 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b5164a-273a-4bb0-b3e1-445ee9f9af26 admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:08.638592 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b5164a-273a-4bb0-b3e1-445ee9f9af26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:08.640070 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b5164a-273a-4bb0-b3e1-445ee9f9af26 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:08.655892 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1103/2182] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:33:08 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 16:33:08.657391 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b5164a-273a-4bb0-b3e1-445ee9f9af26 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:08.679061 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b5164a-273a-4bb0-b3e1-445ee9f9af26 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:08.690750 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352ba520-594b-4703-81ca-efb9eed30f6e None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:08.705505 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfe934a-83bb-4ec3-8222-0d1dce30bff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:08.706613 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfe934a-83bb-4ec3-8222-0d1dce30bff1 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:08.706831 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5469a0c-a7dc-4dff-b842-5fc7113d1413 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f44bfdd5214e8d84a2c0a5b1fd9b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:08.707140 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfe934a-83bb-4ec3-8222-0d1dce30bff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:08.707600 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfe934a-83bb-4ec3-8222-0d1dce30bff1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:08.708012 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5469a0c-a7dc-4dff-b842-5fc7113d1413 service neutron] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:08.708273 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfe934a-83bb-4ec3-8222-0d1dce30bff1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:08.708482 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5469a0c-a7dc-4dff-b842-5fc7113d1413 service neutron] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:08.709088 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5469a0c-a7dc-4dff-b842-5fc7113d1413 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:08.710770 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfe934a-83bb-4ec3-8222-0d1dce30bff1 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:08.725480 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5469a0c-a7dc-4dff-b842-5fc7113d1413 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:08.727463 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5469a0c-a7dc-4dff-b842-5fc7113d1413 service neutron] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:08.736948 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1104/2183] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:33:08 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 16:33:08.737871 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfe934a-83bb-4ec3-8222-0d1dce30bff1 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:08.742044 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1080/2184] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:33:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:33:08.758358 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfe934a-83bb-4ec3-8222-0d1dce30bff1 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:08.764477 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2089e6b0-9c65-47d9-ba05-e171e483836a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:08.765323 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2089e6b0-9c65-47d9-ba05-e171e483836a admin admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:08.765455 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2089e6b0-9c65-47d9-ba05-e171e483836a admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:08.767351 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2089e6b0-9c65-47d9-ba05-e171e483836a admin admin] PATH_INFO: `/v3/projects/beea6b366cdb49fe9f2d05d01ae7fc59/users/b2ade90cbf8d4c898dcca7ffcc4f8494/roles/b38e84bf077846ee802e6bb1bad83522` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:08.789525 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2089e6b0-9c65-47d9-ba05-e171e483836a admin admin] RBAC: Authorizing `identity:create_grant(project_id=beea6b366cdb49fe9f2d05d01ae7fc59, user_id=b2ade90cbf8d4c898dcca7ffcc4f8494, role_id=b38e84bf077846ee802e6bb1bad83522)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:08.793576 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2089e6b0-9c65-47d9-ba05-e171e483836a admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:08.827862 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1105/2185] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 16:33:08 2022] PUT /identity/v3/projects/beea6b366cdb49fe9f2d05d01ae7fc59/users/b2ade90cbf8d4c898dcca7ffcc4f8494/roles/b38e84bf077846ee802e6bb1bad83522 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:33:08.830400 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957f0004-9496-4ecf-a311-48729f786ac0 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:08.831386 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957f0004-9496-4ecf-a311-48729f786ac0 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:08.832546 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957f0004-9496-4ecf-a311-48729f786ac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:08.878727 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-957f0004-9496-4ecf-a311-48729f786ac0 None None] MFA Rules not processed for user `b2ade90cbf8d4c898dcca7ffcc4f8494`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:33:08.879974 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-957f0004-9496-4ecf-a311-48729f786ac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:08.960093 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1081/2186] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:33:08 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:33:08.964510 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2089e6b0-9c65-47d9-ba05-e171e483836a admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:09.040878 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2089e6b0-9c65-47d9-ba05-e171e483836a admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:09.046155 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5515051e-0534-45be-b41d-976ffd751050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:09.046805 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5515051e-0534-45be-b41d-976ffd751050 admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:09.047083 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5515051e-0534-45be-b41d-976ffd751050 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:09.047355 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5515051e-0534-45be-b41d-976ffd751050 admin admin] PATH_INFO: `/v3/projects` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:09.048478 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5515051e-0534-45be-b41d-976ffd751050 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:09.050109 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5515051e-0534-45be-b41d-976ffd751050 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:09.082721 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1106/2187] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 16:33:08 2022] POST /identity/v3/projects => generated 387 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:33:09.086996 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957f0004-9496-4ecf-a311-48729f786ac0 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:09.103711 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957f0004-9496-4ecf-a311-48729f786ac0 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:09.104883 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5515051e-0534-45be-b41d-976ffd751050 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:09.107001 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-5515051e-0534-45be-b41d-976ffd751050 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:09.192887 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5515051e-0534-45be-b41d-976ffd751050 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:09.195448 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5bf6af-faac-4432-9085-3ebe2e890c02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:09.196074 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5bf6af-faac-4432-9085-3ebe2e890c02 admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:09.196350 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5bf6af-faac-4432-9085-3ebe2e890c02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:09.196619 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5bf6af-faac-4432-9085-3ebe2e890c02 admin admin] PATH_INFO: `/v3/users` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:09.197375 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5bf6af-faac-4432-9085-3ebe2e890c02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:09.198182 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6ffee9-3cc9-40d5-9023-1063efc3f67e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:09.198837 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6ffee9-3cc9-40d5-9023-1063efc3f67e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:09.199116 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6ffee9-3cc9-40d5-9023-1063efc3f67e admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:09.199386 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6ffee9-3cc9-40d5-9023-1063efc3f67e admin admin] PATH_INFO: `/v3/projects/5d6acd144f2f4d79a460916316c878da` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:09.199767 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5bf6af-faac-4432-9085-3ebe2e890c02 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:09.201218 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6ffee9-3cc9-40d5-9023-1063efc3f67e admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d6acd144f2f4d79a460916316c878da)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:09.203213 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6ffee9-3cc9-40d5-9023-1063efc3f67e admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:09.210323 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:33:09.233492 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1082/2188] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 16:33:09 2022] POST /identity/v3/users => generated 300 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:33:09.237187 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5bf6af-faac-4432-9085-3ebe2e890c02 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:09.248117 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5bf6af-faac-4432-9085-3ebe2e890c02 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:09.266870 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-8e6ffee9-3cc9-40d5-9023-1063efc3f67e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d6acd144f2f4d79a460916316c878da', 'request_id': 'req-8e6ffee9-3cc9-40d5-9023-1063efc3f67e'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:09.282156 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-8e6ffee9-3cc9-40d5-9023-1063efc3f67e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d6acd144f2f4d79a460916316c878da', 'request_id': 'req-8e6ffee9-3cc9-40d5-9023-1063efc3f67e'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:09.294648 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-8e6ffee9-3cc9-40d5-9023-1063efc3f67e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d6acd144f2f4d79a460916316c878da', 'request_id': 'req-8e6ffee9-3cc9-40d5-9023-1063efc3f67e'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:09.307386 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:33:09.307726 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-8e6ffee9-3cc9-40d5-9023-1063efc3f67e admin admin] The token cache is being invalidate because project 5d6acd144f2f4d79a460916316c878da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81446) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 16:33:09.308025 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-8e6ffee9-3cc9-40d5-9023-1063efc3f67e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:09.309084 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-8e6ffee9-3cc9-40d5-9023-1063efc3f67e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:09.312037 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1107/2189] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 16:33:09 2022] DELETE /identity/v3/projects/5d6acd144f2f4d79a460916316c878da => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:33:09.316697 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6ffee9-3cc9-40d5-9023-1063efc3f67e admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:09.320004 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-8e6ffee9-3cc9-40d5-9023-1063efc3f67e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:09.327957 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206ad10a-497d-43cb-90a8-affe5871f23d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:09.329116 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206ad10a-497d-43cb-90a8-affe5871f23d admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:09.329493 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206ad10a-497d-43cb-90a8-affe5871f23d admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:09.329775 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206ad10a-497d-43cb-90a8-affe5871f23d admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:09.330693 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206ad10a-497d-43cb-90a8-affe5871f23d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:09.332372 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206ad10a-497d-43cb-90a8-affe5871f23d admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:09.347539 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1083/2190] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:33:09 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 16:33:09.348859 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206ad10a-497d-43cb-90a8-affe5871f23d admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:09.351412 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-206ad10a-497d-43cb-90a8-affe5871f23d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:09.368745 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206ad10a-497d-43cb-90a8-affe5871f23d admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:09.373523 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6249656-7f8e-48f3-b010-7f2a59a0a54b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:09.374230 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6249656-7f8e-48f3-b010-7f2a59a0a54b admin admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:09.374544 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6249656-7f8e-48f3-b010-7f2a59a0a54b admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:09.374837 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6249656-7f8e-48f3-b010-7f2a59a0a54b admin admin] PATH_INFO: `/v3/projects/5b2fdff2af2c45d2b84d7388514f41fd/users/599bcd10e6d24c8c97c2037ea11f70a4/roles/0a36d1be416f4089be19be979943b731` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:09.392619 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6249656-7f8e-48f3-b010-7f2a59a0a54b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b2fdff2af2c45d2b84d7388514f41fd, user_id=599bcd10e6d24c8c97c2037ea11f70a4, role_id=0a36d1be416f4089be19be979943b731)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:09.395866 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6249656-7f8e-48f3-b010-7f2a59a0a54b admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:09.407019 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6ffee9-3cc9-40d5-9023-1063efc3f67e admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:09.417649 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1084/2191] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 16:33:09 2022] PUT /identity/v3/projects/5b2fdff2af2c45d2b84d7388514f41fd/users/599bcd10e6d24c8c97c2037ea11f70a4/roles/0a36d1be416f4089be19be979943b731 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 16:33:09.418909 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6249656-7f8e-48f3-b010-7f2a59a0a54b admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:09.494767 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c5ddcc-1f42-4ada-92b2-07f5aebdcc3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:09.495433 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c5ddcc-1f42-4ada-92b2-07f5aebdcc3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:09.495717 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c5ddcc-1f42-4ada-92b2-07f5aebdcc3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:09.496011 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c5ddcc-1f42-4ada-92b2-07f5aebdcc3f admin admin] PATH_INFO: `/v3/users/dcc80e5c427f4cb6af57a281ba8b1879` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:09.496613 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6249656-7f8e-48f3-b010-7f2a59a0a54b admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:09.497814 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c5ddcc-1f42-4ada-92b2-07f5aebdcc3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=dcc80e5c427f4cb6af57a281ba8b1879)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:09.499927 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c5ddcc-1f42-4ada-92b2-07f5aebdcc3f admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:09.503868 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a08225-dc08-46a4-beea-cee18dc6e840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:09.504733 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a08225-dc08-46a4-beea-cee18dc6e840 admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:09.505162 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a08225-dc08-46a4-beea-cee18dc6e840 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:09.505601 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a08225-dc08-46a4-beea-cee18dc6e840 admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:09.506600 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a08225-dc08-46a4-beea-cee18dc6e840 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:09.509444 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a08225-dc08-46a4-beea-cee18dc6e840 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:09.524689 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1085/2192] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:33:09 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 16:33:09.528841 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a08225-dc08-46a4-beea-cee18dc6e840 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:09.541483 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a08225-dc08-46a4-beea-cee18dc6e840 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:09.547360 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a00c3a1-dc19-41ef-a528-32deea615f00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:09.548161 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a00c3a1-dc19-41ef-a528-32deea615f00 admin admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:09.548504 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a00c3a1-dc19-41ef-a528-32deea615f00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:09.548867 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a00c3a1-dc19-41ef-a528-32deea615f00 admin admin] PATH_INFO: `/v3/projects/5b2fdff2af2c45d2b84d7388514f41fd/users/599bcd10e6d24c8c97c2037ea11f70a4/roles/0a36d1be416f4089be19be979943b731` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:09.551009 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a00c3a1-dc19-41ef-a528-32deea615f00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b2fdff2af2c45d2b84d7388514f41fd, user_id=599bcd10e6d24c8c97c2037ea11f70a4, role_id=0a36d1be416f4089be19be979943b731)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:09.553892 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a00c3a1-dc19-41ef-a528-32deea615f00 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:09.563200 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:33:09.569836 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-08c5ddcc-1f42-4ada-92b2-07f5aebdcc3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dcc80e5c427f4cb6af57a281ba8b1879'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:09.575313 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1086/2193] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 16:33:09 2022] PUT /identity/v3/projects/5b2fdff2af2c45d2b84d7388514f41fd/users/599bcd10e6d24c8c97c2037ea11f70a4/roles/0a36d1be416f4089be19be979943b731 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 16:33:09.580477 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-08c5ddcc-1f42-4ada-92b2-07f5aebdcc3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dcc80e5c427f4cb6af57a281ba8b1879'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:09.586885 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f8b21a-2d15-4f03-9b42-636c57af3c9c None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:09.587178 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f8b21a-2d15-4f03-9b42-636c57af3c9c None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:09.587487 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f8b21a-2d15-4f03-9b42-636c57af3c9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:09.595141 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-08c5ddcc-1f42-4ada-92b2-07f5aebdcc3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dcc80e5c427f4cb6af57a281ba8b1879'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:09.609782 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-08c5ddcc-1f42-4ada-92b2-07f5aebdcc3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dcc80e5c427f4cb6af57a281ba8b1879'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:09.611103 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-08c5ddcc-1f42-4ada-92b2-07f5aebdcc3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dcc80e5c427f4cb6af57a281ba8b1879'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:09.622166 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-27f8b21a-2d15-4f03-9b42-636c57af3c9c None None] MFA Rules not processed for user `599bcd10e6d24c8c97c2037ea11f70a4`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:33:09.623385 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1108/2194] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 16:33:09 2022] DELETE /identity/v3/users/dcc80e5c427f4cb6af57a281ba8b1879 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 16:33:09.623986 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-27f8b21a-2d15-4f03-9b42-636c57af3c9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:09.726475 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1087/2195] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:33:09 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 16:33:09.737134 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c5ddcc-1f42-4ada-92b2-07f5aebdcc3f admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:09.738662 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-08c5ddcc-1f42-4ada-92b2-07f5aebdcc3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:09.808473 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c5ddcc-1f42-4ada-92b2-07f5aebdcc3f admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:09.835280 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d265b6-376a-4c7b-87cc-4b1454faf468 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8078e791ba68460f8b3aeafb4b79b73a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:09.837696 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d265b6-376a-4c7b-87cc-4b1454faf468 service cinder] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:09.838523 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d265b6-376a-4c7b-87cc-4b1454faf468 service cinder] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:09.840471 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d265b6-376a-4c7b-87cc-4b1454faf468 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:09.865620 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d265b6-376a-4c7b-87cc-4b1454faf468 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:09.867093 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d265b6-376a-4c7b-87cc-4b1454faf468 service cinder] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:09.878764 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1109/2196] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:33:09 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:33:09.944190 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f8b21a-2d15-4f03-9b42-636c57af3c9c None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:09.945648 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-27f8b21a-2d15-4f03-9b42-636c57af3c9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:10.000197 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:33:10.064896 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f8b21a-2d15-4f03-9b42-636c57af3c9c None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:10.070131 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63942ebd-cbcd-4be0-b212-db55131c2bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:10.070821 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63942ebd-cbcd-4be0-b212-db55131c2bf8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:10.071102 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63942ebd-cbcd-4be0-b212-db55131c2bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:10.071377 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63942ebd-cbcd-4be0-b212-db55131c2bf8 admin admin] PATH_INFO: `/v3/users/ceddde89c72747d784316e7b2fb44d19` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:10.072606 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63942ebd-cbcd-4be0-b212-db55131c2bf8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ceddde89c72747d784316e7b2fb44d19)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:10.074895 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63942ebd-cbcd-4be0-b212-db55131c2bf8 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:10.164047 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-63942ebd-cbcd-4be0-b212-db55131c2bf8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ceddde89c72747d784316e7b2fb44d19'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:10.176884 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-63942ebd-cbcd-4be0-b212-db55131c2bf8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ceddde89c72747d784316e7b2fb44d19'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:10.177706 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-63942ebd-cbcd-4be0-b212-db55131c2bf8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ceddde89c72747d784316e7b2fb44d19'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:10.186481 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-63942ebd-cbcd-4be0-b212-db55131c2bf8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ceddde89c72747d784316e7b2fb44d19'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:10.224527 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-63942ebd-cbcd-4be0-b212-db55131c2bf8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ceddde89c72747d784316e7b2fb44d19'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:10.224706 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d265b6-376a-4c7b-87cc-4b1454faf468 service cinder] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:10.226390 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-49d265b6-376a-4c7b-87cc-4b1454faf468 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:10.232634 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1088/2197] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 16:33:09 2022] DELETE /identity/v3/users/ceddde89c72747d784316e7b2fb44d19 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 16:33:10.237392 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165da837-1367-41dd-8254-28851e528f18 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:10.237675 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165da837-1367-41dd-8254-28851e528f18 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:10.237950 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165da837-1367-41dd-8254-28851e528f18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:10.249446 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d265b6-376a-4c7b-87cc-4b1454faf468 service cinder] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:10.272230 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-165da837-1367-41dd-8254-28851e528f18 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:33:10.273632 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-165da837-1367-41dd-8254-28851e528f18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:10.373912 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820970a1-5f38-4a2c-af35-80eb36653319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:10.374980 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820970a1-5f38-4a2c-af35-80eb36653319 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:10.375441 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820970a1-5f38-4a2c-af35-80eb36653319 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:10.375901 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820970a1-5f38-4a2c-af35-80eb36653319 admin admin] PATH_INFO: `/v3/projects/24acf4ac92714234bb6dfba2e861b94f` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:10.378806 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1089/2198] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:33:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 16:33:10.379319 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820970a1-5f38-4a2c-af35-80eb36653319 admin admin] RBAC: Authorizing `identity:delete_project(project_id=24acf4ac92714234bb6dfba2e861b94f)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:10.382275 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820970a1-5f38-4a2c-af35-80eb36653319 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:10.389263 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165da837-1367-41dd-8254-28851e528f18 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:10.391557 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-165da837-1367-41dd-8254-28851e528f18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:10.457463 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-820970a1-5f38-4a2c-af35-80eb36653319 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24acf4ac92714234bb6dfba2e861b94f', 'request_id': 'req-820970a1-5f38-4a2c-af35-80eb36653319'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:10.468855 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-820970a1-5f38-4a2c-af35-80eb36653319 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24acf4ac92714234bb6dfba2e861b94f', 'request_id': 'req-820970a1-5f38-4a2c-af35-80eb36653319'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:10.475240 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:33:10.480486 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-820970a1-5f38-4a2c-af35-80eb36653319 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24acf4ac92714234bb6dfba2e861b94f', 'request_id': 'req-820970a1-5f38-4a2c-af35-80eb36653319'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:10.491329 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:33:10.491638 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165da837-1367-41dd-8254-28851e528f18 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:10.509733 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-820970a1-5f38-4a2c-af35-80eb36653319 admin admin] The token cache is being invalidate because project 24acf4ac92714234bb6dfba2e861b94f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81446) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 16:33:10.509733 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-820970a1-5f38-4a2c-af35-80eb36653319 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:10.509733 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-820970a1-5f38-4a2c-af35-80eb36653319 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:10.509733 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1110/2199] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 16:33:10 2022] DELETE /identity/v3/projects/24acf4ac92714234bb6dfba2e861b94f => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 16:33:10.526454 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6debd2a1-500f-4834-96fb-873393a2738a None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:10.526454 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6debd2a1-500f-4834-96fb-873393a2738a None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:10.526871 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6debd2a1-500f-4834-96fb-873393a2738a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:10.557184 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-6debd2a1-500f-4834-96fb-873393a2738a None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:33:10.559219 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-6debd2a1-500f-4834-96fb-873393a2738a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:10.574072 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da83409b-4888-4452-a685-2fe7f1def249 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f44bfdd5214e8d84a2c0a5b1fd9b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:10.574820 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da83409b-4888-4452-a685-2fe7f1def249 service neutron] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:10.575159 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da83409b-4888-4452-a685-2fe7f1def249 service neutron] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:10.576181 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da83409b-4888-4452-a685-2fe7f1def249 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:10.578052 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-da83409b-4888-4452-a685-2fe7f1def249 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:10.681973 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da83409b-4888-4452-a685-2fe7f1def249 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:10.684004 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da83409b-4888-4452-a685-2fe7f1def249 service neutron] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:10.687021 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1111/2200] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:33:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:33:10.695725 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c1c6d7-a805-4410-a209-d5501dda9a1c None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:10.696184 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c1c6d7-a805-4410-a209-d5501dda9a1c None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:10.696778 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c1c6d7-a805-4410-a209-d5501dda9a1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:10.700510 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1090/2201] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:33:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:33:10.718460 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-38c1c6d7-a805-4410-a209-d5501dda9a1c None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:33:10.719686 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-38c1c6d7-a805-4410-a209-d5501dda9a1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:10.732222 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1112/2202] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:33:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:33:10.738783 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da83409b-4888-4452-a685-2fe7f1def249 service neutron] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:10.749249 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da83409b-4888-4452-a685-2fe7f1def249 service neutron] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:10.756671 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2000c9-5694-42aa-8d45-7326c4b158c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:10.757282 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c1c6d7-a805-4410-a209-d5501dda9a1c None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:10.757436 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2000c9-5694-42aa-8d45-7326c4b158c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:10.758195 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2000c9-5694-42aa-8d45-7326c4b158c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:10.758195 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2000c9-5694-42aa-8d45-7326c4b158c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:10.758575 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2000c9-5694-42aa-8d45-7326c4b158c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:33:10.758876 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2000c9-5694-42aa-8d45-7326c4b158c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:10.761051 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-38c1c6d7-a805-4410-a209-d5501dda9a1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:10.765045 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2000c9-5694-42aa-8d45-7326c4b158c7 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:10.778037 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c1c6d7-a805-4410-a209-d5501dda9a1c None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:10.779285 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1091/2203] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Sep 9 16:33:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:33:10.783752 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2000c9-5694-42aa-8d45-7326c4b158c7 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:10.788088 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0575406-0cb7-4983-bfd9-586e74546916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:10.788716 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0575406-0cb7-4983-bfd9-586e74546916 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:10.789140 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0575406-0cb7-4983-bfd9-586e74546916 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:10.789412 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0575406-0cb7-4983-bfd9-586e74546916 admin admin] PATH_INFO: `/v3/users/b2ade90cbf8d4c898dcca7ffcc4f8494` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:10.790678 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0575406-0cb7-4983-bfd9-586e74546916 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2ade90cbf8d4c898dcca7ffcc4f8494)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:10.792758 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0575406-0cb7-4983-bfd9-586e74546916 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:10.798982 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2000c9-5694-42aa-8d45-7326c4b158c7 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:10.805555 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf08a89-7190-4c44-ba59-6683c0fdcdee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:10.806505 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf08a89-7190-4c44-ba59-6683c0fdcdee admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:10.806787 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf08a89-7190-4c44-ba59-6683c0fdcdee admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:10.807055 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf08a89-7190-4c44-ba59-6683c0fdcdee admin admin] PATH_INFO: `/v3/projects` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:10.807677 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf08a89-7190-4c44-ba59-6683c0fdcdee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:10.809629 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf08a89-7190-4c44-ba59-6683c0fdcdee admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:10.851093 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1092/2204] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 16:33:10 2022] POST /identity/v3/projects => generated 383 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 16:33:10.855405 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf08a89-7190-4c44-ba59-6683c0fdcdee admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:10.864913 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-e0575406-0cb7-4983-bfd9-586e74546916 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2ade90cbf8d4c898dcca7ffcc4f8494'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:10.875482 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-e0575406-0cb7-4983-bfd9-586e74546916 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2ade90cbf8d4c898dcca7ffcc4f8494'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:10.896313 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-e0575406-0cb7-4983-bfd9-586e74546916 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2ade90cbf8d4c898dcca7ffcc4f8494'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:10.910145 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-e0575406-0cb7-4983-bfd9-586e74546916 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2ade90cbf8d4c898dcca7ffcc4f8494'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:10.911853 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-e0575406-0cb7-4983-bfd9-586e74546916 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2ade90cbf8d4c898dcca7ffcc4f8494'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:10.920752 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1113/2205] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 16:33:10 2022] DELETE /identity/v3/users/b2ade90cbf8d4c898dcca7ffcc4f8494 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:33:10.930089 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b73b02-9250-47d7-99d7-bcc55196fff5 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:10.930606 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b73b02-9250-47d7-99d7-bcc55196fff5 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:10.930950 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b73b02-9250-47d7-99d7-bcc55196fff5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:10.933215 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf08a89-7190-4c44-ba59-6683c0fdcdee admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:10.962023 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-f4b73b02-9250-47d7-99d7-bcc55196fff5 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:33:10.964041 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-f4b73b02-9250-47d7-99d7-bcc55196fff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:10.975729 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:33:11.040975 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cf45a2-5224-483c-adf1-9a34caa404f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:11.041621 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cf45a2-5224-483c-adf1-9a34caa404f5 admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:11.041903 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cf45a2-5224-483c-adf1-9a34caa404f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:11.042174 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cf45a2-5224-483c-adf1-9a34caa404f5 admin admin] PATH_INFO: `/v3/users` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:11.042839 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cf45a2-5224-483c-adf1-9a34caa404f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:11.045140 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cf45a2-5224-483c-adf1-9a34caa404f5 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:11.059345 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:33:11.080644 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1114/2206] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:33:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:33:11.082906 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1093/2207] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 16:33:10 2022] POST /identity/v3/users => generated 292 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 16:33:11.087217 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b73b02-9250-47d7-99d7-bcc55196fff5 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:11.088844 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-f4b73b02-9250-47d7-99d7-bcc55196fff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:11.094245 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cf45a2-5224-483c-adf1-9a34caa404f5 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:11.096398 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-30cf45a2-5224-483c-adf1-9a34caa404f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:11.101993 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b73b02-9250-47d7-99d7-bcc55196fff5 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:11.109404 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a76ff91-6cc5-4e75-b139-894b76429227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:11.110294 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a76ff91-6cc5-4e75-b139-894b76429227 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:11.110665 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a76ff91-6cc5-4e75-b139-894b76429227 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:11.110944 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a76ff91-6cc5-4e75-b139-894b76429227 admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:11.111586 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a76ff91-6cc5-4e75-b139-894b76429227 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:11.113593 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a76ff91-6cc5-4e75-b139-894b76429227 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:11.130340 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1115/2208] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:33:11 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:33:11.134375 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a76ff91-6cc5-4e75-b139-894b76429227 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:11.154025 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a76ff91-6cc5-4e75-b139-894b76429227 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:11.160438 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca266675-b5d8-4704-b393-d1848c13af53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:11.161502 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca266675-b5d8-4704-b393-d1848c13af53 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:11.161838 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca266675-b5d8-4704-b393-d1848c13af53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:11.162534 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca266675-b5d8-4704-b393-d1848c13af53 admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:11.163446 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca266675-b5d8-4704-b393-d1848c13af53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:11.165215 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca266675-b5d8-4704-b393-d1848c13af53 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:11.183073 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cf45a2-5224-483c-adf1-9a34caa404f5 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:11.190868 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1116/2209] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:33:11 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:33:11.194362 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8410e234-c597-4f97-abfe-3b20460b59b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f44bfdd5214e8d84a2c0a5b1fd9b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:11.195643 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8410e234-c597-4f97-abfe-3b20460b59b8 service neutron] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:11.195918 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8410e234-c597-4f97-abfe-3b20460b59b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:11.196180 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8410e234-c597-4f97-abfe-3b20460b59b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:11.196919 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca266675-b5d8-4704-b393-d1848c13af53 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:11.198563 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-ca266675-b5d8-4704-b393-d1848c13af53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:11.206182 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8410e234-c597-4f97-abfe-3b20460b59b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:11.207721 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8410e234-c597-4f97-abfe-3b20460b59b8 service neutron] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:11.211070 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca266675-b5d8-4704-b393-d1848c13af53 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:11.218937 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1094/2210] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:33:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:33:11.219760 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8410e234-c597-4f97-abfe-3b20460b59b8 service neutron] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:11.221213 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7ad18b-b3c0-4f1e-ba47-164fe18ff170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:11.221880 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7ad18b-b3c0-4f1e-ba47-164fe18ff170 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:11.222221 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7ad18b-b3c0-4f1e-ba47-164fe18ff170 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:11.222563 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7ad18b-b3c0-4f1e-ba47-164fe18ff170 admin admin] PATH_INFO: `/v3/projects/85fd5a6a43d249198db3c83820656204` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:11.223693 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7ad18b-b3c0-4f1e-ba47-164fe18ff170 admin admin] RBAC: Authorizing `identity:delete_project(project_id=85fd5a6a43d249198db3c83820656204)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:11.226342 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7ad18b-b3c0-4f1e-ba47-164fe18ff170 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:11.230326 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8410e234-c597-4f97-abfe-3b20460b59b8 service neutron] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:11.235755 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634d97e2-6948-47dc-8a7d-92cefead0c63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:11.236628 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634d97e2-6948-47dc-8a7d-92cefead0c63 admin admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:11.237076 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634d97e2-6948-47dc-8a7d-92cefead0c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:11.237334 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634d97e2-6948-47dc-8a7d-92cefead0c63 admin admin] PATH_INFO: `/v3/projects/8f114d00a44d4c55b3c4e6f79b7b7d35/users/afab5b9a0ea84624b4cc35d866119c78/roles/b38e84bf077846ee802e6bb1bad83522` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:11.254160 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634d97e2-6948-47dc-8a7d-92cefead0c63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f114d00a44d4c55b3c4e6f79b7b7d35, user_id=afab5b9a0ea84624b4cc35d866119c78, role_id=b38e84bf077846ee802e6bb1bad83522)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:11.256886 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634d97e2-6948-47dc-8a7d-92cefead0c63 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:11.273846 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1095/2211] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 16:33:11 2022] PUT /identity/v3/projects/8f114d00a44d4c55b3c4e6f79b7b7d35/users/afab5b9a0ea84624b4cc35d866119c78/roles/b38e84bf077846ee802e6bb1bad83522 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:33:11.282963 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-5d7ad18b-b3c0-4f1e-ba47-164fe18ff170 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85fd5a6a43d249198db3c83820656204', 'request_id': 'req-5d7ad18b-b3c0-4f1e-ba47-164fe18ff170'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:11.285059 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f804b34a-9d25-4697-9d12-a82c0ad9a31d None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:11.285353 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f804b34a-9d25-4697-9d12-a82c0ad9a31d None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:11.285629 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f804b34a-9d25-4697-9d12-a82c0ad9a31d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:11.289765 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-5d7ad18b-b3c0-4f1e-ba47-164fe18ff170 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85fd5a6a43d249198db3c83820656204', 'request_id': 'req-5d7ad18b-b3c0-4f1e-ba47-164fe18ff170'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:11.299216 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-5d7ad18b-b3c0-4f1e-ba47-164fe18ff170 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85fd5a6a43d249198db3c83820656204', 'request_id': 'req-5d7ad18b-b3c0-4f1e-ba47-164fe18ff170'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:11.317078 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-5d7ad18b-b3c0-4f1e-ba47-164fe18ff170 admin admin] The token cache is being invalidate because project 85fd5a6a43d249198db3c83820656204 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81446) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 16:33:11.317672 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-5d7ad18b-b3c0-4f1e-ba47-164fe18ff170 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:11.318389 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-5d7ad18b-b3c0-4f1e-ba47-164fe18ff170 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:11.320014 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-f804b34a-9d25-4697-9d12-a82c0ad9a31d None None] MFA Rules not processed for user `afab5b9a0ea84624b4cc35d866119c78`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:33:11.323884 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1117/2212] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 16:33:11 2022] DELETE /identity/v3/projects/85fd5a6a43d249198db3c83820656204 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:33:11.324051 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-f804b34a-9d25-4697-9d12-a82c0ad9a31d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:11.325960 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e044961-16a3-44ec-8111-0a224783b400 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:11.326272 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e044961-16a3-44ec-8111-0a224783b400 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:11.327056 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e044961-16a3-44ec-8111-0a224783b400 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:11.351606 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-9e044961-16a3-44ec-8111-0a224783b400 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:33:11.353190 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-9e044961-16a3-44ec-8111-0a224783b400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:11.410791 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1096/2213] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:33:11 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:33:11.416625 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f804b34a-9d25-4697-9d12-a82c0ad9a31d None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:11.418296 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-f804b34a-9d25-4697-9d12-a82c0ad9a31d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:11.449186 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1118/2214] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:33:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:33:11.449861 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:33:11.456957 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdf40da-9e57-46d0-ae99-8a27b8e05d59 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:11.457343 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdf40da-9e57-46d0-ae99-8a27b8e05d59 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:11.457521 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdf40da-9e57-46d0-ae99-8a27b8e05d59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:11.482561 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-5cdf40da-9e57-46d0-ae99-8a27b8e05d59 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:33:11.483998 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-5cdf40da-9e57-46d0-ae99-8a27b8e05d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:11.499863 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f804b34a-9d25-4697-9d12-a82c0ad9a31d None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:11.504241 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1119/2215] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:33:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:33:11.505866 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdf40da-9e57-46d0-ae99-8a27b8e05d59 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:11.509887 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50879f7-5e55-481f-82d5-2b78bff85f8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:11.510182 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50879f7-5e55-481f-82d5-2b78bff85f8e admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:11.510516 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50879f7-5e55-481f-82d5-2b78bff85f8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:11.510788 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50879f7-5e55-481f-82d5-2b78bff85f8e admin admin] PATH_INFO: `/v3/projects` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:11.511558 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50879f7-5e55-481f-82d5-2b78bff85f8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:11.513789 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50879f7-5e55-481f-82d5-2b78bff85f8e admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:11.517957 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdf40da-9e57-46d0-ae99-8a27b8e05d59 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:11.524423 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acde557-63e3-48e3-814e-3deb189f18d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:11.525480 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acde557-63e3-48e3-814e-3deb189f18d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:11.525753 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acde557-63e3-48e3-814e-3deb189f18d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:11.526014 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acde557-63e3-48e3-814e-3deb189f18d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:11.527075 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acde557-63e3-48e3-814e-3deb189f18d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:33:11.527377 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acde557-63e3-48e3-814e-3deb189f18d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:11.529683 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acde557-63e3-48e3-814e-3deb189f18d5 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:11.551256 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1120/2216] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Sep 9 16:33:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 16:33:11.554298 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1097/2217] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 16:33:11 2022] POST /identity/v3/projects => generated 385 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:33:11.558194 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50879f7-5e55-481f-82d5-2b78bff85f8e admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:11.562827 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acde557-63e3-48e3-814e-3deb189f18d5 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:11.577822 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acde557-63e3-48e3-814e-3deb189f18d5 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:11.638789 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:33:11.665159 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4656d8c3-0f42-4b19-9733-425e4162ca52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:11.665770 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4656d8c3-0f42-4b19-9733-425e4162ca52 admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:11.666047 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4656d8c3-0f42-4b19-9733-425e4162ca52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:11.666331 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4656d8c3-0f42-4b19-9733-425e4162ca52 admin admin] PATH_INFO: `/v3/projects` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:11.666894 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50879f7-5e55-481f-82d5-2b78bff85f8e admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:11.667154 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4656d8c3-0f42-4b19-9733-425e4162ca52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:11.669987 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4656d8c3-0f42-4b19-9733-425e4162ca52 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:11.672228 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446ee3e6-1595-4672-920d-9293561f9a32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:11.672827 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446ee3e6-1595-4672-920d-9293561f9a32 admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:11.673108 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446ee3e6-1595-4672-920d-9293561f9a32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:11.673377 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446ee3e6-1595-4672-920d-9293561f9a32 admin admin] PATH_INFO: `/v3/users` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:11.673998 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446ee3e6-1595-4672-920d-9293561f9a32 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:11.675959 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446ee3e6-1595-4672-920d-9293561f9a32 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:11.698435 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1121/2218] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 16:33:11 2022] POST /identity/v3/projects => generated 369 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 16:33:11.699109 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1098/2219] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 16:33:11 2022] POST /identity/v3/users => generated 299 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:33:11.702899 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4656d8c3-0f42-4b19-9733-425e4162ca52 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:11.703073 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446ee3e6-1595-4672-920d-9293561f9a32 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:11.704712 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-4656d8c3-0f42-4b19-9733-425e4162ca52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:11.713601 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446ee3e6-1595-4672-920d-9293561f9a32 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:11.773209 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4656d8c3-0f42-4b19-9733-425e4162ca52 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:11.774453 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceb7280-0e39-42ec-89a5-2bf01e3d4402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:11.775061 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceb7280-0e39-42ec-89a5-2bf01e3d4402 admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:11.775340 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceb7280-0e39-42ec-89a5-2bf01e3d4402 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:11.775605 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceb7280-0e39-42ec-89a5-2bf01e3d4402 admin admin] PATH_INFO: `/v3/users` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:11.776221 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ceb7280-0e39-42ec-89a5-2bf01e3d4402 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:11.778151 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ceb7280-0e39-42ec-89a5-2bf01e3d4402 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:11.779062 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab6dd43-8265-4c43-a03a-8b46947feb8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:11.779680 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab6dd43-8265-4c43-a03a-8b46947feb8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:11.779949 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab6dd43-8265-4c43-a03a-8b46947feb8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:11.780216 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab6dd43-8265-4c43-a03a-8b46947feb8d admin admin] PATH_INFO: `/v3/projects/beea6b366cdb49fe9f2d05d01ae7fc59` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:11.781306 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab6dd43-8265-4c43-a03a-8b46947feb8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=beea6b366cdb49fe9f2d05d01ae7fc59)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:11.783295 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab6dd43-8265-4c43-a03a-8b46947feb8d admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:11.800977 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1099/2220] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 16:33:11 2022] POST /identity/v3/users => generated 285 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:33:11.801767 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceb7280-0e39-42ec-89a5-2bf01e3d4402 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:11.812570 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceb7280-0e39-42ec-89a5-2bf01e3d4402 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:11.818017 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3386e0ce-1734-4553-9381-a2ce5f9b6ec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:11.818635 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3386e0ce-1734-4553-9381-a2ce5f9b6ec5 admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:11.819126 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3386e0ce-1734-4553-9381-a2ce5f9b6ec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:11.819247 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3386e0ce-1734-4553-9381-a2ce5f9b6ec5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:11.819829 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3386e0ce-1734-4553-9381-a2ce5f9b6ec5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:11.821415 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3386e0ce-1734-4553-9381-a2ce5f9b6ec5 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:11.834978 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1100/2221] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:33:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:33:11.834978 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3386e0ce-1734-4553-9381-a2ce5f9b6ec5 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:11.844785 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3386e0ce-1734-4553-9381-a2ce5f9b6ec5 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:11.846238 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-4ab6dd43-8265-4c43-a03a-8b46947feb8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'beea6b366cdb49fe9f2d05d01ae7fc59', 'request_id': 'req-4ab6dd43-8265-4c43-a03a-8b46947feb8d'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:11.854166 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-4ab6dd43-8265-4c43-a03a-8b46947feb8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'beea6b366cdb49fe9f2d05d01ae7fc59', 'request_id': 'req-4ab6dd43-8265-4c43-a03a-8b46947feb8d'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:11.857621 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:33:11.862808 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-4ab6dd43-8265-4c43-a03a-8b46947feb8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'beea6b366cdb49fe9f2d05d01ae7fc59', 'request_id': 'req-4ab6dd43-8265-4c43-a03a-8b46947feb8d'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:11.876760 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-4ab6dd43-8265-4c43-a03a-8b46947feb8d admin admin] The token cache is being invalidate because project beea6b366cdb49fe9f2d05d01ae7fc59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81446) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 16:33:11.877138 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-4ab6dd43-8265-4c43-a03a-8b46947feb8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:11.878010 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-4ab6dd43-8265-4c43-a03a-8b46947feb8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:11.880313 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1122/2222] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 16:33:11 2022] DELETE /identity/v3/projects/beea6b366cdb49fe9f2d05d01ae7fc59 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:33:11.883124 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab6dd43-8265-4c43-a03a-8b46947feb8d admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:11.884481 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-4ab6dd43-8265-4c43-a03a-8b46947feb8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:11.909019 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e184bc6f-c9ba-43df-9062-5123496d4b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:11.909714 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e184bc6f-c9ba-43df-9062-5123496d4b6c admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:11.910001 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e184bc6f-c9ba-43df-9062-5123496d4b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:11.910313 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e184bc6f-c9ba-43df-9062-5123496d4b6c admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:11.910958 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e184bc6f-c9ba-43df-9062-5123496d4b6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:11.912560 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e184bc6f-c9ba-43df-9062-5123496d4b6c admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:11.923519 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1101/2223] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:33:11 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:33:11.924269 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e184bc6f-c9ba-43df-9062-5123496d4b6c admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:11.925982 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-e184bc6f-c9ba-43df-9062-5123496d4b6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:11.938451 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e184bc6f-c9ba-43df-9062-5123496d4b6c admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:11.945097 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e346ae35-b0bf-4337-a8f5-629377fc0f61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:11.945717 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e346ae35-b0bf-4337-a8f5-629377fc0f61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:11.945997 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e346ae35-b0bf-4337-a8f5-629377fc0f61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:11.946265 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e346ae35-b0bf-4337-a8f5-629377fc0f61 admin admin] PATH_INFO: `/v3/users/599bcd10e6d24c8c97c2037ea11f70a4` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:11.947460 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e346ae35-b0bf-4337-a8f5-629377fc0f61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=599bcd10e6d24c8c97c2037ea11f70a4)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:11.949417 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e346ae35-b0bf-4337-a8f5-629377fc0f61 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:11.956963 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:33:11.964951 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab6dd43-8265-4c43-a03a-8b46947feb8d admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:11.974167 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2255619-5907-4dd9-8025-8d9a97cab99b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:11.975048 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2255619-5907-4dd9-8025-8d9a97cab99b admin admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:11.975284 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2255619-5907-4dd9-8025-8d9a97cab99b admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:11.975616 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2255619-5907-4dd9-8025-8d9a97cab99b admin admin] PATH_INFO: `/v3/projects/74bbeead89014384bd30a58ad909c101/users/47c81e68646e48d395c360fbd5e664d1/roles/0a36d1be416f4089be19be979943b731` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:11.994741 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2255619-5907-4dd9-8025-8d9a97cab99b admin admin] RBAC: Authorizing `identity:create_grant(project_id=74bbeead89014384bd30a58ad909c101, user_id=47c81e68646e48d395c360fbd5e664d1, role_id=0a36d1be416f4089be19be979943b731)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:11.998325 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2255619-5907-4dd9-8025-8d9a97cab99b admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:12.007151 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-e346ae35-b0bf-4337-a8f5-629377fc0f61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '599bcd10e6d24c8c97c2037ea11f70a4'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:12.013726 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1123/2224] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 16:33:11 2022] PUT /identity/v3/projects/74bbeead89014384bd30a58ad909c101/users/47c81e68646e48d395c360fbd5e664d1/roles/0a36d1be416f4089be19be979943b731 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:33:12.015644 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-e346ae35-b0bf-4337-a8f5-629377fc0f61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '599bcd10e6d24c8c97c2037ea11f70a4'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:12.016518 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-e346ae35-b0bf-4337-a8f5-629377fc0f61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '599bcd10e6d24c8c97c2037ea11f70a4'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:12.017661 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2255619-5907-4dd9-8025-8d9a97cab99b admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:12.020127 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-d2255619-5907-4dd9-8025-8d9a97cab99b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:12.024805 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-e346ae35-b0bf-4337-a8f5-629377fc0f61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '599bcd10e6d24c8c97c2037ea11f70a4'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:12.041019 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-e346ae35-b0bf-4337-a8f5-629377fc0f61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '599bcd10e6d24c8c97c2037ea11f70a4'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:12.047767 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1102/2225] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 16:33:11 2022] DELETE /identity/v3/users/599bcd10e6d24c8c97c2037ea11f70a4 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:33:12.050889 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e346ae35-b0bf-4337-a8f5-629377fc0f61 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:12.050889 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-e346ae35-b0bf-4337-a8f5-629377fc0f61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:12.099310 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2255619-5907-4dd9-8025-8d9a97cab99b admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:12.134204 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e346ae35-b0bf-4337-a8f5-629377fc0f61 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:12.144736 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4536a8b2-2d97-4521-8de9-564c463b70f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:12.145381 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4536a8b2-2d97-4521-8de9-564c463b70f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:12.145653 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4536a8b2-2d97-4521-8de9-564c463b70f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:12.145922 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4536a8b2-2d97-4521-8de9-564c463b70f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:12.146775 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4536a8b2-2d97-4521-8de9-564c463b70f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:12.149784 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4536a8b2-2d97-4521-8de9-564c463b70f2 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:12.165101 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1103/2226] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:33:12 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:33:12.172847 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4536a8b2-2d97-4521-8de9-564c463b70f2 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:12.188700 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4536a8b2-2d97-4521-8de9-564c463b70f2 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:12.194340 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5637063a-1677-4945-9a8f-152f6a60435c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:12.194788 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5637063a-1677-4945-9a8f-152f6a60435c admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:12.195082 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5637063a-1677-4945-9a8f-152f6a60435c admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:12.195187 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a217eb72-7d25-48a6-bae4-4bb68fa61c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:12.195411 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5637063a-1677-4945-9a8f-152f6a60435c admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:12.195989 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a217eb72-7d25-48a6-bae4-4bb68fa61c4d admin admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:12.196088 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5637063a-1677-4945-9a8f-152f6a60435c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:12.196407 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a217eb72-7d25-48a6-bae4-4bb68fa61c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:12.196686 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a217eb72-7d25-48a6-bae4-4bb68fa61c4d admin admin] PATH_INFO: `/v3/projects/74bbeead89014384bd30a58ad909c101/users/47c81e68646e48d395c360fbd5e664d1/roles/0a36d1be416f4089be19be979943b731` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:12.197673 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5637063a-1677-4945-9a8f-152f6a60435c admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:12.198714 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a217eb72-7d25-48a6-bae4-4bb68fa61c4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=74bbeead89014384bd30a58ad909c101, user_id=47c81e68646e48d395c360fbd5e664d1, role_id=0a36d1be416f4089be19be979943b731)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:12.202159 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a217eb72-7d25-48a6-bae4-4bb68fa61c4d admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:12.209937 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1124/2227] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:33:12 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:33:12.214522 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5637063a-1677-4945-9a8f-152f6a60435c admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:12.220054 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-5637063a-1677-4945-9a8f-152f6a60435c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:12.221542 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1104/2228] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 16:33:12 2022] PUT /identity/v3/projects/74bbeead89014384bd30a58ad909c101/users/47c81e68646e48d395c360fbd5e664d1/roles/0a36d1be416f4089be19be979943b731 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 16:33:12.233072 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d519ed31-d26b-4010-9cc7-d2bf77569ec0 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:12.233365 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d519ed31-d26b-4010-9cc7-d2bf77569ec0 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:12.233616 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d519ed31-d26b-4010-9cc7-d2bf77569ec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:12.238011 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5637063a-1677-4945-9a8f-152f6a60435c admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:12.267262 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:33:12.303386 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-d519ed31-d26b-4010-9cc7-d2bf77569ec0 None None] MFA Rules not processed for user `47c81e68646e48d395c360fbd5e664d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:33:12.305537 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-d519ed31-d26b-4010-9cc7-d2bf77569ec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:12.327803 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249618b6-2993-4646-9e49-133320729980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:12.329647 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249618b6-2993-4646-9e49-133320729980 admin admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:12.330328 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249618b6-2993-4646-9e49-133320729980 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:12.330681 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249618b6-2993-4646-9e49-133320729980 admin admin] PATH_INFO: `/v3/projects/0d291eb8df024a76a4052c56e76f5443/users/256c3030c923440784ab9b36ae67a3ad/roles/b38e84bf077846ee802e6bb1bad83522` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:12.350107 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249618b6-2993-4646-9e49-133320729980 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d291eb8df024a76a4052c56e76f5443, user_id=256c3030c923440784ab9b36ae67a3ad, role_id=b38e84bf077846ee802e6bb1bad83522)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:12.353802 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249618b6-2993-4646-9e49-133320729980 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:12.374366 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1125/2229] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 16:33:12 2022] PUT /identity/v3/projects/0d291eb8df024a76a4052c56e76f5443/users/256c3030c923440784ab9b36ae67a3ad/roles/b38e84bf077846ee802e6bb1bad83522 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 16:33:12.384525 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a48372-4ee7-4f7a-8cdc-6bd32c5052ac None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:12.384729 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a48372-4ee7-4f7a-8cdc-6bd32c5052ac None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:12.384997 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a48372-4ee7-4f7a-8cdc-6bd32c5052ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:12.411540 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:33:12.435455 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-89a48372-4ee7-4f7a-8cdc-6bd32c5052ac None None] MFA Rules not processed for user `256c3030c923440784ab9b36ae67a3ad`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:33:12.441555 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-89a48372-4ee7-4f7a-8cdc-6bd32c5052ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:12.443483 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1105/2230] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:33:12 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 16:33:12.444648 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d519ed31-d26b-4010-9cc7-d2bf77569ec0 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:12.446186 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-d519ed31-d26b-4010-9cc7-d2bf77569ec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:12.468339 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d519ed31-d26b-4010-9cc7-d2bf77569ec0 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:12.522037 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1126/2231] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:33:12 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 16:33:12.522909 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a48372-4ee7-4f7a-8cdc-6bd32c5052ac None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:12.526975 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-89a48372-4ee7-4f7a-8cdc-6bd32c5052ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:12.528075 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5cb952-a2b8-447b-a500-e1c29c7bf018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:12.528905 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5cb952-a2b8-447b-a500-e1c29c7bf018 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:12.529276 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5cb952-a2b8-447b-a500-e1c29c7bf018 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:12.529538 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5cb952-a2b8-447b-a500-e1c29c7bf018 admin admin] PATH_INFO: `/v3/projects/5b2fdff2af2c45d2b84d7388514f41fd` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:12.530802 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5cb952-a2b8-447b-a500-e1c29c7bf018 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b2fdff2af2c45d2b84d7388514f41fd)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:12.534701 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5cb952-a2b8-447b-a500-e1c29c7bf018 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:12.587553 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-df5cb952-a2b8-447b-a500-e1c29c7bf018 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b2fdff2af2c45d2b84d7388514f41fd', 'request_id': 'req-df5cb952-a2b8-447b-a500-e1c29c7bf018'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:12.593696 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a48372-4ee7-4f7a-8cdc-6bd32c5052ac None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:12.594694 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-df5cb952-a2b8-447b-a500-e1c29c7bf018 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b2fdff2af2c45d2b84d7388514f41fd', 'request_id': 'req-df5cb952-a2b8-447b-a500-e1c29c7bf018'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:12.602399 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-df5cb952-a2b8-447b-a500-e1c29c7bf018 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b2fdff2af2c45d2b84d7388514f41fd', 'request_id': 'req-df5cb952-a2b8-447b-a500-e1c29c7bf018'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:12.613795 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-df5cb952-a2b8-447b-a500-e1c29c7bf018 admin admin] The token cache is being invalidate because project 5b2fdff2af2c45d2b84d7388514f41fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81445) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 16:33:12.614078 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-df5cb952-a2b8-447b-a500-e1c29c7bf018 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:12.614744 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-df5cb952-a2b8-447b-a500-e1c29c7bf018 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:12.616240 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1106/2232] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 16:33:12 2022] DELETE /identity/v3/projects/5b2fdff2af2c45d2b84d7388514f41fd => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:33:12.616988 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5cb952-a2b8-447b-a500-e1c29c7bf018 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:12.618248 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-df5cb952-a2b8-447b-a500-e1c29c7bf018 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:12.649837 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:33:12.650045 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ac4548-4afb-4ba4-80ea-2e5b3fb7c360 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8078e791ba68460f8b3aeafb4b79b73a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:12.650761 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ac4548-4afb-4ba4-80ea-2e5b3fb7c360 service cinder] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:12.651145 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ac4548-4afb-4ba4-80ea-2e5b3fb7c360 service cinder] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:12.651513 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ac4548-4afb-4ba4-80ea-2e5b3fb7c360 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:12.653789 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-f9ac4548-4afb-4ba4-80ea-2e5b3fb7c360 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:12.690754 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5cb952-a2b8-447b-a500-e1c29c7bf018 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:12.696185 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a74f95-6bc7-414a-b124-f610d295b4f6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ddd42508eee4412ae139cb8526090d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:12.696921 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a74f95-6bc7-414a-b124-f610d295b4f6 service glance] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:12.697236 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a74f95-6bc7-414a-b124-f610d295b4f6 service glance] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:12.697669 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a74f95-6bc7-414a-b124-f610d295b4f6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:12.699674 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-c0a74f95-6bc7-414a-b124-f610d295b4f6 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:12.748848 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ac4548-4afb-4ba4-80ea-2e5b3fb7c360 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:12.750677 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ac4548-4afb-4ba4-80ea-2e5b3fb7c360 service cinder] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:12.762274 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1127/2233] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:33:12 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:33:12.764347 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b006bf-3680-4996-8d34-12e90ed86279 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:12.764689 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b006bf-3680-4996-8d34-12e90ed86279 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:12.765255 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b006bf-3680-4996-8d34-12e90ed86279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:12.771028 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a74f95-6bc7-414a-b124-f610d295b4f6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:12.772645 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a74f95-6bc7-414a-b124-f610d295b4f6 service glance] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:12.784648 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:33:12.791998 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1107/2234] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:33:12 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:33:12.797647 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-73b006bf-3680-4996-8d34-12e90ed86279 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:33:12.798994 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-73b006bf-3680-4996-8d34-12e90ed86279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:12.882351 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1128/2235] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:33:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:33:12.889968 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc4a1d8-0b6a-41c1-a3c3-fa14f194b13e None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:12.890259 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc4a1d8-0b6a-41c1-a3c3-fa14f194b13e None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:12.890567 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc4a1d8-0b6a-41c1-a3c3-fa14f194b13e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:12.919719 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-7bc4a1d8-0b6a-41c1-a3c3-fa14f194b13e None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:33:12.922134 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-7bc4a1d8-0b6a-41c1-a3c3-fa14f194b13e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:12.934031 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1108/2236] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:33:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:33:12.937107 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b006bf-3680-4996-8d34-12e90ed86279 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:12.948906 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b006bf-3680-4996-8d34-12e90ed86279 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:12.956564 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b748b7a8-1de0-47c6-a76c-27592c937e3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:12.957312 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b748b7a8-1de0-47c6-a76c-27592c937e3d admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:12.957821 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b748b7a8-1de0-47c6-a76c-27592c937e3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:12.958235 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b748b7a8-1de0-47c6-a76c-27592c937e3d admin admin] PATH_INFO: `/v3/domains` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:12.959207 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b748b7a8-1de0-47c6-a76c-27592c937e3d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:33:12.959670 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b748b7a8-1de0-47c6-a76c-27592c937e3d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:12.963932 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b748b7a8-1de0-47c6-a76c-27592c937e3d admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:12.982081 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1129/2237] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Sep 9 16:33:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 16:33:12.987045 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc4a1d8-0b6a-41c1-a3c3-fa14f194b13e None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:12.999195 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc4a1d8-0b6a-41c1-a3c3-fa14f194b13e None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:13.005065 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be17422-5b91-4637-9fe6-b15faa8689ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:13.005679 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be17422-5b91-4637-9fe6-b15faa8689ee admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:13.006140 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be17422-5b91-4637-9fe6-b15faa8689ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:13.006470 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be17422-5b91-4637-9fe6-b15faa8689ee admin admin] PATH_INFO: `/v3/projects` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:13.007472 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be17422-5b91-4637-9fe6-b15faa8689ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:13.010283 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be17422-5b91-4637-9fe6-b15faa8689ee admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:13.050893 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1109/2238] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 16:33:12 2022] POST /identity/v3/projects => generated 385 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:33:13.058434 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b748b7a8-1de0-47c6-a76c-27592c937e3d admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:13.070070 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b748b7a8-1de0-47c6-a76c-27592c937e3d admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:13.146773 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9246f0b5-ca04-4d45-9362-85a81e5eef8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:13.146773 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9246f0b5-ca04-4d45-9362-85a81e5eef8e admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:13.146773 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9246f0b5-ca04-4d45-9362-85a81e5eef8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:13.146773 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9246f0b5-ca04-4d45-9362-85a81e5eef8e admin admin] PATH_INFO: `/v3/users` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:13.147068 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9246f0b5-ca04-4d45-9362-85a81e5eef8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:13.148027 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9246f0b5-ca04-4d45-9362-85a81e5eef8e admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:13.179395 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1130/2239] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 16:33:13 2022] POST /identity/v3/users => generated 293 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:33:13.181488 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be17422-5b91-4637-9fe6-b15faa8689ee admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:13.197479 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be17422-5b91-4637-9fe6-b15faa8689ee admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:13.220006 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5e0508-cd28-47de-9cd0-3f53f5de7ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:13.220698 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5e0508-cd28-47de-9cd0-3f53f5de7ab7 admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:13.220918 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5e0508-cd28-47de-9cd0-3f53f5de7ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:13.222433 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5e0508-cd28-47de-9cd0-3f53f5de7ab7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:13.223088 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5e0508-cd28-47de-9cd0-3f53f5de7ab7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:13.224712 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5e0508-cd28-47de-9cd0-3f53f5de7ab7 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:13.252176 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1110/2240] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:33:13 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:33:13.256135 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9246f0b5-ca04-4d45-9362-85a81e5eef8e admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:13.269989 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9246f0b5-ca04-4d45-9362-85a81e5eef8e admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:13.276493 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14587999-8dc4-4301-9e16-b18db56aa0eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:13.277040 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14587999-8dc4-4301-9e16-b18db56aa0eb admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:13.277322 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14587999-8dc4-4301-9e16-b18db56aa0eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:13.277583 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14587999-8dc4-4301-9e16-b18db56aa0eb admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:13.278467 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14587999-8dc4-4301-9e16-b18db56aa0eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:13.280224 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14587999-8dc4-4301-9e16-b18db56aa0eb admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:13.293765 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1131/2241] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:33:13 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:33:13.299135 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5e0508-cd28-47de-9cd0-3f53f5de7ab7 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:13.311008 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5e0508-cd28-47de-9cd0-3f53f5de7ab7 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:13.316325 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea8e8ec-0a36-4351-884f-f72eadaa9699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:13.316998 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea8e8ec-0a36-4351-884f-f72eadaa9699 admin admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:13.317276 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea8e8ec-0a36-4351-884f-f72eadaa9699 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:13.317549 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea8e8ec-0a36-4351-884f-f72eadaa9699 admin admin] PATH_INFO: `/v3/projects/e70a60c5f6474de58f53647b9b88ad52/users/4e50cdc7787848c1a01e39645ff9680a/roles/b38e84bf077846ee802e6bb1bad83522` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:13.333905 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea8e8ec-0a36-4351-884f-f72eadaa9699 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e70a60c5f6474de58f53647b9b88ad52, user_id=4e50cdc7787848c1a01e39645ff9680a, role_id=b38e84bf077846ee802e6bb1bad83522)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:13.336593 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea8e8ec-0a36-4351-884f-f72eadaa9699 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:13.351603 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1111/2242] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 16:33:13 2022] PUT /identity/v3/projects/e70a60c5f6474de58f53647b9b88ad52/users/4e50cdc7787848c1a01e39645ff9680a/roles/b38e84bf077846ee802e6bb1bad83522 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 16:33:13.363574 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16843302-6f9f-42d0-9609-bdc0872750db None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:13.363865 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16843302-6f9f-42d0-9609-bdc0872750db None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:13.364142 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16843302-6f9f-42d0-9609-bdc0872750db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:13.396322 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-16843302-6f9f-42d0-9609-bdc0872750db None None] MFA Rules not processed for user `4e50cdc7787848c1a01e39645ff9680a`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:33:13.397916 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-16843302-6f9f-42d0-9609-bdc0872750db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:13.474572 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1132/2243] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:33:13 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:33:13.487542 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea8e8ec-0a36-4351-884f-f72eadaa9699 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:13.489526 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-7ea8e8ec-0a36-4351-884f-f72eadaa9699 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:13.552272 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea8e8ec-0a36-4351-884f-f72eadaa9699 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:13.555929 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab21e57-9975-4ad4-ae84-a038b267ab84 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8078e791ba68460f8b3aeafb4b79b73a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:13.556529 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab21e57-9975-4ad4-ae84-a038b267ab84 service cinder] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:13.556810 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab21e57-9975-4ad4-ae84-a038b267ab84 service cinder] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:13.557084 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab21e57-9975-4ad4-ae84-a038b267ab84 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:13.565787 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab21e57-9975-4ad4-ae84-a038b267ab84 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:13.567756 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab21e57-9975-4ad4-ae84-a038b267ab84 service cinder] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:13.577687 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1112/2244] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:33:13 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 16:33:13.600922 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16843302-6f9f-42d0-9609-bdc0872750db None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:13.606016 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:33:13.673247 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16843302-6f9f-42d0-9609-bdc0872750db None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:13.678010 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ad7e70-6f6e-48af-8350-86a23d10346f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:13.678669 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ad7e70-6f6e-48af-8350-86a23d10346f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:13.678951 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ad7e70-6f6e-48af-8350-86a23d10346f admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:13.679217 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ad7e70-6f6e-48af-8350-86a23d10346f admin admin] PATH_INFO: `/v3/users/4e50cdc7787848c1a01e39645ff9680a` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:13.680351 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ad7e70-6f6e-48af-8350-86a23d10346f admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e50cdc7787848c1a01e39645ff9680a)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:13.682269 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ad7e70-6f6e-48af-8350-86a23d10346f admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:13.733371 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-56ad7e70-6f6e-48af-8350-86a23d10346f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e50cdc7787848c1a01e39645ff9680a'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:13.740853 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-56ad7e70-6f6e-48af-8350-86a23d10346f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e50cdc7787848c1a01e39645ff9680a'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:13.760002 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-56ad7e70-6f6e-48af-8350-86a23d10346f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e50cdc7787848c1a01e39645ff9680a'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:13.771465 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-56ad7e70-6f6e-48af-8350-86a23d10346f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e50cdc7787848c1a01e39645ff9680a'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:13.772228 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-56ad7e70-6f6e-48af-8350-86a23d10346f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e50cdc7787848c1a01e39645ff9680a'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:13.779226 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1133/2245] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 16:33:13 2022] DELETE /identity/v3/users/4e50cdc7787848c1a01e39645ff9680a => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 16:33:13.784174 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846191e7-893b-4acc-86fd-f3bb3a38adcc None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:13.784676 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846191e7-893b-4acc-86fd-f3bb3a38adcc None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:13.792852 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846191e7-893b-4acc-86fd-f3bb3a38adcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:13.817850 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-846191e7-893b-4acc-86fd-f3bb3a38adcc None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:33:13.819199 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-846191e7-893b-4acc-86fd-f3bb3a38adcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:13.832338 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:33:13.890284 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ad7e70-6f6e-48af-8350-86a23d10346f admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:13.892009 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-56ad7e70-6f6e-48af-8350-86a23d10346f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:13.900862 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1113/2246] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:33:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:33:13.911304 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ad7e70-6f6e-48af-8350-86a23d10346f admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:13.911823 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846191e7-893b-4acc-86fd-f3bb3a38adcc None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:13.913720 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-846191e7-893b-4acc-86fd-f3bb3a38adcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:13.916382 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701d002b-047d-42ef-934e-05ccd298b7b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:13.917007 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701d002b-047d-42ef-934e-05ccd298b7b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:13.917284 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701d002b-047d-42ef-934e-05ccd298b7b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:13.917554 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701d002b-047d-42ef-934e-05ccd298b7b6 admin admin] PATH_INFO: `/v3/users/926c5c9f099448b08abdee386231a13d` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:13.918829 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701d002b-047d-42ef-934e-05ccd298b7b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=926c5c9f099448b08abdee386231a13d)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:13.921319 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701d002b-047d-42ef-934e-05ccd298b7b6 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:13.994019 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-701d002b-047d-42ef-934e-05ccd298b7b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '926c5c9f099448b08abdee386231a13d'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:14.001494 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-701d002b-047d-42ef-934e-05ccd298b7b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '926c5c9f099448b08abdee386231a13d'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:14.002712 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846191e7-893b-4acc-86fd-f3bb3a38adcc None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:14.007448 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98e652d-ade3-454e-8a4a-3de67da4397b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f44bfdd5214e8d84a2c0a5b1fd9b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:14.008288 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98e652d-ade3-454e-8a4a-3de67da4397b service neutron] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:14.008564 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98e652d-ade3-454e-8a4a-3de67da4397b service neutron] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:14.008832 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98e652d-ade3-454e-8a4a-3de67da4397b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:14.017328 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-701d002b-047d-42ef-934e-05ccd298b7b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '926c5c9f099448b08abdee386231a13d'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:14.020540 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:33:14.020677 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98e652d-ade3-454e-8a4a-3de67da4397b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:14.022384 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98e652d-ade3-454e-8a4a-3de67da4397b service neutron] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:14.026684 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-701d002b-047d-42ef-934e-05ccd298b7b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '926c5c9f099448b08abdee386231a13d'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:14.028171 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-701d002b-047d-42ef-934e-05ccd298b7b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '926c5c9f099448b08abdee386231a13d'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:14.036643 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1114/2247] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:33:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 16:33:14.037396 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1134/2248] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 16:33:13 2022] DELETE /identity/v3/users/926c5c9f099448b08abdee386231a13d => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 16:33:14.042946 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9c04ae-52af-4962-8633-700915e3b797 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:14.043448 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9c04ae-52af-4962-8633-700915e3b797 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:14.044730 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9c04ae-52af-4962-8633-700915e3b797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:14.070355 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-0f9c04ae-52af-4962-8633-700915e3b797 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:33:14.071874 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-0f9c04ae-52af-4962-8633-700915e3b797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:14.164763 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1115/2249] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:33:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 16:33:14.172562 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701d002b-047d-42ef-934e-05ccd298b7b6 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:14.174590 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-701d002b-047d-42ef-934e-05ccd298b7b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:14.268807 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701d002b-047d-42ef-934e-05ccd298b7b6 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:14.293350 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174c9902-649c-45f5-aec1-f6d942ea44f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f44bfdd5214e8d84a2c0a5b1fd9b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:14.294007 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174c9902-649c-45f5-aec1-f6d942ea44f3 service neutron] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:14.294288 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174c9902-649c-45f5-aec1-f6d942ea44f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:14.294590 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174c9902-649c-45f5-aec1-f6d942ea44f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:14.307139 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174c9902-649c-45f5-aec1-f6d942ea44f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:14.308585 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174c9902-649c-45f5-aec1-f6d942ea44f3 service neutron] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:14.321531 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1135/2250] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:33:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:33:14.451722 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9c04ae-52af-4962-8633-700915e3b797 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:14.453838 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-0f9c04ae-52af-4962-8633-700915e3b797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:14.489270 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9c04ae-52af-4962-8633-700915e3b797 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:14.497569 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafa4989-0a7b-4f0e-be69-e6cb6262416f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:14.498453 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafa4989-0a7b-4f0e-be69-e6cb6262416f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:14.498723 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafa4989-0a7b-4f0e-be69-e6cb6262416f admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:14.499152 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafa4989-0a7b-4f0e-be69-e6cb6262416f admin admin] PATH_INFO: `/v3/projects/e70a60c5f6474de58f53647b9b88ad52` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:14.500657 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafa4989-0a7b-4f0e-be69-e6cb6262416f admin admin] RBAC: Authorizing `identity:delete_project(project_id=e70a60c5f6474de58f53647b9b88ad52)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:14.503876 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafa4989-0a7b-4f0e-be69-e6cb6262416f admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:14.569276 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-bafa4989-0a7b-4f0e-be69-e6cb6262416f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e70a60c5f6474de58f53647b9b88ad52', 'request_id': 'req-bafa4989-0a7b-4f0e-be69-e6cb6262416f'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:14.582170 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-bafa4989-0a7b-4f0e-be69-e6cb6262416f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e70a60c5f6474de58f53647b9b88ad52', 'request_id': 'req-bafa4989-0a7b-4f0e-be69-e6cb6262416f'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:14.584255 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:33:14.595552 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-bafa4989-0a7b-4f0e-be69-e6cb6262416f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e70a60c5f6474de58f53647b9b88ad52', 'request_id': 'req-bafa4989-0a7b-4f0e-be69-e6cb6262416f'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:14.609155 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-bafa4989-0a7b-4f0e-be69-e6cb6262416f admin admin] The token cache is being invalidate because project e70a60c5f6474de58f53647b9b88ad52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81445) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 16:33:14.609702 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-bafa4989-0a7b-4f0e-be69-e6cb6262416f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:14.610812 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-bafa4989-0a7b-4f0e-be69-e6cb6262416f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:14.613140 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1116/2251] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 16:33:14 2022] DELETE /identity/v3/projects/e70a60c5f6474de58f53647b9b88ad52 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:33:14.617949 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc254d2b-3322-486b-ad61-85ef4189c014 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:14.618238 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc254d2b-3322-486b-ad61-85ef4189c014 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:14.618572 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc254d2b-3322-486b-ad61-85ef4189c014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:14.639385 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-dc254d2b-3322-486b-ad61-85ef4189c014 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:33:14.640843 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-dc254d2b-3322-486b-ad61-85ef4189c014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:14.733604 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafa4989-0a7b-4f0e-be69-e6cb6262416f admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:14.735048 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-bafa4989-0a7b-4f0e-be69-e6cb6262416f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:14.756932 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1136/2252] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:33:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 16:33:14.767651 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13a50be-3c88-46e5-9a3e-cb3693549fa1 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:14.767978 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13a50be-3c88-46e5-9a3e-cb3693549fa1 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:14.768361 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13a50be-3c88-46e5-9a3e-cb3693549fa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:14.805210 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-c13a50be-3c88-46e5-9a3e-cb3693549fa1 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:33:14.806479 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-c13a50be-3c88-46e5-9a3e-cb3693549fa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:14.816723 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1137/2253] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:33:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:33:14.821381 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13a50be-3c88-46e5-9a3e-cb3693549fa1 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:14.830783 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13a50be-3c88-46e5-9a3e-cb3693549fa1 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:14.835650 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb17024-8828-4a41-a859-47e04e0ad7b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:14.836243 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb17024-8828-4a41-a859-47e04e0ad7b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:14.836523 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb17024-8828-4a41-a859-47e04e0ad7b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:14.836795 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb17024-8828-4a41-a859-47e04e0ad7b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:14.837435 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb17024-8828-4a41-a859-47e04e0ad7b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:33:14.837738 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb17024-8828-4a41-a859-47e04e0ad7b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:14.839142 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafa4989-0a7b-4f0e-be69-e6cb6262416f admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:14.839554 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb17024-8828-4a41-a859-47e04e0ad7b2 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:14.843904 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38fb5cc-e094-47d1-abd4-6ae4762a1023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:14.844715 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38fb5cc-e094-47d1-abd4-6ae4762a1023 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:14.845002 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38fb5cc-e094-47d1-abd4-6ae4762a1023 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:14.845266 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38fb5cc-e094-47d1-abd4-6ae4762a1023 admin admin] PATH_INFO: `/v3/projects/68978627495f475baec711ba54a958f1` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:14.846530 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38fb5cc-e094-47d1-abd4-6ae4762a1023 admin admin] RBAC: Authorizing `identity:delete_project(project_id=68978627495f475baec711ba54a958f1)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:14.848643 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38fb5cc-e094-47d1-abd4-6ae4762a1023 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:14.855415 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1138/2254] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Sep 9 16:33:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:33:14.860840 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb17024-8828-4a41-a859-47e04e0ad7b2 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:14.871225 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb17024-8828-4a41-a859-47e04e0ad7b2 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:14.877394 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8340aa3-38bc-4971-8494-0c99f6d2c6a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:14.878095 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8340aa3-38bc-4971-8494-0c99f6d2c6a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:14.878449 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8340aa3-38bc-4971-8494-0c99f6d2c6a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:14.878811 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8340aa3-38bc-4971-8494-0c99f6d2c6a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:14.879574 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8340aa3-38bc-4971-8494-0c99f6d2c6a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:14.881902 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8340aa3-38bc-4971-8494-0c99f6d2c6a6 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:14.902884 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-b38fb5cc-e094-47d1-abd4-6ae4762a1023 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68978627495f475baec711ba54a958f1', 'request_id': 'req-b38fb5cc-e094-47d1-abd4-6ae4762a1023'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:14.909686 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-b38fb5cc-e094-47d1-abd4-6ae4762a1023 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68978627495f475baec711ba54a958f1', 'request_id': 'req-b38fb5cc-e094-47d1-abd4-6ae4762a1023'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:14.914158 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1139/2255] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 16:33:14 2022] POST /identity/v3/projects => generated 385 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 16:33:14.917203 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-b38fb5cc-e094-47d1-abd4-6ae4762a1023 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68978627495f475baec711ba54a958f1', 'request_id': 'req-b38fb5cc-e094-47d1-abd4-6ae4762a1023'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:14.918194 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8340aa3-38bc-4971-8494-0c99f6d2c6a6 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:14.930372 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-b38fb5cc-e094-47d1-abd4-6ae4762a1023 admin admin] The token cache is being invalidate because project 68978627495f475baec711ba54a958f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81445) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 16:33:14.930786 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-b38fb5cc-e094-47d1-abd4-6ae4762a1023 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:14.931414 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-b38fb5cc-e094-47d1-abd4-6ae4762a1023 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:14.936990 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1117/2256] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 16:33:14 2022] DELETE /identity/v3/projects/68978627495f475baec711ba54a958f1 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:33:14.987341 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:33:14.994420 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8340aa3-38bc-4971-8494-0c99f6d2c6a6 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:15.000840 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a9010e-63b7-498f-b436-67e6ba432c11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:15.001700 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a9010e-63b7-498f-b436-67e6ba432c11 admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:15.002056 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a9010e-63b7-498f-b436-67e6ba432c11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:15.002449 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a9010e-63b7-498f-b436-67e6ba432c11 admin admin] PATH_INFO: `/v3/users` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:15.003764 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a9010e-63b7-498f-b436-67e6ba432c11 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:15.005760 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a9010e-63b7-498f-b436-67e6ba432c11 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:15.029772 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1140/2257] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 16:33:14 2022] POST /identity/v3/users => generated 293 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:33:15.033967 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38fb5cc-e094-47d1-abd4-6ae4762a1023 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:15.035436 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-b38fb5cc-e094-47d1-abd4-6ae4762a1023 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:15.112354 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38fb5cc-e094-47d1-abd4-6ae4762a1023 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:15.117311 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d31ece9-a8da-4622-ac1f-4aa14ea05d91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:15.117920 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d31ece9-a8da-4622-ac1f-4aa14ea05d91 admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:15.118195 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d31ece9-a8da-4622-ac1f-4aa14ea05d91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:15.118491 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d31ece9-a8da-4622-ac1f-4aa14ea05d91 admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:15.119138 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d31ece9-a8da-4622-ac1f-4aa14ea05d91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:15.121165 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d31ece9-a8da-4622-ac1f-4aa14ea05d91 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:15.133140 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1118/2258] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:33:15 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:33:15.137324 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a9010e-63b7-498f-b436-67e6ba432c11 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:15.148205 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a9010e-63b7-498f-b436-67e6ba432c11 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:15.153100 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c7e7bf-cae4-4279-ac35-020244698d3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:15.154382 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c7e7bf-cae4-4279-ac35-020244698d3b admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:15.154598 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c7e7bf-cae4-4279-ac35-020244698d3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:15.154867 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c7e7bf-cae4-4279-ac35-020244698d3b admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:15.155507 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c7e7bf-cae4-4279-ac35-020244698d3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:15.157173 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c7e7bf-cae4-4279-ac35-020244698d3b admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:15.167960 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1141/2259] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:33:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:33:15.172860 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d31ece9-a8da-4622-ac1f-4aa14ea05d91 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:15.183259 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d31ece9-a8da-4622-ac1f-4aa14ea05d91 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:15.188087 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d072cab8-8576-4ca8-a87e-8ffca9c72b1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:15.188693 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d072cab8-8576-4ca8-a87e-8ffca9c72b1e admin admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:15.188970 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d072cab8-8576-4ca8-a87e-8ffca9c72b1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:15.189240 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d072cab8-8576-4ca8-a87e-8ffca9c72b1e admin admin] PATH_INFO: `/v3/projects/2f0585a297ac46289eded473c3df2ace/users/1d91cd70998f450aa122a08e0b299d2a/roles/b38e84bf077846ee802e6bb1bad83522` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:15.192596 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:INSERT=2,keystone:DELETE=10,keystone:SELECT=88 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:33:15.207448 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d072cab8-8576-4ca8-a87e-8ffca9c72b1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f0585a297ac46289eded473c3df2ace, user_id=1d91cd70998f450aa122a08e0b299d2a, role_id=b38e84bf077846ee802e6bb1bad83522)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:15.210239 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d072cab8-8576-4ca8-a87e-8ffca9c72b1e admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:15.223796 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1119/2260] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 16:33:15 2022] PUT /identity/v3/projects/2f0585a297ac46289eded473c3df2ace/users/1d91cd70998f450aa122a08e0b299d2a/roles/b38e84bf077846ee802e6bb1bad83522 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:33:15.235272 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8337ff3b-df9d-43db-9569-6ca8cdd0e221 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:15.235816 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8337ff3b-df9d-43db-9569-6ca8cdd0e221 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:15.236088 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8337ff3b-df9d-43db-9569-6ca8cdd0e221 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:15.267348 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-8337ff3b-df9d-43db-9569-6ca8cdd0e221 None None] MFA Rules not processed for user `1d91cd70998f450aa122a08e0b299d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:33:15.268560 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-8337ff3b-df9d-43db-9569-6ca8cdd0e221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:15.365272 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1142/2261] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:33:15 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:33:15.369903 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d072cab8-8576-4ca8-a87e-8ffca9c72b1e admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:15.460812 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d072cab8-8576-4ca8-a87e-8ffca9c72b1e admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:15.476864 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2f754f-34cd-490a-ba94-9027f5582ae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:15.477673 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2f754f-34cd-490a-ba94-9027f5582ae5 admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:15.478010 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2f754f-34cd-490a-ba94-9027f5582ae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:15.478369 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2f754f-34cd-490a-ba94-9027f5582ae5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:15.479717 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2f754f-34cd-490a-ba94-9027f5582ae5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:15.481763 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2f754f-34cd-490a-ba94-9027f5582ae5 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:15.516049 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1120/2262] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 16:33:15 2022] POST /identity/v3/projects => generated 383 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:33:15.518527 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8337ff3b-df9d-43db-9569-6ca8cdd0e221 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:15.536385 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8337ff3b-df9d-43db-9569-6ca8cdd0e221 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:15.620605 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53313284-ecae-4cba-8d65-45cad9c4a6eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:15.621331 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53313284-ecae-4cba-8d65-45cad9c4a6eb admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:15.621682 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53313284-ecae-4cba-8d65-45cad9c4a6eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:15.621965 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53313284-ecae-4cba-8d65-45cad9c4a6eb admin admin] PATH_INFO: `/v3/users` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:15.622694 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53313284-ecae-4cba-8d65-45cad9c4a6eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:15.624615 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53313284-ecae-4cba-8d65-45cad9c4a6eb admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:15.650392 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1143/2263] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 16:33:15 2022] POST /identity/v3/users => generated 292 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 16:33:15.652224 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2f754f-34cd-490a-ba94-9027f5582ae5 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:15.662991 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2f754f-34cd-490a-ba94-9027f5582ae5 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:15.667753 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea43cbe-1cbb-400c-a780-6102297f42b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:15.668442 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea43cbe-1cbb-400c-a780-6102297f42b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:15.668955 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea43cbe-1cbb-400c-a780-6102297f42b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:15.669227 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea43cbe-1cbb-400c-a780-6102297f42b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:15.669852 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea43cbe-1cbb-400c-a780-6102297f42b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:15.671480 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea43cbe-1cbb-400c-a780-6102297f42b5 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:15.681931 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1121/2264] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:33:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:33:15.686673 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53313284-ecae-4cba-8d65-45cad9c4a6eb admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:15.698103 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53313284-ecae-4cba-8d65-45cad9c4a6eb admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:15.703403 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f724ed-aac6-41b2-9bc0-f52799651dbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:15.704007 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f724ed-aac6-41b2-9bc0-f52799651dbf admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:15.704284 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f724ed-aac6-41b2-9bc0-f52799651dbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:15.704556 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f724ed-aac6-41b2-9bc0-f52799651dbf admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:15.705216 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f724ed-aac6-41b2-9bc0-f52799651dbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:15.706869 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f724ed-aac6-41b2-9bc0-f52799651dbf admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:15.717746 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1144/2265] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:33:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:33:15.721872 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea43cbe-1cbb-400c-a780-6102297f42b5 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:15.731896 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea43cbe-1cbb-400c-a780-6102297f42b5 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:15.736514 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdea3e7-78ae-4072-8d10-744fc80445d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:15.737174 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdea3e7-78ae-4072-8d10-744fc80445d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:15.737446 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdea3e7-78ae-4072-8d10-744fc80445d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:15.737711 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdea3e7-78ae-4072-8d10-744fc80445d0 admin admin] PATH_INFO: `/v3/projects/a790b2f60cab456bb190fde50dd2fd6c/users/4e3117dfdb144b2f9ac9e3e1ad94a4dd/roles/b38e84bf077846ee802e6bb1bad83522` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:15.754078 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdea3e7-78ae-4072-8d10-744fc80445d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a790b2f60cab456bb190fde50dd2fd6c, user_id=4e3117dfdb144b2f9ac9e3e1ad94a4dd, role_id=b38e84bf077846ee802e6bb1bad83522)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:15.756917 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdea3e7-78ae-4072-8d10-744fc80445d0 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:15.773055 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1122/2266] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 16:33:15 2022] PUT /identity/v3/projects/a790b2f60cab456bb190fde50dd2fd6c/users/4e3117dfdb144b2f9ac9e3e1ad94a4dd/roles/b38e84bf077846ee802e6bb1bad83522 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:33:15.784063 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04de6caf-666f-4686-9a64-4c1565d1770d None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:15.784409 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04de6caf-666f-4686-9a64-4c1565d1770d None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:15.784608 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04de6caf-666f-4686-9a64-4c1565d1770d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:15.824778 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-04de6caf-666f-4686-9a64-4c1565d1770d None None] MFA Rules not processed for user `4e3117dfdb144b2f9ac9e3e1ad94a4dd`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:33:15.826595 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-04de6caf-666f-4686-9a64-4c1565d1770d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:15.865272 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:33:15.917460 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1145/2267] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:33:15 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:33:15.922266 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdea3e7-78ae-4072-8d10-744fc80445d0 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:15.996676 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdea3e7-78ae-4072-8d10-744fc80445d0 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:16.002072 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b39d0ac-fbbf-4906-8a7f-38c81b0b4185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:16.002714 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b39d0ac-fbbf-4906-8a7f-38c81b0b4185 admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:16.002995 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b39d0ac-fbbf-4906-8a7f-38c81b0b4185 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:16.003273 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b39d0ac-fbbf-4906-8a7f-38c81b0b4185 admin admin] PATH_INFO: `/v3/projects` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:16.003909 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b39d0ac-fbbf-4906-8a7f-38c81b0b4185 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:16.005871 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b39d0ac-fbbf-4906-8a7f-38c81b0b4185 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:16.044332 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1123/2268] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 16:33:15 2022] POST /identity/v3/projects => generated 383 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:33:16.045167 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04de6caf-666f-4686-9a64-4c1565d1770d None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:16.056988 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04de6caf-666f-4686-9a64-4c1565d1770d None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:16.136292 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a56b7bd-d900-4b05-b61a-4301656d03bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:16.137086 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a56b7bd-d900-4b05-b61a-4301656d03bb admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:16.137442 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a56b7bd-d900-4b05-b61a-4301656d03bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:16.137881 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a56b7bd-d900-4b05-b61a-4301656d03bb admin admin] PATH_INFO: `/v3/users` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:16.138781 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a56b7bd-d900-4b05-b61a-4301656d03bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:16.140845 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a56b7bd-d900-4b05-b61a-4301656d03bb admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:16.169554 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1146/2269] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 16:33:16 2022] POST /identity/v3/users => generated 298 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 16:33:16.173520 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b39d0ac-fbbf-4906-8a7f-38c81b0b4185 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:16.186913 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b39d0ac-fbbf-4906-8a7f-38c81b0b4185 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:16.192028 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96a8d6a-2d71-409f-bbc3-8a5f68dce1a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:16.192717 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96a8d6a-2d71-409f-bbc3-8a5f68dce1a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:16.193025 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96a8d6a-2d71-409f-bbc3-8a5f68dce1a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:16.193364 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96a8d6a-2d71-409f-bbc3-8a5f68dce1a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:16.194002 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96a8d6a-2d71-409f-bbc3-8a5f68dce1a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:16.198508 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96a8d6a-2d71-409f-bbc3-8a5f68dce1a3 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:16.207321 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1124/2270] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:33:16 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:33:16.211338 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a56b7bd-d900-4b05-b61a-4301656d03bb admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:16.221601 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a56b7bd-d900-4b05-b61a-4301656d03bb admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:16.229728 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28036e9-f00d-4dd8-9658-a4977a647336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:16.229728 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28036e9-f00d-4dd8-9658-a4977a647336 admin admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:16.229728 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28036e9-f00d-4dd8-9658-a4977a647336 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:16.229728 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28036e9-f00d-4dd8-9658-a4977a647336 admin admin] PATH_INFO: `/v3/projects/22ca6dbb62ae40c28c1fa0ad7a87ad3d/users/58dde7cebd90473a9d3ce2137393c120/roles/0a36d1be416f4089be19be979943b731` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:16.245482 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28036e9-f00d-4dd8-9658-a4977a647336 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22ca6dbb62ae40c28c1fa0ad7a87ad3d, user_id=58dde7cebd90473a9d3ce2137393c120, role_id=0a36d1be416f4089be19be979943b731)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:16.249700 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28036e9-f00d-4dd8-9658-a4977a647336 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:16.264183 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1147/2271] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 16:33:16 2022] PUT /identity/v3/projects/22ca6dbb62ae40c28c1fa0ad7a87ad3d/users/58dde7cebd90473a9d3ce2137393c120/roles/0a36d1be416f4089be19be979943b731 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:33:16.268097 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96a8d6a-2d71-409f-bbc3-8a5f68dce1a3 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:16.279010 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96a8d6a-2d71-409f-bbc3-8a5f68dce1a3 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:16.284113 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:33:16.338025 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4530261a-751d-45ce-a2d6-9270f6b9fc48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:16.338678 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4530261a-751d-45ce-a2d6-9270f6b9fc48 admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:16.338968 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4530261a-751d-45ce-a2d6-9270f6b9fc48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:16.339264 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4530261a-751d-45ce-a2d6-9270f6b9fc48 admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:16.339942 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4530261a-751d-45ce-a2d6-9270f6b9fc48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:16.341622 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4530261a-751d-45ce-a2d6-9270f6b9fc48 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:16.355543 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1125/2272] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:33:16 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:33:16.356229 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28036e9-f00d-4dd8-9658-a4977a647336 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:16.367605 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28036e9-f00d-4dd8-9658-a4977a647336 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:16.373035 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8031818f-288d-4d4d-b710-67685c69d3e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:16.373877 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8031818f-288d-4d4d-b710-67685c69d3e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:16.374187 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8031818f-288d-4d4d-b710-67685c69d3e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:16.374565 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8031818f-288d-4d4d-b710-67685c69d3e6 admin admin] PATH_INFO: `/v3/projects/22ca6dbb62ae40c28c1fa0ad7a87ad3d/users/58dde7cebd90473a9d3ce2137393c120/roles/0a36d1be416f4089be19be979943b731` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:16.376864 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8031818f-288d-4d4d-b710-67685c69d3e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22ca6dbb62ae40c28c1fa0ad7a87ad3d, user_id=58dde7cebd90473a9d3ce2137393c120, role_id=0a36d1be416f4089be19be979943b731)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:16.379484 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8031818f-288d-4d4d-b710-67685c69d3e6 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:16.392843 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1148/2273] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 16:33:16 2022] PUT /identity/v3/projects/22ca6dbb62ae40c28c1fa0ad7a87ad3d/users/58dde7cebd90473a9d3ce2137393c120/roles/0a36d1be416f4089be19be979943b731 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:33:16.403192 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d00f17-7741-4d71-a9d6-7473b661d070 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:16.403483 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d00f17-7741-4d71-a9d6-7473b661d070 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:16.403764 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d00f17-7741-4d71-a9d6-7473b661d070 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:16.431064 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-d3d00f17-7741-4d71-a9d6-7473b661d070 None None] MFA Rules not processed for user `58dde7cebd90473a9d3ce2137393c120`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:33:16.432257 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-d3d00f17-7741-4d71-a9d6-7473b661d070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:16.500722 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1126/2274] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:33:16 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:33:16.512112 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8031818f-288d-4d4d-b710-67685c69d3e6 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:16.513867 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-8031818f-288d-4d4d-b710-67685c69d3e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:16.574583 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8031818f-288d-4d4d-b710-67685c69d3e6 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:16.578274 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10e7b23-5f17-49d8-84b9-631ca1632b5a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8078e791ba68460f8b3aeafb4b79b73a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:16.578901 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10e7b23-5f17-49d8-84b9-631ca1632b5a service cinder] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:16.579203 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10e7b23-5f17-49d8-84b9-631ca1632b5a service cinder] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:16.579469 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10e7b23-5f17-49d8-84b9-631ca1632b5a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:16.629107 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:33:16.650045 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10e7b23-5f17-49d8-84b9-631ca1632b5a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:16.651645 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10e7b23-5f17-49d8-84b9-631ca1632b5a service cinder] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:16.661061 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1149/2275] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:33:16 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:33:17.328675 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d00f17-7741-4d71-a9d6-7473b661d070 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:17.338488 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d00f17-7741-4d71-a9d6-7473b661d070 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:17.341998 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bad80af-739d-45ea-84b8-b24835c4aa6e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8078e791ba68460f8b3aeafb4b79b73a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:17.342628 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bad80af-739d-45ea-84b8-b24835c4aa6e service cinder] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:17.342905 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bad80af-739d-45ea-84b8-b24835c4aa6e service cinder] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:17.343172 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bad80af-739d-45ea-84b8-b24835c4aa6e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:17.344891 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-6bad80af-739d-45ea-84b8-b24835c4aa6e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:17.410617 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bad80af-739d-45ea-84b8-b24835c4aa6e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:17.412122 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bad80af-739d-45ea-84b8-b24835c4aa6e service cinder] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:17.422433 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1127/2276] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:33:17 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:33:18.198948 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10e7b23-5f17-49d8-84b9-631ca1632b5a service cinder] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:18.208208 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10e7b23-5f17-49d8-84b9-631ca1632b5a service cinder] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:18.212150 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6f9807-ae30-4eb6-931d-2ac5e09843e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8078e791ba68460f8b3aeafb4b79b73a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:18.212765 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6f9807-ae30-4eb6-931d-2ac5e09843e4 service cinder] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:18.213038 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6f9807-ae30-4eb6-931d-2ac5e09843e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:18.213304 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6f9807-ae30-4eb6-931d-2ac5e09843e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:18.270094 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6f9807-ae30-4eb6-931d-2ac5e09843e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:18.271550 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6f9807-ae30-4eb6-931d-2ac5e09843e4 service cinder] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:18.280535 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1150/2277] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:33:18 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:33:18.818760 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bad80af-739d-45ea-84b8-b24835c4aa6e service cinder] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:18.820393 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-6bad80af-739d-45ea-84b8-b24835c4aa6e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:18.834592 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bad80af-739d-45ea-84b8-b24835c4aa6e service cinder] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:18.838247 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbe71bf-dc74-4a12-a2cf-ffe48bb110ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8078e791ba68460f8b3aeafb4b79b73a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:18.838881 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbe71bf-dc74-4a12-a2cf-ffe48bb110ac service cinder] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:18.839159 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbe71bf-dc74-4a12-a2cf-ffe48bb110ac service cinder] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:18.839432 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbe71bf-dc74-4a12-a2cf-ffe48bb110ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:18.849149 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbe71bf-dc74-4a12-a2cf-ffe48bb110ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:18.850607 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbe71bf-dc74-4a12-a2cf-ffe48bb110ac service cinder] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:18.861061 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1128/2278] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:33:18 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:33:22.382371 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6f9807-ae30-4eb6-931d-2ac5e09843e4 service cinder] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:22.383764 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-bb6f9807-ae30-4eb6-931d-2ac5e09843e4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:22.449353 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6f9807-ae30-4eb6-931d-2ac5e09843e4 service cinder] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:22.453845 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43939338-3243-4636-83e8-ac5c3127dad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:22.454507 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43939338-3243-4636-83e8-ac5c3127dad7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:22.454789 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43939338-3243-4636-83e8-ac5c3127dad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:22.455062 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43939338-3243-4636-83e8-ac5c3127dad7 admin admin] PATH_INFO: `/v3/users/afab5b9a0ea84624b4cc35d866119c78` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:22.456207 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43939338-3243-4636-83e8-ac5c3127dad7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=afab5b9a0ea84624b4cc35d866119c78)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:22.458129 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43939338-3243-4636-83e8-ac5c3127dad7 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:22.512431 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-43939338-3243-4636-83e8-ac5c3127dad7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afab5b9a0ea84624b4cc35d866119c78'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:22.519445 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-43939338-3243-4636-83e8-ac5c3127dad7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afab5b9a0ea84624b4cc35d866119c78'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:22.533094 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-43939338-3243-4636-83e8-ac5c3127dad7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afab5b9a0ea84624b4cc35d866119c78'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:22.536718 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:33:22.544658 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-43939338-3243-4636-83e8-ac5c3127dad7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afab5b9a0ea84624b4cc35d866119c78'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:22.545771 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-43939338-3243-4636-83e8-ac5c3127dad7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afab5b9a0ea84624b4cc35d866119c78'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:22.553449 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1151/2279] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 16:33:22 2022] DELETE /identity/v3/users/afab5b9a0ea84624b4cc35d866119c78 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:33:22.559143 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cb7827-fed7-4a35-b5e6-dc2589545d36 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:22.559839 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cb7827-fed7-4a35-b5e6-dc2589545d36 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:22.559839 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cb7827-fed7-4a35-b5e6-dc2589545d36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:22.579723 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-33cb7827-fed7-4a35-b5e6-dc2589545d36 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:33:22.580940 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-33cb7827-fed7-4a35-b5e6-dc2589545d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:22.585850 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:33:22.650927 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1129/2280] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:33:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:33:22.661207 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43939338-3243-4636-83e8-ac5c3127dad7 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:22.662658 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-43939338-3243-4636-83e8-ac5c3127dad7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:22.730251 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43939338-3243-4636-83e8-ac5c3127dad7 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:22.735133 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b748d2-496d-4565-915f-7cadcc4aeeac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f44bfdd5214e8d84a2c0a5b1fd9b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:22.736612 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b748d2-496d-4565-915f-7cadcc4aeeac service neutron] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:22.737843 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b748d2-496d-4565-915f-7cadcc4aeeac service neutron] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:22.738356 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b748d2-496d-4565-915f-7cadcc4aeeac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:22.750639 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b748d2-496d-4565-915f-7cadcc4aeeac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:22.752207 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b748d2-496d-4565-915f-7cadcc4aeeac service neutron] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:22.763179 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1152/2281] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:33:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:33:22.814503 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cb7827-fed7-4a35-b5e6-dc2589545d36 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:22.816066 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-33cb7827-fed7-4a35-b5e6-dc2589545d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:22.830483 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cb7827-fed7-4a35-b5e6-dc2589545d36 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:22.845309 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c93a3cc-758c-4f67-864a-57f21f0848ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:22.845922 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c93a3cc-758c-4f67-864a-57f21f0848ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:22.846197 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c93a3cc-758c-4f67-864a-57f21f0848ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:22.846488 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c93a3cc-758c-4f67-864a-57f21f0848ca admin admin] PATH_INFO: `/v3/users/1d91cd70998f450aa122a08e0b299d2a` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:22.847954 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c93a3cc-758c-4f67-864a-57f21f0848ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d91cd70998f450aa122a08e0b299d2a)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:22.850013 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c93a3cc-758c-4f67-864a-57f21f0848ca admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:22.930217 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-0c93a3cc-758c-4f67-864a-57f21f0848ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d91cd70998f450aa122a08e0b299d2a'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:22.943959 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-0c93a3cc-758c-4f67-864a-57f21f0848ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d91cd70998f450aa122a08e0b299d2a'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:22.946684 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-0c93a3cc-758c-4f67-864a-57f21f0848ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d91cd70998f450aa122a08e0b299d2a'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:22.958555 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-0c93a3cc-758c-4f67-864a-57f21f0848ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d91cd70998f450aa122a08e0b299d2a'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:22.977832 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-0c93a3cc-758c-4f67-864a-57f21f0848ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d91cd70998f450aa122a08e0b299d2a'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:22.984459 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1130/2282] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 16:33:22 2022] DELETE /identity/v3/users/1d91cd70998f450aa122a08e0b299d2a => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:33:22.989170 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed606b56-f0ee-4b14-9aa4-6632fd6a2cbb None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:22.989463 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed606b56-f0ee-4b14-9aa4-6632fd6a2cbb None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:22.989827 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed606b56-f0ee-4b14-9aa4-6632fd6a2cbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:23.009863 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-ed606b56-f0ee-4b14-9aa4-6632fd6a2cbb None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:33:23.011812 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-ed606b56-f0ee-4b14-9aa4-6632fd6a2cbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:23.104955 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1153/2283] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:33:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 16:33:23.112873 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c93a3cc-758c-4f67-864a-57f21f0848ca admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:23.114380 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-0c93a3cc-758c-4f67-864a-57f21f0848ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:23.115392 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed606b56-f0ee-4b14-9aa4-6632fd6a2cbb None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:23.117062 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-ed606b56-f0ee-4b14-9aa4-6632fd6a2cbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:23.147974 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c93a3cc-758c-4f67-864a-57f21f0848ca admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:23.152799 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4acefeb-f7c5-4985-ac81-381b65f3043f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:23.154090 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4acefeb-f7c5-4985-ac81-381b65f3043f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:23.154541 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4acefeb-f7c5-4985-ac81-381b65f3043f admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:23.154942 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4acefeb-f7c5-4985-ac81-381b65f3043f admin admin] PATH_INFO: `/v3/projects/8f114d00a44d4c55b3c4e6f79b7b7d35` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:23.156915 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4acefeb-f7c5-4985-ac81-381b65f3043f admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f114d00a44d4c55b3c4e6f79b7b7d35)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:23.160559 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4acefeb-f7c5-4985-ac81-381b65f3043f admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:23.206737 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed606b56-f0ee-4b14-9aa4-6632fd6a2cbb None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:23.210875 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7271d121-7355-4e18-8e5d-9793f113e385 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f44bfdd5214e8d84a2c0a5b1fd9b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:23.211593 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7271d121-7355-4e18-8e5d-9793f113e385 service neutron] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:23.211778 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7271d121-7355-4e18-8e5d-9793f113e385 service neutron] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:23.212074 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7271d121-7355-4e18-8e5d-9793f113e385 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:23.222976 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7271d121-7355-4e18-8e5d-9793f113e385 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:23.224599 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7271d121-7355-4e18-8e5d-9793f113e385 service neutron] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:23.228863 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-c4acefeb-f7c5-4985-ac81-381b65f3043f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f114d00a44d4c55b3c4e6f79b7b7d35', 'request_id': 'req-c4acefeb-f7c5-4985-ac81-381b65f3043f'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:23.235152 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-c4acefeb-f7c5-4985-ac81-381b65f3043f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f114d00a44d4c55b3c4e6f79b7b7d35', 'request_id': 'req-c4acefeb-f7c5-4985-ac81-381b65f3043f'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:23.236183 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1154/2284] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:33:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:33:23.244001 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-c4acefeb-f7c5-4985-ac81-381b65f3043f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f114d00a44d4c55b3c4e6f79b7b7d35', 'request_id': 'req-c4acefeb-f7c5-4985-ac81-381b65f3043f'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:23.257821 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-c4acefeb-f7c5-4985-ac81-381b65f3043f admin admin] The token cache is being invalidate because project 8f114d00a44d4c55b3c4e6f79b7b7d35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81445) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 16:33:23.258213 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-c4acefeb-f7c5-4985-ac81-381b65f3043f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:23.259016 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-c4acefeb-f7c5-4985-ac81-381b65f3043f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:23.261569 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1131/2285] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 16:33:23 2022] DELETE /identity/v3/projects/8f114d00a44d4c55b3c4e6f79b7b7d35 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:33:23.267028 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7271d121-7355-4e18-8e5d-9793f113e385 service neutron] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:23.278344 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7271d121-7355-4e18-8e5d-9793f113e385 service neutron] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:23.324587 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:33:23.348012 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d283dc3a-28a6-4e58-8d45-cb47c46c7f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:23.348862 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d283dc3a-28a6-4e58-8d45-cb47c46c7f91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:23.349190 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d283dc3a-28a6-4e58-8d45-cb47c46c7f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:23.349490 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d283dc3a-28a6-4e58-8d45-cb47c46c7f91 admin admin] PATH_INFO: `/v3/users/47c81e68646e48d395c360fbd5e664d1` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:23.350847 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d283dc3a-28a6-4e58-8d45-cb47c46c7f91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=47c81e68646e48d395c360fbd5e664d1)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:23.353089 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d283dc3a-28a6-4e58-8d45-cb47c46c7f91 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:23.411180 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-d283dc3a-28a6-4e58-8d45-cb47c46c7f91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47c81e68646e48d395c360fbd5e664d1'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:23.418817 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-d283dc3a-28a6-4e58-8d45-cb47c46c7f91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47c81e68646e48d395c360fbd5e664d1'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:23.431671 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-d283dc3a-28a6-4e58-8d45-cb47c46c7f91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47c81e68646e48d395c360fbd5e664d1'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:23.444977 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-d283dc3a-28a6-4e58-8d45-cb47c46c7f91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47c81e68646e48d395c360fbd5e664d1'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:23.445639 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-d283dc3a-28a6-4e58-8d45-cb47c46c7f91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47c81e68646e48d395c360fbd5e664d1'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:23.452639 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1155/2286] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 16:33:23 2022] DELETE /identity/v3/users/47c81e68646e48d395c360fbd5e664d1 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 16:33:23.544816 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4acefeb-f7c5-4985-ac81-381b65f3043f admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:23.546399 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-c4acefeb-f7c5-4985-ac81-381b65f3043f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:23.560535 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4acefeb-f7c5-4985-ac81-381b65f3043f admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:23.565933 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:33:23.642328 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9e2201-cfcd-4507-8877-da6049a76089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:23.642974 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9e2201-cfcd-4507-8877-da6049a76089 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:23.643255 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9e2201-cfcd-4507-8877-da6049a76089 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:23.643530 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9e2201-cfcd-4507-8877-da6049a76089 admin admin] PATH_INFO: `/v3/projects/2f0585a297ac46289eded473c3df2ace` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:23.644702 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9e2201-cfcd-4507-8877-da6049a76089 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f0585a297ac46289eded473c3df2ace)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:23.646681 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9e2201-cfcd-4507-8877-da6049a76089 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:23.697649 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-dc9e2201-cfcd-4507-8877-da6049a76089 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f0585a297ac46289eded473c3df2ace', 'request_id': 'req-dc9e2201-cfcd-4507-8877-da6049a76089'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:23.704571 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-dc9e2201-cfcd-4507-8877-da6049a76089 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f0585a297ac46289eded473c3df2ace', 'request_id': 'req-dc9e2201-cfcd-4507-8877-da6049a76089'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:23.712585 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-dc9e2201-cfcd-4507-8877-da6049a76089 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f0585a297ac46289eded473c3df2ace', 'request_id': 'req-dc9e2201-cfcd-4507-8877-da6049a76089'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:23.726369 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-dc9e2201-cfcd-4507-8877-da6049a76089 admin admin] The token cache is being invalidate because project 2f0585a297ac46289eded473c3df2ace was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81445) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 16:33:23.726570 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-dc9e2201-cfcd-4507-8877-da6049a76089 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:23.727142 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-dc9e2201-cfcd-4507-8877-da6049a76089 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:23.729516 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1132/2287] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 16:33:23 2022] DELETE /identity/v3/projects/2f0585a297ac46289eded473c3df2ace => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:33:23.733380 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d283dc3a-28a6-4e58-8d45-cb47c46c7f91 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:23.735028 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-d283dc3a-28a6-4e58-8d45-cb47c46c7f91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:23.758271 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d283dc3a-28a6-4e58-8d45-cb47c46c7f91 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:23.771275 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9e2201-cfcd-4507-8877-da6049a76089 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:23.773072 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-dc9e2201-cfcd-4507-8877-da6049a76089 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:23.840679 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa002059-4b75-4d93-89f4-7a8df893e985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:23.841710 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa002059-4b75-4d93-89f4-7a8df893e985 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:23.842783 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa002059-4b75-4d93-89f4-7a8df893e985 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:23.842783 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa002059-4b75-4d93-89f4-7a8df893e985 admin admin] PATH_INFO: `/v3/users/4e3117dfdb144b2f9ac9e3e1ad94a4dd` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:23.844383 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa002059-4b75-4d93-89f4-7a8df893e985 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e3117dfdb144b2f9ac9e3e1ad94a4dd)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:23.847202 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa002059-4b75-4d93-89f4-7a8df893e985 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:23.881600 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9e2201-cfcd-4507-8877-da6049a76089 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:23.889490 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af2c713-e20b-4544-9ca9-0d1538df4985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:23.890502 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af2c713-e20b-4544-9ca9-0d1538df4985 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:23.891280 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af2c713-e20b-4544-9ca9-0d1538df4985 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:23.891280 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af2c713-e20b-4544-9ca9-0d1538df4985 admin admin] PATH_INFO: `/v3/projects/74bbeead89014384bd30a58ad909c101` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:23.892774 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af2c713-e20b-4544-9ca9-0d1538df4985 admin admin] RBAC: Authorizing `identity:delete_project(project_id=74bbeead89014384bd30a58ad909c101)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:23.894981 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af2c713-e20b-4544-9ca9-0d1538df4985 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:23.913792 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-fa002059-4b75-4d93-89f4-7a8df893e985 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e3117dfdb144b2f9ac9e3e1ad94a4dd'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:23.938886 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-fa002059-4b75-4d93-89f4-7a8df893e985 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e3117dfdb144b2f9ac9e3e1ad94a4dd'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:23.938886 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:33:23.949266 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-fa002059-4b75-4d93-89f4-7a8df893e985 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e3117dfdb144b2f9ac9e3e1ad94a4dd'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:23.949498 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:33:23.962989 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-8af2c713-e20b-4544-9ca9-0d1538df4985 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74bbeead89014384bd30a58ad909c101', 'request_id': 'req-8af2c713-e20b-4544-9ca9-0d1538df4985'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:23.963235 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-fa002059-4b75-4d93-89f4-7a8df893e985 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e3117dfdb144b2f9ac9e3e1ad94a4dd'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:23.963959 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-fa002059-4b75-4d93-89f4-7a8df893e985 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e3117dfdb144b2f9ac9e3e1ad94a4dd'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:23.971900 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-8af2c713-e20b-4544-9ca9-0d1538df4985 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74bbeead89014384bd30a58ad909c101', 'request_id': 'req-8af2c713-e20b-4544-9ca9-0d1538df4985'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:23.976992 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1156/2288] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 16:33:23 2022] DELETE /identity/v3/users/4e3117dfdb144b2f9ac9e3e1ad94a4dd => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 16:33:23.982223 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-8af2c713-e20b-4544-9ca9-0d1538df4985 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74bbeead89014384bd30a58ad909c101', 'request_id': 'req-8af2c713-e20b-4544-9ca9-0d1538df4985'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:23.993770 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-8af2c713-e20b-4544-9ca9-0d1538df4985 admin admin] The token cache is being invalidate because project 74bbeead89014384bd30a58ad909c101 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81445) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 16:33:23.994209 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-8af2c713-e20b-4544-9ca9-0d1538df4985 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:23.994994 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-8af2c713-e20b-4544-9ca9-0d1538df4985 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:23.996647 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1133/2289] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 16:33:23 2022] DELETE /identity/v3/projects/74bbeead89014384bd30a58ad909c101 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:33:24.002779 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef38c27-8514-4c60-ad2e-d753dd2d511c None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:24.003136 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef38c27-8514-4c60-ad2e-d753dd2d511c None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:24.003487 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef38c27-8514-4c60-ad2e-d753dd2d511c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:24.026499 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-6ef38c27-8514-4c60-ad2e-d753dd2d511c None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:33:24.027722 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-6ef38c27-8514-4c60-ad2e-d753dd2d511c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:24.101815 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1157/2290] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:33:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:33:24.110679 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbf529e-2ab8-43d5-9650-964a31fc55f4 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:24.111245 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbf529e-2ab8-43d5-9650-964a31fc55f4 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:24.111617 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbf529e-2ab8-43d5-9650-964a31fc55f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:24.131951 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-3fbf529e-2ab8-43d5-9650-964a31fc55f4 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:33:24.133295 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-3fbf529e-2ab8-43d5-9650-964a31fc55f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:24.150230 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1134/2291] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:33:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:33:24.154948 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef38c27-8514-4c60-ad2e-d753dd2d511c None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:24.165301 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef38c27-8514-4c60-ad2e-d753dd2d511c None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:24.171166 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dc2845-c36f-4c01-9bee-eaab8e891f61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:24.171806 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dc2845-c36f-4c01-9bee-eaab8e891f61 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:24.172110 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dc2845-c36f-4c01-9bee-eaab8e891f61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:24.172405 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dc2845-c36f-4c01-9bee-eaab8e891f61 admin admin] PATH_INFO: `/v3/domains` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:24.173111 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dc2845-c36f-4c01-9bee-eaab8e891f61 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:33:24.173413 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dc2845-c36f-4c01-9bee-eaab8e891f61 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:24.175143 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dc2845-c36f-4c01-9bee-eaab8e891f61 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:24.194460 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1158/2292] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Sep 9 16:33:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:33:24.200255 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbf529e-2ab8-43d5-9650-964a31fc55f4 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:24.211163 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbf529e-2ab8-43d5-9650-964a31fc55f4 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:24.217408 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecb09fe-847a-4233-b2ef-2695efec66a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:24.218028 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecb09fe-847a-4233-b2ef-2695efec66a7 admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:24.218320 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecb09fe-847a-4233-b2ef-2695efec66a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:24.218600 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecb09fe-847a-4233-b2ef-2695efec66a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:24.219242 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecb09fe-847a-4233-b2ef-2695efec66a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:24.221796 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecb09fe-847a-4233-b2ef-2695efec66a7 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:24.227392 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dc2845-c36f-4c01-9bee-eaab8e891f61 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:24.229209 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-c7dc2845-c36f-4c01-9bee-eaab8e891f61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:24.244879 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dc2845-c36f-4c01-9bee-eaab8e891f61 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:24.250821 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e4ebb2-194d-44d2-bd13-0f966582a165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:24.251441 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e4ebb2-194d-44d2-bd13-0f966582a165 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:24.251721 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e4ebb2-194d-44d2-bd13-0f966582a165 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:24.252030 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e4ebb2-194d-44d2-bd13-0f966582a165 admin admin] PATH_INFO: `/v3/users/e82d7742d0164d6f9819dd6981f89ee9` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:24.253123 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e4ebb2-194d-44d2-bd13-0f966582a165 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e82d7742d0164d6f9819dd6981f89ee9)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:24.255127 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e4ebb2-194d-44d2-bd13-0f966582a165 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:24.257286 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1135/2293] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 16:33:24 2022] POST /identity/v3/projects => generated 377 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:33:24.263882 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecb09fe-847a-4233-b2ef-2695efec66a7 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:24.329180 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-e2e4ebb2-194d-44d2-bd13-0f966582a165 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e82d7742d0164d6f9819dd6981f89ee9'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:24.345280 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecb09fe-847a-4233-b2ef-2695efec66a7 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:24.345610 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-e2e4ebb2-194d-44d2-bd13-0f966582a165 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e82d7742d0164d6f9819dd6981f89ee9'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:24.350293 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f906f0ad-cceb-40e0-b1f4-330946ade805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:24.350943 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f906f0ad-cceb-40e0-b1f4-330946ade805 admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:24.351220 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f906f0ad-cceb-40e0-b1f4-330946ade805 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:24.351498 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f906f0ad-cceb-40e0-b1f4-330946ade805 admin admin] PATH_INFO: `/v3/users` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:24.352200 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f906f0ad-cceb-40e0-b1f4-330946ade805 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:24.354202 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f906f0ad-cceb-40e0-b1f4-330946ade805 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:24.362644 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-e2e4ebb2-194d-44d2-bd13-0f966582a165 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e82d7742d0164d6f9819dd6981f89ee9'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:24.370614 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-e2e4ebb2-194d-44d2-bd13-0f966582a165 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e82d7742d0164d6f9819dd6981f89ee9'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:24.371261 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-e2e4ebb2-194d-44d2-bd13-0f966582a165 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e82d7742d0164d6f9819dd6981f89ee9'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:24.378410 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1136/2294] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 16:33:24 2022] POST /identity/v3/users => generated 289 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:33:24.378551 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1159/2295] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 16:33:24 2022] DELETE /identity/v3/users/e82d7742d0164d6f9819dd6981f89ee9 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:33:24.378663 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f906f0ad-cceb-40e0-b1f4-330946ade805 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:24.379800 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-f906f0ad-cceb-40e0-b1f4-330946ade805 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:24.381559 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce2e3db-2fd4-4ca0-9ec3-d1bf5eba61d9 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:24.381845 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce2e3db-2fd4-4ca0-9ec3-d1bf5eba61d9 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:24.382187 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce2e3db-2fd4-4ca0-9ec3-d1bf5eba61d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:24.392530 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f906f0ad-cceb-40e0-b1f4-330946ade805 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:24.404216 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-5ce2e3db-2fd4-4ca0-9ec3-d1bf5eba61d9 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:33:24.405745 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-5ce2e3db-2fd4-4ca0-9ec3-d1bf5eba61d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:24.440014 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:33:24.456350 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b6846f-3541-4cf3-b49e-1f3733bb2de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:24.457025 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b6846f-3541-4cf3-b49e-1f3733bb2de1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:24.457306 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b6846f-3541-4cf3-b49e-1f3733bb2de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:24.457585 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b6846f-3541-4cf3-b49e-1f3733bb2de1 admin admin] PATH_INFO: `/v3/projects/a790b2f60cab456bb190fde50dd2fd6c` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:24.459364 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b6846f-3541-4cf3-b49e-1f3733bb2de1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a790b2f60cab456bb190fde50dd2fd6c)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:24.461562 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b6846f-3541-4cf3-b49e-1f3733bb2de1 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:24.472183 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1160/2296] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:33:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:33:24.476363 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce2e3db-2fd4-4ca0-9ec3-d1bf5eba61d9 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:24.479409 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-5ce2e3db-2fd4-4ca0-9ec3-d1bf5eba61d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:24.494261 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce2e3db-2fd4-4ca0-9ec3-d1bf5eba61d9 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:24.498409 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=89,keystone:DELETE=6,keystone:INSERT=5 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:33:24.499029 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f7036a-fbf1-4f3e-9fac-c593f0cebfc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:24.499681 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f7036a-fbf1-4f3e-9fac-c593f0cebfc7 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:24.499993 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f7036a-fbf1-4f3e-9fac-c593f0cebfc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:24.500341 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f7036a-fbf1-4f3e-9fac-c593f0cebfc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:24.501012 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f7036a-fbf1-4f3e-9fac-c593f0cebfc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:24.502675 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f7036a-fbf1-4f3e-9fac-c593f0cebfc7 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:24.514512 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1161/2297] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:33:24 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:33:24.515455 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f7036a-fbf1-4f3e-9fac-c593f0cebfc7 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:24.517149 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-28f7036a-fbf1-4f3e-9fac-c593f0cebfc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:24.518265 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-90b6846f-3541-4cf3-b49e-1f3733bb2de1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a790b2f60cab456bb190fde50dd2fd6c', 'request_id': 'req-90b6846f-3541-4cf3-b49e-1f3733bb2de1'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:24.526396 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-90b6846f-3541-4cf3-b49e-1f3733bb2de1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a790b2f60cab456bb190fde50dd2fd6c', 'request_id': 'req-90b6846f-3541-4cf3-b49e-1f3733bb2de1'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:24.534014 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-90b6846f-3541-4cf3-b49e-1f3733bb2de1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a790b2f60cab456bb190fde50dd2fd6c', 'request_id': 'req-90b6846f-3541-4cf3-b49e-1f3733bb2de1'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:24.546490 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-90b6846f-3541-4cf3-b49e-1f3733bb2de1 admin admin] The token cache is being invalidate because project a790b2f60cab456bb190fde50dd2fd6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81445) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 16:33:24.546783 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-90b6846f-3541-4cf3-b49e-1f3733bb2de1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:24.547453 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-90b6846f-3541-4cf3-b49e-1f3733bb2de1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:24.548964 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1137/2298] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 16:33:24 2022] DELETE /identity/v3/projects/a790b2f60cab456bb190fde50dd2fd6c => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:33:24.551957 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b6846f-3541-4cf3-b49e-1f3733bb2de1 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:24.551957 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-90b6846f-3541-4cf3-b49e-1f3733bb2de1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:24.585912 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f7036a-fbf1-4f3e-9fac-c593f0cebfc7 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:24.618577 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b6846f-3541-4cf3-b49e-1f3733bb2de1 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:24.623882 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bd6549-d828-470a-8c10-573424489f18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:24.624477 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bd6549-d828-470a-8c10-573424489f18 admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:24.624779 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bd6549-d828-470a-8c10-573424489f18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:24.625047 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bd6549-d828-470a-8c10-573424489f18 admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:24.625684 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bd6549-d828-470a-8c10-573424489f18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:24.627357 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bd6549-d828-470a-8c10-573424489f18 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:24.637142 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1138/2299] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:33:24 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:33:24.638003 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bd6549-d828-470a-8c10-573424489f18 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:24.639632 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-00bd6549-d828-470a-8c10-573424489f18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:24.642074 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc66ede-a21f-4072-854d-7b6d61120718 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f44bfdd5214e8d84a2c0a5b1fd9b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:24.642739 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc66ede-a21f-4072-854d-7b6d61120718 service neutron] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:24.643013 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc66ede-a21f-4072-854d-7b6d61120718 service neutron] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:24.643280 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc66ede-a21f-4072-854d-7b6d61120718 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:24.645000 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-9bc66ede-a21f-4072-854d-7b6d61120718 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:24.652178 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bd6549-d828-470a-8c10-573424489f18 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:24.656835 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b492166a-612b-402a-bc78-1ef96e0d5b0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:24.657321 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc66ede-a21f-4072-854d-7b6d61120718 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:24.657438 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b492166a-612b-402a-bc78-1ef96e0d5b0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:24.657694 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b492166a-612b-402a-bc78-1ef96e0d5b0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:24.657959 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b492166a-612b-402a-bc78-1ef96e0d5b0e admin admin] PATH_INFO: `/v3/users/58dde7cebd90473a9d3ce2137393c120` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:24.658804 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc66ede-a21f-4072-854d-7b6d61120718 service neutron] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:24.659103 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b492166a-612b-402a-bc78-1ef96e0d5b0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=58dde7cebd90473a9d3ce2137393c120)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:24.660992 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b492166a-612b-402a-bc78-1ef96e0d5b0e admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:24.668329 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1162/2300] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:33:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:33:24.669614 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc66ede-a21f-4072-854d-7b6d61120718 service neutron] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:24.683621 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc66ede-a21f-4072-854d-7b6d61120718 service neutron] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:24.690083 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3664beef-7fa6-4ad3-9c23-2c6dcdf52da3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:24.690841 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3664beef-7fa6-4ad3-9c23-2c6dcdf52da3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:24.691119 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3664beef-7fa6-4ad3-9c23-2c6dcdf52da3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:24.691655 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3664beef-7fa6-4ad3-9c23-2c6dcdf52da3 admin admin] PATH_INFO: `/v3/projects/b232b16345bf47719cc9c5376cf065df/users/aedf6978cce94027a5f111779c0a7354/roles/b38e84bf077846ee802e6bb1bad83522` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:24.707090 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3664beef-7fa6-4ad3-9c23-2c6dcdf52da3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b232b16345bf47719cc9c5376cf065df, user_id=aedf6978cce94027a5f111779c0a7354, role_id=b38e84bf077846ee802e6bb1bad83522)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:24.709810 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3664beef-7fa6-4ad3-9c23-2c6dcdf52da3 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:24.713685 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-b492166a-612b-402a-bc78-1ef96e0d5b0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58dde7cebd90473a9d3ce2137393c120'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:24.726100 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1163/2301] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 16:33:24 2022] PUT /identity/v3/projects/b232b16345bf47719cc9c5376cf065df/users/aedf6978cce94027a5f111779c0a7354/roles/b38e84bf077846ee802e6bb1bad83522 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:33:24.726450 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-b492166a-612b-402a-bc78-1ef96e0d5b0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58dde7cebd90473a9d3ce2137393c120'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:24.727197 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-b492166a-612b-402a-bc78-1ef96e0d5b0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58dde7cebd90473a9d3ce2137393c120'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:24.735396 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-b492166a-612b-402a-bc78-1ef96e0d5b0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58dde7cebd90473a9d3ce2137393c120'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:24.737829 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb93ff23-862b-48b4-9d1b-10de3f45d38f None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:24.738114 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb93ff23-862b-48b4-9d1b-10de3f45d38f None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:24.738415 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb93ff23-862b-48b4-9d1b-10de3f45d38f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:24.758482 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-b492166a-612b-402a-bc78-1ef96e0d5b0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58dde7cebd90473a9d3ce2137393c120'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:24.766454 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1139/2302] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 16:33:24 2022] DELETE /identity/v3/users/58dde7cebd90473a9d3ce2137393c120 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:33:24.778612 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-bb93ff23-862b-48b4-9d1b-10de3f45d38f None None] MFA Rules not processed for user `aedf6978cce94027a5f111779c0a7354`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:33:24.779862 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-bb93ff23-862b-48b4-9d1b-10de3f45d38f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:24.843290 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:33:24.855767 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1164/2303] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:33:24 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 16:33:24.862937 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b492166a-612b-402a-bc78-1ef96e0d5b0e admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:24.864614 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-b492166a-612b-402a-bc78-1ef96e0d5b0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:24.936407 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:33:24.980895 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b492166a-612b-402a-bc78-1ef96e0d5b0e admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:24.986641 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e625c886-8a66-4930-af1f-654657e86cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:24.987329 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e625c886-8a66-4930-af1f-654657e86cb4 admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:24.988183 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e625c886-8a66-4930-af1f-654657e86cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:24.988864 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e625c886-8a66-4930-af1f-654657e86cb4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:24.989209 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e625c886-8a66-4930-af1f-654657e86cb4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:24.991426 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e625c886-8a66-4930-af1f-654657e86cb4 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:25.034002 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb93ff23-862b-48b4-9d1b-10de3f45d38f None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:25.037836 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1140/2304] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 16:33:24 2022] POST /identity/v3/projects => generated 377 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:33:25.038905 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-bb93ff23-862b-48b4-9d1b-10de3f45d38f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:25.039014 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e625c886-8a66-4930-af1f-654657e86cb4 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:25.059514 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb93ff23-862b-48b4-9d1b-10de3f45d38f None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:25.125389 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e625c886-8a66-4930-af1f-654657e86cb4 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:25.132225 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c858c84f-e414-44a9-aac1-2f80b2af20d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:25.133549 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c858c84f-e414-44a9-aac1-2f80b2af20d7 admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:25.133749 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3dd163-baa4-44b1-9dc1-3420cb0808c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:25.134233 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c858c84f-e414-44a9-aac1-2f80b2af20d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:25.134586 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3dd163-baa4-44b1-9dc1-3420cb0808c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:25.134866 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3dd163-baa4-44b1-9dc1-3420cb0808c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:25.135331 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c858c84f-e414-44a9-aac1-2f80b2af20d7 admin admin] PATH_INFO: `/v3/users` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:25.135438 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3dd163-baa4-44b1-9dc1-3420cb0808c1 admin admin] PATH_INFO: `/v3/projects/287b3cfb830f4ae99aea938d62c14c80` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:25.136536 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c858c84f-e414-44a9-aac1-2f80b2af20d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:25.136664 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3dd163-baa4-44b1-9dc1-3420cb0808c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=287b3cfb830f4ae99aea938d62c14c80)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:25.139349 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3dd163-baa4-44b1-9dc1-3420cb0808c1 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:25.140342 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c858c84f-e414-44a9-aac1-2f80b2af20d7 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:25.170934 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1141/2305] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 16:33:25 2022] POST /identity/v3/users => generated 289 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 16:33:25.178677 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c858c84f-e414-44a9-aac1-2f80b2af20d7 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:25.192131 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c858c84f-e414-44a9-aac1-2f80b2af20d7 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:25.198246 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-0e3dd163-baa4-44b1-9dc1-3420cb0808c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '287b3cfb830f4ae99aea938d62c14c80', 'request_id': 'req-0e3dd163-baa4-44b1-9dc1-3420cb0808c1'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:25.205392 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-0e3dd163-baa4-44b1-9dc1-3420cb0808c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '287b3cfb830f4ae99aea938d62c14c80', 'request_id': 'req-0e3dd163-baa4-44b1-9dc1-3420cb0808c1'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:25.214503 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-0e3dd163-baa4-44b1-9dc1-3420cb0808c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '287b3cfb830f4ae99aea938d62c14c80', 'request_id': 'req-0e3dd163-baa4-44b1-9dc1-3420cb0808c1'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:25.227159 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-0e3dd163-baa4-44b1-9dc1-3420cb0808c1 admin admin] The token cache is being invalidate because project 287b3cfb830f4ae99aea938d62c14c80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81446) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 16:33:25.227455 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-0e3dd163-baa4-44b1-9dc1-3420cb0808c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:25.228112 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-0e3dd163-baa4-44b1-9dc1-3420cb0808c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:25.229842 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1165/2306] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 16:33:25 2022] DELETE /identity/v3/projects/287b3cfb830f4ae99aea938d62c14c80 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:33:25.235714 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2689d36-cf3f-4731-a70f-e9ff31973201 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:25.235991 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2689d36-cf3f-4731-a70f-e9ff31973201 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:25.236264 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2689d36-cf3f-4731-a70f-e9ff31973201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:25.268211 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-d2689d36-cf3f-4731-a70f-e9ff31973201 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:33:25.269896 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-d2689d36-cf3f-4731-a70f-e9ff31973201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:25.279155 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63422b0-f293-4ae6-8979-49e02b5af00d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:25.279814 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63422b0-f293-4ae6-8979-49e02b5af00d admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:25.280083 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63422b0-f293-4ae6-8979-49e02b5af00d admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:25.280382 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63422b0-f293-4ae6-8979-49e02b5af00d admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:25.281063 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63422b0-f293-4ae6-8979-49e02b5af00d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:25.282672 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63422b0-f293-4ae6-8979-49e02b5af00d admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:25.298477 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1142/2307] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:33:25 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:33:25.302070 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63422b0-f293-4ae6-8979-49e02b5af00d admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:25.304089 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-b63422b0-f293-4ae6-8979-49e02b5af00d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:25.318846 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63422b0-f293-4ae6-8979-49e02b5af00d admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:25.328308 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49548726-d2d8-45d9-a0a3-01a73b6f1d82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:25.328940 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49548726-d2d8-45d9-a0a3-01a73b6f1d82 admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:25.329249 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49548726-d2d8-45d9-a0a3-01a73b6f1d82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:25.330493 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49548726-d2d8-45d9-a0a3-01a73b6f1d82 admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:25.331148 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49548726-d2d8-45d9-a0a3-01a73b6f1d82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:25.332905 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49548726-d2d8-45d9-a0a3-01a73b6f1d82 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:25.347471 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1143/2308] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:33:25 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 16:33:25.348473 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49548726-d2d8-45d9-a0a3-01a73b6f1d82 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:25.351369 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-49548726-d2d8-45d9-a0a3-01a73b6f1d82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:25.357804 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1166/2309] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:33:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:33:25.358812 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2689d36-cf3f-4731-a70f-e9ff31973201 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:25.367055 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49548726-d2d8-45d9-a0a3-01a73b6f1d82 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:25.369031 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2689d36-cf3f-4731-a70f-e9ff31973201 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:25.371961 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4867740-0273-4159-b216-25d5c4d4d963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:25.372583 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4867740-0273-4159-b216-25d5c4d4d963 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:25.372864 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4867740-0273-4159-b216-25d5c4d4d963 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:25.373138 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4867740-0273-4159-b216-25d5c4d4d963 admin admin] PATH_INFO: `/v3/projects/22ca6dbb62ae40c28c1fa0ad7a87ad3d` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:25.373686 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0d7435-fe1d-4936-a8a1-cd559b044e75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:25.374376 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0d7435-fe1d-4936-a8a1-cd559b044e75 admin admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:25.374481 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4867740-0273-4159-b216-25d5c4d4d963 admin admin] RBAC: Authorizing `identity:delete_project(project_id=22ca6dbb62ae40c28c1fa0ad7a87ad3d)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:25.374793 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0d7435-fe1d-4936-a8a1-cd559b044e75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:25.374937 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0d7435-fe1d-4936-a8a1-cd559b044e75 admin admin] PATH_INFO: `/v3/projects/8c0cbda9d2f04e4fb9e443833942f300/users/547a2fe7df454510bb2648868f2fab7b/roles/b38e84bf077846ee802e6bb1bad83522` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:25.376629 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4867740-0273-4159-b216-25d5c4d4d963 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:25.393725 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0d7435-fe1d-4936-a8a1-cd559b044e75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c0cbda9d2f04e4fb9e443833942f300, user_id=547a2fe7df454510bb2648868f2fab7b, role_id=b38e84bf077846ee802e6bb1bad83522)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:25.396399 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0d7435-fe1d-4936-a8a1-cd559b044e75 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:25.404149 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:33:25.406637 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:33:25.412211 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1167/2310] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 16:33:25 2022] PUT /identity/v3/projects/8c0cbda9d2f04e4fb9e443833942f300/users/547a2fe7df454510bb2648868f2fab7b/roles/b38e84bf077846ee802e6bb1bad83522 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:33:25.420308 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a68ce7-4405-438c-a5e9-243382facf03 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:25.420658 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a68ce7-4405-438c-a5e9-243382facf03 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:25.421611 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a68ce7-4405-438c-a5e9-243382facf03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:25.429063 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-d4867740-0273-4159-b216-25d5c4d4d963 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22ca6dbb62ae40c28c1fa0ad7a87ad3d', 'request_id': 'req-d4867740-0273-4159-b216-25d5c4d4d963'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:25.438732 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-d4867740-0273-4159-b216-25d5c4d4d963 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22ca6dbb62ae40c28c1fa0ad7a87ad3d', 'request_id': 'req-d4867740-0273-4159-b216-25d5c4d4d963'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:25.442558 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-78a68ce7-4405-438c-a5e9-243382facf03 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:33:25.443979 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-78a68ce7-4405-438c-a5e9-243382facf03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:25.448088 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-d4867740-0273-4159-b216-25d5c4d4d963 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22ca6dbb62ae40c28c1fa0ad7a87ad3d', 'request_id': 'req-d4867740-0273-4159-b216-25d5c4d4d963'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:25.460828 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-d4867740-0273-4159-b216-25d5c4d4d963 admin admin] The token cache is being invalidate because project 22ca6dbb62ae40c28c1fa0ad7a87ad3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81445) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 16:33:25.461525 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-d4867740-0273-4159-b216-25d5c4d4d963 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:25.462423 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-d4867740-0273-4159-b216-25d5c4d4d963 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:25.464458 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1144/2311] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 16:33:25 2022] DELETE /identity/v3/projects/22ca6dbb62ae40c28c1fa0ad7a87ad3d => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:33:25.466534 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd949cf7-1792-4646-982c-4129b2fa043d None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:25.466819 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd949cf7-1792-4646-982c-4129b2fa043d None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:25.467092 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd949cf7-1792-4646-982c-4129b2fa043d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:25.496689 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-fd949cf7-1792-4646-982c-4129b2fa043d None None] MFA Rules not processed for user `547a2fe7df454510bb2648868f2fab7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:33:25.498555 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-fd949cf7-1792-4646-982c-4129b2fa043d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:25.509792 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1168/2312] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:33:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:33:25.511129 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b1cdfd-e3d5-4c35-8190-81e460d37865 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:25.511436 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b1cdfd-e3d5-4c35-8190-81e460d37865 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:25.511733 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b1cdfd-e3d5-4c35-8190-81e460d37865 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:25.532914 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-b2b1cdfd-e3d5-4c35-8190-81e460d37865 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:33:25.534203 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-b2b1cdfd-e3d5-4c35-8190-81e460d37865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:25.543491 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1169/2313] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:33:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:33:25.544136 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b1cdfd-e3d5-4c35-8190-81e460d37865 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:25.554079 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b1cdfd-e3d5-4c35-8190-81e460d37865 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:25.559268 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5924a147-3575-49a1-98cc-9a60096a02f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:25.560558 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5924a147-3575-49a1-98cc-9a60096a02f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:25.561300 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5924a147-3575-49a1-98cc-9a60096a02f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:25.561300 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5924a147-3575-49a1-98cc-9a60096a02f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:25.562169 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5924a147-3575-49a1-98cc-9a60096a02f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:33:25.562169 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5924a147-3575-49a1-98cc-9a60096a02f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:25.563859 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5924a147-3575-49a1-98cc-9a60096a02f6 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:25.571336 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1145/2314] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:33:25 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:33:25.572682 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9d1b9f-f69c-4b84-ac29-7695b5da7ccf None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:25.572976 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9d1b9f-f69c-4b84-ac29-7695b5da7ccf None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:25.573250 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9d1b9f-f69c-4b84-ac29-7695b5da7ccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:25.579941 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1170/2315] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Sep 9 16:33:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:33:25.580840 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5924a147-3575-49a1-98cc-9a60096a02f6 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:25.582585 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-5924a147-3575-49a1-98cc-9a60096a02f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:25.596231 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5924a147-3575-49a1-98cc-9a60096a02f6 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:25.597281 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-ed9d1b9f-f69c-4b84-ac29-7695b5da7ccf None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:33:25.598548 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-ed9d1b9f-f69c-4b84-ac29-7695b5da7ccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:25.601087 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4e726c-ba8e-4160-810b-c57b776e0926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:25.601639 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4e726c-ba8e-4160-810b-c57b776e0926 admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:25.601914 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4e726c-ba8e-4160-810b-c57b776e0926 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:25.602210 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4e726c-ba8e-4160-810b-c57b776e0926 admin admin] PATH_INFO: `/v3/projects` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:25.602867 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4e726c-ba8e-4160-810b-c57b776e0926 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:25.604756 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4e726c-ba8e-4160-810b-c57b776e0926 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:25.606571 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1146/2316] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:33:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:33:25.607320 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9d1b9f-f69c-4b84-ac29-7695b5da7ccf None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:25.616876 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9d1b9f-f69c-4b84-ac29-7695b5da7ccf None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:25.621439 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25dcc9b-aaa7-4e9a-b3ce-be44cb22abe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:25.622578 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25dcc9b-aaa7-4e9a-b3ce-be44cb22abe4 admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:25.622835 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25dcc9b-aaa7-4e9a-b3ce-be44cb22abe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:25.623105 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25dcc9b-aaa7-4e9a-b3ce-be44cb22abe4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:25.623707 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25dcc9b-aaa7-4e9a-b3ce-be44cb22abe4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:25.625604 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25dcc9b-aaa7-4e9a-b3ce-be44cb22abe4 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:25.638835 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1171/2317] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 16:33:25 2022] POST /identity/v3/projects => generated 377 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:33:25.639714 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4e726c-ba8e-4160-810b-c57b776e0926 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:25.659597 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1147/2318] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 16:33:25 2022] POST /identity/v3/projects => generated 383 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:33:25.661232 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25dcc9b-aaa7-4e9a-b3ce-be44cb22abe4 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:25.709948 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4e726c-ba8e-4160-810b-c57b776e0926 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:25.727475 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25dcc9b-aaa7-4e9a-b3ce-be44cb22abe4 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:25.732224 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236ac30d-f2b4-448f-b85d-e63cf9aa08ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:25.732826 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236ac30d-f2b4-448f-b85d-e63cf9aa08ab admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:25.733099 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236ac30d-f2b4-448f-b85d-e63cf9aa08ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:25.733361 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236ac30d-f2b4-448f-b85d-e63cf9aa08ab admin admin] PATH_INFO: `/v3/users` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:25.734022 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236ac30d-f2b4-448f-b85d-e63cf9aa08ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:25.735981 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236ac30d-f2b4-448f-b85d-e63cf9aa08ab admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:25.756541 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:DELETE=7,keystone:SELECT=88,keystone:INSERT=5 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:33:25.765592 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1148/2319] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 16:33:25 2022] POST /identity/v3/users => generated 295 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:33:25.765592 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236ac30d-f2b4-448f-b85d-e63cf9aa08ab admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:25.772483 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81958ec0-4482-4570-8bbb-af401bb2c634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:25.773098 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81958ec0-4482-4570-8bbb-af401bb2c634 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:25.773378 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81958ec0-4482-4570-8bbb-af401bb2c634 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:25.773643 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81958ec0-4482-4570-8bbb-af401bb2c634 admin admin] PATH_INFO: `/v3/domains` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:25.774275 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81958ec0-4482-4570-8bbb-af401bb2c634 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:33:25.774760 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81958ec0-4482-4570-8bbb-af401bb2c634 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:25.775904 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236ac30d-f2b4-448f-b85d-e63cf9aa08ab admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:25.776355 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81958ec0-4482-4570-8bbb-af401bb2c634 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:25.781069 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53d0919-3fc9-4be9-ac10-e0845282990b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:25.781677 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53d0919-3fc9-4be9-ac10-e0845282990b admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:25.781981 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53d0919-3fc9-4be9-ac10-e0845282990b admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:25.782249 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53d0919-3fc9-4be9-ac10-e0845282990b admin admin] PATH_INFO: `/v3/users` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:25.782884 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53d0919-3fc9-4be9-ac10-e0845282990b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:25.784825 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53d0919-3fc9-4be9-ac10-e0845282990b admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:25.785211 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:33:25.793297 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1172/2320] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Sep 9 16:33:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:33:25.793297 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81958ec0-4482-4570-8bbb-af401bb2c634 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:25.803915 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81958ec0-4482-4570-8bbb-af401bb2c634 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:25.807221 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1149/2321] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 16:33:25 2022] POST /identity/v3/users => generated 292 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:33:25.807984 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53d0919-3fc9-4be9-ac10-e0845282990b admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:25.812051 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b246be41-de14-4aff-a13a-d8dc2c94a59e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:25.812762 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b246be41-de14-4aff-a13a-d8dc2c94a59e admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:25.813053 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b246be41-de14-4aff-a13a-d8dc2c94a59e admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:25.813520 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b246be41-de14-4aff-a13a-d8dc2c94a59e admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:25.814159 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b246be41-de14-4aff-a13a-d8dc2c94a59e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:25.816809 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b246be41-de14-4aff-a13a-d8dc2c94a59e admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:25.818976 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53d0919-3fc9-4be9-ac10-e0845282990b admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:25.823704 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a432309-a8ab-45b3-818d-9a9fff0a85a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:25.824325 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a432309-a8ab-45b3-818d-9a9fff0a85a3 admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:25.824603 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a432309-a8ab-45b3-818d-9a9fff0a85a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:25.824871 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a432309-a8ab-45b3-818d-9a9fff0a85a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:25.826041 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a432309-a8ab-45b3-818d-9a9fff0a85a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:25.827970 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a432309-a8ab-45b3-818d-9a9fff0a85a3 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:25.828865 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1173/2322] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:33:25 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:33:25.829697 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b246be41-de14-4aff-a13a-d8dc2c94a59e admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:25.841546 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b246be41-de14-4aff-a13a-d8dc2c94a59e admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:25.846252 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160b6c7e-0460-4e6d-931a-22b5d70df19b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:25.846866 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160b6c7e-0460-4e6d-931a-22b5d70df19b admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:25.847181 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160b6c7e-0460-4e6d-931a-22b5d70df19b admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:25.847494 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160b6c7e-0460-4e6d-931a-22b5d70df19b admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:25.848204 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160b6c7e-0460-4e6d-931a-22b5d70df19b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:25.850028 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160b6c7e-0460-4e6d-931a-22b5d70df19b admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:25.859260 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1150/2323] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 16:33:25 2022] POST /identity/v3/projects => generated 389 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:33:25.860058 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a432309-a8ab-45b3-818d-9a9fff0a85a3 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:25.863935 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1174/2324] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:33:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:33:25.863935 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160b6c7e-0460-4e6d-931a-22b5d70df19b admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:25.874748 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160b6c7e-0460-4e6d-931a-22b5d70df19b admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:25.929602 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a432309-a8ab-45b3-818d-9a9fff0a85a3 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:25.932905 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a47bbe-1cb4-4812-a04a-d60eb7ca1835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:25.933542 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a47bbe-1cb4-4812-a04a-d60eb7ca1835 admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:25.933820 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a47bbe-1cb4-4812-a04a-d60eb7ca1835 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:25.934093 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a47bbe-1cb4-4812-a04a-d60eb7ca1835 admin admin] PATH_INFO: `/v3/users` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:25.934956 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143a49c6-4d62-435a-8e2d-e089ac92c617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:25.935303 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a47bbe-1cb4-4812-a04a-d60eb7ca1835 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:25.935507 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143a49c6-4d62-435a-8e2d-e089ac92c617 admin admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:25.935785 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143a49c6-4d62-435a-8e2d-e089ac92c617 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:25.936053 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143a49c6-4d62-435a-8e2d-e089ac92c617 admin admin] PATH_INFO: `/v3/projects/74bca398bb7c452997d19d69200387d3/users/1ab903ff578e43688bf7b9a40ae36250/roles/0a36d1be416f4089be19be979943b731` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:25.937219 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a47bbe-1cb4-4812-a04a-d60eb7ca1835 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:25.951385 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143a49c6-4d62-435a-8e2d-e089ac92c617 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74bca398bb7c452997d19d69200387d3, user_id=1ab903ff578e43688bf7b9a40ae36250, role_id=0a36d1be416f4089be19be979943b731)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:25.954077 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143a49c6-4d62-435a-8e2d-e089ac92c617 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:25.966727 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1175/2325] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 16:33:25 2022] POST /identity/v3/users => generated 295 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:33:25.966727 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a47bbe-1cb4-4812-a04a-d60eb7ca1835 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:25.968723 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1151/2326] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 16:33:25 2022] PUT /identity/v3/projects/74bca398bb7c452997d19d69200387d3/users/1ab903ff578e43688bf7b9a40ae36250/roles/0a36d1be416f4089be19be979943b731 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:33:25.969718 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143a49c6-4d62-435a-8e2d-e089ac92c617 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:25.975325 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a47bbe-1cb4-4812-a04a-d60eb7ca1835 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:26.031381 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae39965-7a5c-421c-919f-cb1f802e332d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:26.032088 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae39965-7a5c-421c-919f-cb1f802e332d admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:26.032482 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae39965-7a5c-421c-919f-cb1f802e332d admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:26.032756 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae39965-7a5c-421c-919f-cb1f802e332d admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:26.033389 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae39965-7a5c-421c-919f-cb1f802e332d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:26.033997 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143a49c6-4d62-435a-8e2d-e089ac92c617 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:26.035373 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae39965-7a5c-421c-919f-cb1f802e332d admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:26.039054 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9928c0a-8bb7-46e5-9258-979358ae4702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:26.039664 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9928c0a-8bb7-46e5-9258-979358ae4702 admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:26.039943 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9928c0a-8bb7-46e5-9258-979358ae4702 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:26.040213 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9928c0a-8bb7-46e5-9258-979358ae4702 admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:26.040887 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9928c0a-8bb7-46e5-9258-979358ae4702 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:26.042548 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9928c0a-8bb7-46e5-9258-979358ae4702 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:26.051688 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1176/2327] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:33:25 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:33:26.052631 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae39965-7a5c-421c-919f-cb1f802e332d admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:26.053241 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1152/2328] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:33:25 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:33:26.055806 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9928c0a-8bb7-46e5-9258-979358ae4702 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:26.063604 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae39965-7a5c-421c-919f-cb1f802e332d admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:26.066817 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9928c0a-8bb7-46e5-9258-979358ae4702 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:26.068627 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fec2282-76ff-45c1-8cbd-8cc929aa53e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:26.069219 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fec2282-76ff-45c1-8cbd-8cc929aa53e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:26.069479 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fec2282-76ff-45c1-8cbd-8cc929aa53e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:26.069745 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fec2282-76ff-45c1-8cbd-8cc929aa53e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:26.070394 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fec2282-76ff-45c1-8cbd-8cc929aa53e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:26.071399 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf96e4a4-ad25-40c7-b542-88f1824b7060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:26.072017 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf96e4a4-ad25-40c7-b542-88f1824b7060 admin admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:26.072111 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fec2282-76ff-45c1-8cbd-8cc929aa53e2 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:26.072342 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf96e4a4-ad25-40c7-b542-88f1824b7060 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:26.072619 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf96e4a4-ad25-40c7-b542-88f1824b7060 admin admin] PATH_INFO: `/v3/projects/3053b6ffe03c40a0a2831d64c90ad3d9/users/44f59fc6c4044b9491e9eded27d9422e/roles/b38e84bf077846ee802e6bb1bad83522` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:26.082986 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1177/2329] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:33:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:33:26.083756 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fec2282-76ff-45c1-8cbd-8cc929aa53e2 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:26.091387 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf96e4a4-ad25-40c7-b542-88f1824b7060 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3053b6ffe03c40a0a2831d64c90ad3d9, user_id=44f59fc6c4044b9491e9eded27d9422e, role_id=b38e84bf077846ee802e6bb1bad83522)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:26.093305 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fec2282-76ff-45c1-8cbd-8cc929aa53e2 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:26.094133 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf96e4a4-ad25-40c7-b542-88f1824b7060 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:26.097864 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a28db4-7f9f-46c5-9402-63f583b50379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:26.098631 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a28db4-7f9f-46c5-9402-63f583b50379 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:26.098918 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a28db4-7f9f-46c5-9402-63f583b50379 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:26.099257 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a28db4-7f9f-46c5-9402-63f583b50379 admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:26.099953 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a28db4-7f9f-46c5-9402-63f583b50379 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:26.101566 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a28db4-7f9f-46c5-9402-63f583b50379 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:26.108215 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1153/2330] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 16:33:26 2022] PUT /identity/v3/projects/3053b6ffe03c40a0a2831d64c90ad3d9/users/44f59fc6c4044b9491e9eded27d9422e/roles/b38e84bf077846ee802e6bb1bad83522 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 16:33:26.112076 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf96e4a4-ad25-40c7-b542-88f1824b7060 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:26.114215 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1178/2331] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:33:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:33:26.118732 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2a03ea-28cb-42db-819b-47f94961d3ef None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:26.119018 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2a03ea-28cb-42db-819b-47f94961d3ef None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:26.119291 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2a03ea-28cb-42db-819b-47f94961d3ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:26.131859 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:33:26.144036 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-7e2a03ea-28cb-42db-819b-47f94961d3ef None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:33:26.145258 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-7e2a03ea-28cb-42db-819b-47f94961d3ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:26.191179 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:33:26.191655 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf96e4a4-ad25-40c7-b542-88f1824b7060 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:26.197139 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693fb4bb-004f-4c38-a77f-fe253bac1cd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:26.197833 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693fb4bb-004f-4c38-a77f-fe253bac1cd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:26.198121 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693fb4bb-004f-4c38-a77f-fe253bac1cd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:26.198425 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693fb4bb-004f-4c38-a77f-fe253bac1cd1 admin admin] PATH_INFO: `/v3/projects/74bca398bb7c452997d19d69200387d3/users/1ab903ff578e43688bf7b9a40ae36250/roles/0a36d1be416f4089be19be979943b731` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:26.200518 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693fb4bb-004f-4c38-a77f-fe253bac1cd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74bca398bb7c452997d19d69200387d3, user_id=1ab903ff578e43688bf7b9a40ae36250, role_id=0a36d1be416f4089be19be979943b731)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:26.203275 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693fb4bb-004f-4c38-a77f-fe253bac1cd1 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:26.214143 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1154/2332] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 16:33:26 2022] PUT /identity/v3/projects/74bca398bb7c452997d19d69200387d3/users/1ab903ff578e43688bf7b9a40ae36250/roles/0a36d1be416f4089be19be979943b731 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:33:26.215076 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693fb4bb-004f-4c38-a77f-fe253bac1cd1 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:26.221566 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1179/2333] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:33:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:33:26.224782 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cfd593-5ce3-47cd-a9b7-c64f070248b1 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:26.225304 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cfd593-5ce3-47cd-a9b7-c64f070248b1 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:26.225573 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cfd593-5ce3-47cd-a9b7-c64f070248b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:26.254832 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-66cfd593-5ce3-47cd-a9b7-c64f070248b1 None None] MFA Rules not processed for user `1ab903ff578e43688bf7b9a40ae36250`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:33:26.256145 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-66cfd593-5ce3-47cd-a9b7-c64f070248b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:26.296923 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693fb4bb-004f-4c38-a77f-fe253bac1cd1 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:26.303328 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cacfe12-118e-4b39-baba-18495d750a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:26.303638 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cacfe12-118e-4b39-baba-18495d750a12 admin admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:26.303917 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cacfe12-118e-4b39-baba-18495d750a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:26.304187 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cacfe12-118e-4b39-baba-18495d750a12 admin admin] PATH_INFO: `/v3/projects/e397055ce2394560a53bb5a77dc24c48/users/9d0156aa9d32415bae874d164a19fa17/roles/b38e84bf077846ee802e6bb1bad83522` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:26.321568 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cacfe12-118e-4b39-baba-18495d750a12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e397055ce2394560a53bb5a77dc24c48, user_id=9d0156aa9d32415bae874d164a19fa17, role_id=b38e84bf077846ee802e6bb1bad83522)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:26.324172 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cacfe12-118e-4b39-baba-18495d750a12 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:26.341592 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1180/2334] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:33:26 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 16:33:26.342616 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1155/2335] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 16:33:26 2022] PUT /identity/v3/projects/e397055ce2394560a53bb5a77dc24c48/users/9d0156aa9d32415bae874d164a19fa17/roles/b38e84bf077846ee802e6bb1bad83522 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:33:26.352422 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cfd593-5ce3-47cd-a9b7-c64f070248b1 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:26.352422 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-66cfd593-5ce3-47cd-a9b7-c64f070248b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:26.353689 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cacfe12-118e-4b39-baba-18495d750a12 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:26.355610 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-5cacfe12-118e-4b39-baba-18495d750a12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:26.413679 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cfd593-5ce3-47cd-a9b7-c64f070248b1 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:26.423782 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cacfe12-118e-4b39-baba-18495d750a12 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:26.428571 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd72152-bb94-49c0-92bc-0bebc6e13616 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8078e791ba68460f8b3aeafb4b79b73a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:26.429186 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd72152-bb94-49c0-92bc-0bebc6e13616 service cinder] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:26.429463 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd72152-bb94-49c0-92bc-0bebc6e13616 service cinder] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:26.429734 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd72152-bb94-49c0-92bc-0bebc6e13616 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:26.432102 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-cdd72152-bb94-49c0-92bc-0bebc6e13616 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:26.477189 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e11ba2f-1d5d-4a56-9327-aea8a26bb98c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f44bfdd5214e8d84a2c0a5b1fd9b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:26.477949 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e11ba2f-1d5d-4a56-9327-aea8a26bb98c service neutron] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:26.478392 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e11ba2f-1d5d-4a56-9327-aea8a26bb98c service neutron] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:26.478640 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e11ba2f-1d5d-4a56-9327-aea8a26bb98c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:26.490260 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:33:26.505784 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd72152-bb94-49c0-92bc-0bebc6e13616 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:26.507248 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd72152-bb94-49c0-92bc-0bebc6e13616 service cinder] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:26.518808 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1156/2336] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:33:26 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:33:26.521742 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309d92e8-a5c0-48f6-9a09-37256cfb0211 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:26.522206 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309d92e8-a5c0-48f6-9a09-37256cfb0211 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:26.522510 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309d92e8-a5c0-48f6-9a09-37256cfb0211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:26.528794 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:33:26.555594 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e11ba2f-1d5d-4a56-9327-aea8a26bb98c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:26.557023 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e11ba2f-1d5d-4a56-9327-aea8a26bb98c service neutron] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:26.561398 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-309d92e8-a5c0-48f6-9a09-37256cfb0211 None None] MFA Rules not processed for user `9d0156aa9d32415bae874d164a19fa17`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:33:26.563307 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-309d92e8-a5c0-48f6-9a09-37256cfb0211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:26.570452 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1181/2337] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:33:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:33:26.652771 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1157/2338] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:33:26 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:33:26.665690 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e11ba2f-1d5d-4a56-9327-aea8a26bb98c service neutron] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:26.667656 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-9e11ba2f-1d5d-4a56-9327-aea8a26bb98c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:26.684492 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e11ba2f-1d5d-4a56-9327-aea8a26bb98c service neutron] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:26.689523 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf87fb3-8d07-404e-a67f-b9df38f8532b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8078e791ba68460f8b3aeafb4b79b73a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:26.690478 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf87fb3-8d07-404e-a67f-b9df38f8532b service cinder] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:26.690821 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf87fb3-8d07-404e-a67f-b9df38f8532b service cinder] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:26.691457 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf87fb3-8d07-404e-a67f-b9df38f8532b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:26.703453 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf87fb3-8d07-404e-a67f-b9df38f8532b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:26.704891 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf87fb3-8d07-404e-a67f-b9df38f8532b service cinder] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:26.715457 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1182/2339] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:33:26 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:33:27.306829 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa96df7-595a-47c6-810d-03cdb9be26db None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:27.307114 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa96df7-595a-47c6-810d-03cdb9be26db None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:27.307437 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa96df7-595a-47c6-810d-03cdb9be26db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:27.337686 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-eaa96df7-595a-47c6-810d-03cdb9be26db None None] MFA Rules not processed for user `44f59fc6c4044b9491e9eded27d9422e`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:33:27.338977 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-eaa96df7-595a-47c6-810d-03cdb9be26db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:27.409522 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1158/2340] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:33:27 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:33:27.422028 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf87fb3-8d07-404e-a67f-b9df38f8532b service cinder] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:27.431238 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf87fb3-8d07-404e-a67f-b9df38f8532b service cinder] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:27.434863 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e88c67-6369-4cbb-8ae5-b544b1b93bdd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8078e791ba68460f8b3aeafb4b79b73a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:27.435465 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e88c67-6369-4cbb-8ae5-b544b1b93bdd service cinder] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:27.435739 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e88c67-6369-4cbb-8ae5-b544b1b93bdd service cinder] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:27.436013 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e88c67-6369-4cbb-8ae5-b544b1b93bdd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:27.444865 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e88c67-6369-4cbb-8ae5-b544b1b93bdd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:27.446578 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e88c67-6369-4cbb-8ae5-b544b1b93bdd service cinder] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:27.460521 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1183/2341] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:33:27 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:33:28.108381 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa96df7-595a-47c6-810d-03cdb9be26db None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:28.117941 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa96df7-595a-47c6-810d-03cdb9be26db None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:28.121807 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55e0795-8efc-4016-88e4-e17ebf67913a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8078e791ba68460f8b3aeafb4b79b73a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:28.122437 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55e0795-8efc-4016-88e4-e17ebf67913a service cinder] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:28.122723 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55e0795-8efc-4016-88e4-e17ebf67913a service cinder] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:28.122989 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55e0795-8efc-4016-88e4-e17ebf67913a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:28.184252 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55e0795-8efc-4016-88e4-e17ebf67913a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:28.185699 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55e0795-8efc-4016-88e4-e17ebf67913a service cinder] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:28.194773 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1159/2342] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:33:28 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:33:28.797728 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e88c67-6369-4cbb-8ae5-b544b1b93bdd service cinder] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:28.806432 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e88c67-6369-4cbb-8ae5-b544b1b93bdd service cinder] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:28.811077 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d31197-f990-4f38-8ce4-bc3b41cc348f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8078e791ba68460f8b3aeafb4b79b73a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:28.811681 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d31197-f990-4f38-8ce4-bc3b41cc348f service cinder] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:28.811958 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d31197-f990-4f38-8ce4-bc3b41cc348f service cinder] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:28.812230 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d31197-f990-4f38-8ce4-bc3b41cc348f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:28.836173 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c0aed7-77a3-420a-a013-e1e378022057 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:28.836440 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c0aed7-77a3-420a-a013-e1e378022057 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:28.836725 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c0aed7-77a3-420a-a013-e1e378022057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:28.846757 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:33:28.858687 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-f1c0aed7-77a3-420a-a013-e1e378022057 None None] MFA Rules not processed for user `44f59fc6c4044b9491e9eded27d9422e`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:33:28.859904 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-f1c0aed7-77a3-420a-a013-e1e378022057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:28.867396 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1160/2343] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:33:28 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 16:33:28.901416 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d31197-f990-4f38-8ce4-bc3b41cc348f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:28.902818 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d31197-f990-4f38-8ce4-bc3b41cc348f service cinder] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:28.914100 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1184/2344] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:33:28 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:33:32.873442 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c0aed7-77a3-420a-a013-e1e378022057 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:32.887096 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c0aed7-77a3-420a-a013-e1e378022057 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:32.893312 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf9c6ce-590e-4539-ad9e-d44dab36456c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:32.893952 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf9c6ce-590e-4539-ad9e-d44dab36456c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:32.894397 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf9c6ce-590e-4539-ad9e-d44dab36456c admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:32.894857 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf9c6ce-590e-4539-ad9e-d44dab36456c admin admin] PATH_INFO: `/v3/users/aedf6978cce94027a5f111779c0a7354` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:32.896444 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf9c6ce-590e-4539-ad9e-d44dab36456c admin admin] RBAC: Authorizing `identity:delete_user(user_id=aedf6978cce94027a5f111779c0a7354)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:32.898858 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf9c6ce-590e-4539-ad9e-d44dab36456c admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:32.968011 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-8bf9c6ce-590e-4539-ad9e-d44dab36456c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aedf6978cce94027a5f111779c0a7354'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:32.998165 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-8bf9c6ce-590e-4539-ad9e-d44dab36456c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aedf6978cce94027a5f111779c0a7354'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:33.000317 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-8bf9c6ce-590e-4539-ad9e-d44dab36456c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aedf6978cce94027a5f111779c0a7354'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:33.018888 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-8bf9c6ce-590e-4539-ad9e-d44dab36456c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aedf6978cce94027a5f111779c0a7354'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:33.039500 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-8bf9c6ce-590e-4539-ad9e-d44dab36456c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aedf6978cce94027a5f111779c0a7354'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:33.049839 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1161/2345] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 16:33:32 2022] DELETE /identity/v3/users/aedf6978cce94027a5f111779c0a7354 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:33:33.051622 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbb9fa2-3f74-459b-882d-f5e4de59b917 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:33.052079 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbb9fa2-3f74-459b-882d-f5e4de59b917 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:33.052418 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbb9fa2-3f74-459b-882d-f5e4de59b917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:33.073028 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-ccbb9fa2-3f74-459b-882d-f5e4de59b917 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:33:33.074330 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-ccbb9fa2-3f74-459b-882d-f5e4de59b917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:33.134887 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1185/2346] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:33:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:33:33.147580 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf9c6ce-590e-4539-ad9e-d44dab36456c admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:33.149293 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-8bf9c6ce-590e-4539-ad9e-d44dab36456c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:33.215923 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf9c6ce-590e-4539-ad9e-d44dab36456c admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:33.219950 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc808458-aad6-473f-8701-ea8d275b2c0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f44bfdd5214e8d84a2c0a5b1fd9b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:33.220555 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc808458-aad6-473f-8701-ea8d275b2c0f service neutron] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:33.220831 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc808458-aad6-473f-8701-ea8d275b2c0f service neutron] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:33.221097 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc808458-aad6-473f-8701-ea8d275b2c0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:33.232411 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc808458-aad6-473f-8701-ea8d275b2c0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:33.234060 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc808458-aad6-473f-8701-ea8d275b2c0f service neutron] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:33.243664 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1162/2347] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:33:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:33:33.533587 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbb9fa2-3f74-459b-882d-f5e4de59b917 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:33.535315 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-ccbb9fa2-3f74-459b-882d-f5e4de59b917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:33.560011 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbb9fa2-3f74-459b-882d-f5e4de59b917 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:33.564798 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b622c76b-fa0a-4233-b8b9-110af8bf39a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:33.565365 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b622c76b-fa0a-4233-b8b9-110af8bf39a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:33.565643 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b622c76b-fa0a-4233-b8b9-110af8bf39a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:33.565914 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b622c76b-fa0a-4233-b8b9-110af8bf39a3 admin admin] PATH_INFO: `/v3/projects/b232b16345bf47719cc9c5376cf065df` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:33.567847 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b622c76b-fa0a-4233-b8b9-110af8bf39a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b232b16345bf47719cc9c5376cf065df)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:33.571545 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b622c76b-fa0a-4233-b8b9-110af8bf39a3 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:33.611489 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:33:33.622383 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-b622c76b-fa0a-4233-b8b9-110af8bf39a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b232b16345bf47719cc9c5376cf065df', 'request_id': 'req-b622c76b-fa0a-4233-b8b9-110af8bf39a3'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:33.629137 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-b622c76b-fa0a-4233-b8b9-110af8bf39a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b232b16345bf47719cc9c5376cf065df', 'request_id': 'req-b622c76b-fa0a-4233-b8b9-110af8bf39a3'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:33.639129 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-b622c76b-fa0a-4233-b8b9-110af8bf39a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b232b16345bf47719cc9c5376cf065df', 'request_id': 'req-b622c76b-fa0a-4233-b8b9-110af8bf39a3'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:33.652455 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-b622c76b-fa0a-4233-b8b9-110af8bf39a3 admin admin] The token cache is being invalidate because project b232b16345bf47719cc9c5376cf065df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81446) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 16:33:33.652745 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-b622c76b-fa0a-4233-b8b9-110af8bf39a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:33.653395 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-b622c76b-fa0a-4233-b8b9-110af8bf39a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:33.654908 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1186/2348] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 16:33:33 2022] DELETE /identity/v3/projects/b232b16345bf47719cc9c5376cf065df => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:33:33.658983 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc808458-aad6-473f-8701-ea8d275b2c0f service neutron] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:33.669042 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc808458-aad6-473f-8701-ea8d275b2c0f service neutron] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:33.735436 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5fde4a-dca4-4299-a804-f65b83def026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:33.736064 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5fde4a-dca4-4299-a804-f65b83def026 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:33.736590 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5fde4a-dca4-4299-a804-f65b83def026 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:33.736863 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5fde4a-dca4-4299-a804-f65b83def026 admin admin] PATH_INFO: `/v3/users/547a2fe7df454510bb2648868f2fab7b` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:33.738017 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5fde4a-dca4-4299-a804-f65b83def026 admin admin] RBAC: Authorizing `identity:delete_user(user_id=547a2fe7df454510bb2648868f2fab7b)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:33.740657 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5fde4a-dca4-4299-a804-f65b83def026 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:33.761240 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:33:33.817520 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-cb5fde4a-dca4-4299-a804-f65b83def026 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '547a2fe7df454510bb2648868f2fab7b'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:33.827156 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-cb5fde4a-dca4-4299-a804-f65b83def026 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '547a2fe7df454510bb2648868f2fab7b'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:33.827835 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-cb5fde4a-dca4-4299-a804-f65b83def026 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '547a2fe7df454510bb2648868f2fab7b'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:33.836569 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-cb5fde4a-dca4-4299-a804-f65b83def026 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '547a2fe7df454510bb2648868f2fab7b'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:33.852106 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-cb5fde4a-dca4-4299-a804-f65b83def026 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '547a2fe7df454510bb2648868f2fab7b'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:33.858727 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1163/2349] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 16:33:33 2022] DELETE /identity/v3/users/547a2fe7df454510bb2648868f2fab7b => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:33:34.326783 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b622c76b-fa0a-4233-b8b9-110af8bf39a3 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:34.328279 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-b622c76b-fa0a-4233-b8b9-110af8bf39a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:34.344054 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b622c76b-fa0a-4233-b8b9-110af8bf39a3 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:34.422115 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e4cf49-b43c-404e-bc44-12f94407688b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:34.422804 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e4cf49-b43c-404e-bc44-12f94407688b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:34.423081 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e4cf49-b43c-404e-bc44-12f94407688b admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:34.423355 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e4cf49-b43c-404e-bc44-12f94407688b admin admin] PATH_INFO: `/v3/projects/8c0cbda9d2f04e4fb9e443833942f300` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:34.424477 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e4cf49-b43c-404e-bc44-12f94407688b admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c0cbda9d2f04e4fb9e443833942f300)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:34.426568 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e4cf49-b43c-404e-bc44-12f94407688b admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:34.480487 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-20e4cf49-b43c-404e-bc44-12f94407688b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c0cbda9d2f04e4fb9e443833942f300', 'request_id': 'req-20e4cf49-b43c-404e-bc44-12f94407688b'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:34.487257 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-20e4cf49-b43c-404e-bc44-12f94407688b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c0cbda9d2f04e4fb9e443833942f300', 'request_id': 'req-20e4cf49-b43c-404e-bc44-12f94407688b'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:34.495204 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-20e4cf49-b43c-404e-bc44-12f94407688b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c0cbda9d2f04e4fb9e443833942f300', 'request_id': 'req-20e4cf49-b43c-404e-bc44-12f94407688b'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:34.512984 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-20e4cf49-b43c-404e-bc44-12f94407688b admin admin] The token cache is being invalidate because project 8c0cbda9d2f04e4fb9e443833942f300 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81446) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 16:33:34.513413 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-20e4cf49-b43c-404e-bc44-12f94407688b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:34.514230 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-20e4cf49-b43c-404e-bc44-12f94407688b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:34.520263 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1187/2350] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 16:33:34 2022] DELETE /identity/v3/projects/8c0cbda9d2f04e4fb9e443833942f300 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:33:34.521281 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5fde4a-dca4-4299-a804-f65b83def026 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:34.523248 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-cb5fde4a-dca4-4299-a804-f65b83def026 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:34.546448 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5fde4a-dca4-4299-a804-f65b83def026 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:34.622918 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c82b64a-198f-4067-9df2-c7db36431480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:34.623557 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c82b64a-198f-4067-9df2-c7db36431480 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:34.623839 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c82b64a-198f-4067-9df2-c7db36431480 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:34.624111 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c82b64a-198f-4067-9df2-c7db36431480 admin admin] PATH_INFO: `/v3/users/1ab903ff578e43688bf7b9a40ae36250` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:34.625293 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c82b64a-198f-4067-9df2-c7db36431480 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ab903ff578e43688bf7b9a40ae36250)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:34.627496 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c82b64a-198f-4067-9df2-c7db36431480 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:34.684294 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-9c82b64a-198f-4067-9df2-c7db36431480 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ab903ff578e43688bf7b9a40ae36250'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:34.695405 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-9c82b64a-198f-4067-9df2-c7db36431480 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ab903ff578e43688bf7b9a40ae36250'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:34.696179 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-9c82b64a-198f-4067-9df2-c7db36431480 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ab903ff578e43688bf7b9a40ae36250'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:34.705118 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-9c82b64a-198f-4067-9df2-c7db36431480 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ab903ff578e43688bf7b9a40ae36250'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:34.718194 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-9c82b64a-198f-4067-9df2-c7db36431480 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ab903ff578e43688bf7b9a40ae36250'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:34.727214 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1164/2351] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 16:33:34 2022] DELETE /identity/v3/users/1ab903ff578e43688bf7b9a40ae36250 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 16:33:35.405662 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e4cf49-b43c-404e-bc44-12f94407688b admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:35.407405 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-20e4cf49-b43c-404e-bc44-12f94407688b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:35.430440 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e4cf49-b43c-404e-bc44-12f94407688b admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:35.534213 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:33:35.546198 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd63f36-b2ec-438a-a30b-4532766db5a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:35.547140 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd63f36-b2ec-438a-a30b-4532766db5a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:35.547489 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd63f36-b2ec-438a-a30b-4532766db5a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:35.547827 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd63f36-b2ec-438a-a30b-4532766db5a4 admin admin] PATH_INFO: `/v3/projects/74bca398bb7c452997d19d69200387d3` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:35.549195 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd63f36-b2ec-438a-a30b-4532766db5a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=74bca398bb7c452997d19d69200387d3)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:35.551560 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd63f36-b2ec-438a-a30b-4532766db5a4 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:35.610249 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-7dd63f36-b2ec-438a-a30b-4532766db5a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74bca398bb7c452997d19d69200387d3', 'request_id': 'req-7dd63f36-b2ec-438a-a30b-4532766db5a4'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:35.616830 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-7dd63f36-b2ec-438a-a30b-4532766db5a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74bca398bb7c452997d19d69200387d3', 'request_id': 'req-7dd63f36-b2ec-438a-a30b-4532766db5a4'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:35.624823 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-7dd63f36-b2ec-438a-a30b-4532766db5a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74bca398bb7c452997d19d69200387d3', 'request_id': 'req-7dd63f36-b2ec-438a-a30b-4532766db5a4'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:35.637598 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-7dd63f36-b2ec-438a-a30b-4532766db5a4 admin admin] The token cache is being invalidate because project 74bca398bb7c452997d19d69200387d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81446) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 16:33:35.638289 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-7dd63f36-b2ec-438a-a30b-4532766db5a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:35.638979 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-7dd63f36-b2ec-438a-a30b-4532766db5a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:35.640485 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1188/2352] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 16:33:35 2022] DELETE /identity/v3/projects/74bca398bb7c452997d19d69200387d3 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:33:35.645539 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35bccfe-439c-43a6-ab69-b86bcbc519bb None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:35.650830 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35bccfe-439c-43a6-ab69-b86bcbc519bb None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:35.651334 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35bccfe-439c-43a6-ab69-b86bcbc519bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:35.672803 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-a35bccfe-439c-43a6-ab69-b86bcbc519bb None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:33:35.674367 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-a35bccfe-439c-43a6-ab69-b86bcbc519bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:35.681173 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:33:35.744331 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1165/2353] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:33:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:33:35.813428 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebe9929-07f8-4ba5-a44a-392509cceea4 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:35.813704 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebe9929-07f8-4ba5-a44a-392509cceea4 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:35.813972 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebe9929-07f8-4ba5-a44a-392509cceea4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:35.836609 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-aebe9929-07f8-4ba5-a44a-392509cceea4 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:33:35.838067 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-aebe9929-07f8-4ba5-a44a-392509cceea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:35.862403 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1189/2354] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:33:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:33:35.865573 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35bccfe-439c-43a6-ab69-b86bcbc519bb None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:35.875869 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35bccfe-439c-43a6-ab69-b86bcbc519bb None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:35.880777 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40f01e8-ff0d-4b73-8d11-980cebb80107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:35.881386 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40f01e8-ff0d-4b73-8d11-980cebb80107 admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:35.881659 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40f01e8-ff0d-4b73-8d11-980cebb80107 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:35.881925 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40f01e8-ff0d-4b73-8d11-980cebb80107 admin admin] PATH_INFO: `/v3/domains` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:35.882592 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40f01e8-ff0d-4b73-8d11-980cebb80107 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:33:35.882881 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40f01e8-ff0d-4b73-8d11-980cebb80107 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:35.884772 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40f01e8-ff0d-4b73-8d11-980cebb80107 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:35.902341 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1166/2355] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Sep 9 16:33:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:33:35.903909 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebe9929-07f8-4ba5-a44a-392509cceea4 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:35.913471 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebe9929-07f8-4ba5-a44a-392509cceea4 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:35.918760 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6901260-2e5c-470a-a62f-101b0554fc95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:35.919363 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6901260-2e5c-470a-a62f-101b0554fc95 admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:35.919636 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6901260-2e5c-470a-a62f-101b0554fc95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:35.919900 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6901260-2e5c-470a-a62f-101b0554fc95 admin admin] PATH_INFO: `/v3/projects` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:35.920533 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6901260-2e5c-470a-a62f-101b0554fc95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:35.922498 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6901260-2e5c-470a-a62f-101b0554fc95 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:35.960768 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1190/2356] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 16:33:35 2022] POST /identity/v3/projects => generated 373 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 16:33:35.964878 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40f01e8-ff0d-4b73-8d11-980cebb80107 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:35.974982 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40f01e8-ff0d-4b73-8d11-980cebb80107 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:36.034402 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e6d230-59e4-4ceb-af59-878a387154e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:36.035005 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e6d230-59e4-4ceb-af59-878a387154e8 admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:36.035284 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e6d230-59e4-4ceb-af59-878a387154e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:36.035559 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e6d230-59e4-4ceb-af59-878a387154e8 admin admin] PATH_INFO: `/v3/users` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:36.036182 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e6d230-59e4-4ceb-af59-878a387154e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:36.038079 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e6d230-59e4-4ceb-af59-878a387154e8 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:36.067341 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1167/2357] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 16:33:35 2022] POST /identity/v3/users => generated 287 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 16:33:36.071661 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6901260-2e5c-470a-a62f-101b0554fc95 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:36.088197 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6901260-2e5c-470a-a62f-101b0554fc95 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:36.095173 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24564f9e-c511-482b-978b-5ff2d4589da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:36.096348 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24564f9e-c511-482b-978b-5ff2d4589da4 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:36.096732 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24564f9e-c511-482b-978b-5ff2d4589da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:36.097112 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24564f9e-c511-482b-978b-5ff2d4589da4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:36.098134 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24564f9e-c511-482b-978b-5ff2d4589da4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:36.099816 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24564f9e-c511-482b-978b-5ff2d4589da4 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:36.112706 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1191/2358] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:33:36 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:33:36.116904 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e6d230-59e4-4ceb-af59-878a387154e8 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:36.127895 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e6d230-59e4-4ceb-af59-878a387154e8 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:36.141503 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6147c23-2650-4089-800c-805bb961300a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:36.142162 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6147c23-2650-4089-800c-805bb961300a admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:36.142562 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6147c23-2650-4089-800c-805bb961300a admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:36.142833 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6147c23-2650-4089-800c-805bb961300a admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:36.143632 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6147c23-2650-4089-800c-805bb961300a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:36.145257 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6147c23-2650-4089-800c-805bb961300a admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:36.156622 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1168/2359] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:33:36 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:33:36.160787 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24564f9e-c511-482b-978b-5ff2d4589da4 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:36.173452 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24564f9e-c511-482b-978b-5ff2d4589da4 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:36.178195 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8f3076-b864-4d30-b923-c10da43efb9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:36.178881 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8f3076-b864-4d30-b923-c10da43efb9e admin admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:36.179162 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8f3076-b864-4d30-b923-c10da43efb9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:36.179471 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8f3076-b864-4d30-b923-c10da43efb9e admin admin] PATH_INFO: `/v3/projects/6b42b5fa0eab4f9f9e8a485d07f06c12/users/fa068d40100441e78f79499d51e6f471/roles/b38e84bf077846ee802e6bb1bad83522` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:36.196118 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8f3076-b864-4d30-b923-c10da43efb9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b42b5fa0eab4f9f9e8a485d07f06c12, user_id=fa068d40100441e78f79499d51e6f471, role_id=b38e84bf077846ee802e6bb1bad83522)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:36.198824 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8f3076-b864-4d30-b923-c10da43efb9e admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:36.215662 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1192/2360] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 16:33:36 2022] PUT /identity/v3/projects/6b42b5fa0eab4f9f9e8a485d07f06c12/users/fa068d40100441e78f79499d51e6f471/roles/b38e84bf077846ee802e6bb1bad83522 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:33:36.226347 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b544ea79-5386-4a8d-88a9-e021496ae4bb None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:36.226695 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b544ea79-5386-4a8d-88a9-e021496ae4bb None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:36.226976 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b544ea79-5386-4a8d-88a9-e021496ae4bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:36.274730 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-b544ea79-5386-4a8d-88a9-e021496ae4bb None None] MFA Rules not processed for user `fa068d40100441e78f79499d51e6f471`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:33:36.283164 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-b544ea79-5386-4a8d-88a9-e021496ae4bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:36.352795 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1169/2361] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:33:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 16:33:36.364598 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8f3076-b864-4d30-b923-c10da43efb9e admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:36.366216 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-7e8f3076-b864-4d30-b923-c10da43efb9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:36.424424 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8f3076-b864-4d30-b923-c10da43efb9e admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:36.428109 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b6b401-8c50-487e-be02-82d95f421989 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8078e791ba68460f8b3aeafb4b79b73a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:36.428703 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b6b401-8c50-487e-be02-82d95f421989 service cinder] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:36.428978 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b6b401-8c50-487e-be02-82d95f421989 service cinder] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:36.429247 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b6b401-8c50-487e-be02-82d95f421989 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:36.438047 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b6b401-8c50-487e-be02-82d95f421989 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:36.440022 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b6b401-8c50-487e-be02-82d95f421989 service cinder] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:36.448887 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1193/2362] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:33:36 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:33:37.156522 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b544ea79-5386-4a8d-88a9-e021496ae4bb None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:37.159394 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-b544ea79-5386-4a8d-88a9-e021496ae4bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:37.172659 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:33:37.252029 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b544ea79-5386-4a8d-88a9-e021496ae4bb None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:37.256833 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459ba39c-03a1-4b88-9e86-3322ecc51b39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:37.257498 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459ba39c-03a1-4b88-9e86-3322ecc51b39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:37.257773 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459ba39c-03a1-4b88-9e86-3322ecc51b39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:37.258223 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459ba39c-03a1-4b88-9e86-3322ecc51b39 admin admin] PATH_INFO: `/v3/users/9d0156aa9d32415bae874d164a19fa17` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:37.259782 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459ba39c-03a1-4b88-9e86-3322ecc51b39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d0156aa9d32415bae874d164a19fa17)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:37.262010 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459ba39c-03a1-4b88-9e86-3322ecc51b39 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:37.335147 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-459ba39c-03a1-4b88-9e86-3322ecc51b39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d0156aa9d32415bae874d164a19fa17'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:37.343404 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-459ba39c-03a1-4b88-9e86-3322ecc51b39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d0156aa9d32415bae874d164a19fa17'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:37.344107 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-459ba39c-03a1-4b88-9e86-3322ecc51b39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d0156aa9d32415bae874d164a19fa17'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:37.353488 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-459ba39c-03a1-4b88-9e86-3322ecc51b39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d0156aa9d32415bae874d164a19fa17'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:37.377052 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-459ba39c-03a1-4b88-9e86-3322ecc51b39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d0156aa9d32415bae874d164a19fa17'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:37.384427 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1170/2363] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 16:33:37 2022] DELETE /identity/v3/users/9d0156aa9d32415bae874d164a19fa17 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:33:37.388663 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161e3618-f2ed-4024-9138-91ca9fe26b05 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:37.389108 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161e3618-f2ed-4024-9138-91ca9fe26b05 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:37.389388 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161e3618-f2ed-4024-9138-91ca9fe26b05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:37.415561 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-161e3618-f2ed-4024-9138-91ca9fe26b05 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:33:37.417983 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-161e3618-f2ed-4024-9138-91ca9fe26b05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:37.443769 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:33:37.513123 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1194/2364] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:33:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 16:33:37.523236 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459ba39c-03a1-4b88-9e86-3322ecc51b39 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:37.524694 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-459ba39c-03a1-4b88-9e86-3322ecc51b39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:37.592091 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459ba39c-03a1-4b88-9e86-3322ecc51b39 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:37.595915 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccdb305-fd5e-4e13-a1dc-cecc16578b9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f44bfdd5214e8d84a2c0a5b1fd9b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:37.596538 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccdb305-fd5e-4e13-a1dc-cecc16578b9a service neutron] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:37.596813 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccdb305-fd5e-4e13-a1dc-cecc16578b9a service neutron] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:37.597083 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccdb305-fd5e-4e13-a1dc-cecc16578b9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:37.607596 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccdb305-fd5e-4e13-a1dc-cecc16578b9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:37.609093 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccdb305-fd5e-4e13-a1dc-cecc16578b9a service neutron] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:37.619696 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1171/2365] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:33:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:33:37.831735 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ba135b-5643-4e25-ba89-a2bc30e5ec20 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:37.832128 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ba135b-5643-4e25-ba89-a2bc30e5ec20 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:37.832491 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ba135b-5643-4e25-ba89-a2bc30e5ec20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:37.852489 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-54ba135b-5643-4e25-ba89-a2bc30e5ec20 None None] MFA Rules not processed for user `fa068d40100441e78f79499d51e6f471`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:33:37.853693 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-54ba135b-5643-4e25-ba89-a2bc30e5ec20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:37.908829 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1195/2366] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:33:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:33:38.071019 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccdb305-fd5e-4e13-a1dc-cecc16578b9a service neutron] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:38.072469 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-dccdb305-fd5e-4e13-a1dc-cecc16578b9a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:38.086809 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccdb305-fd5e-4e13-a1dc-cecc16578b9a service neutron] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:38.092986 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64092e70-286e-42ca-a961-0aec4e8ea255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:38.094348 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64092e70-286e-42ca-a961-0aec4e8ea255 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:38.094348 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64092e70-286e-42ca-a961-0aec4e8ea255 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:38.094855 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64092e70-286e-42ca-a961-0aec4e8ea255 admin admin] PATH_INFO: `/v3/projects/e397055ce2394560a53bb5a77dc24c48` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:38.096170 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64092e70-286e-42ca-a961-0aec4e8ea255 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e397055ce2394560a53bb5a77dc24c48)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:38.098385 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64092e70-286e-42ca-a961-0aec4e8ea255 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:38.130193 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:33:38.163560 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-64092e70-286e-42ca-a961-0aec4e8ea255 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e397055ce2394560a53bb5a77dc24c48', 'request_id': 'req-64092e70-286e-42ca-a961-0aec4e8ea255'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:38.172041 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-64092e70-286e-42ca-a961-0aec4e8ea255 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e397055ce2394560a53bb5a77dc24c48', 'request_id': 'req-64092e70-286e-42ca-a961-0aec4e8ea255'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:38.181336 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-64092e70-286e-42ca-a961-0aec4e8ea255 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e397055ce2394560a53bb5a77dc24c48', 'request_id': 'req-64092e70-286e-42ca-a961-0aec4e8ea255'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:38.213377 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-64092e70-286e-42ca-a961-0aec4e8ea255 admin admin] The token cache is being invalidate because project e397055ce2394560a53bb5a77dc24c48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81445) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 16:33:38.214002 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-64092e70-286e-42ca-a961-0aec4e8ea255 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:38.214892 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-64092e70-286e-42ca-a961-0aec4e8ea255 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:38.221457 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1172/2367] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 16:33:38 2022] DELETE /identity/v3/projects/e397055ce2394560a53bb5a77dc24c48 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:33:38.224049 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef3cbac-5bdd-4069-adf5-75e8fdf2dfc2 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:38.224818 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef3cbac-5bdd-4069-adf5-75e8fdf2dfc2 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:38.225354 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef3cbac-5bdd-4069-adf5-75e8fdf2dfc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:38.255874 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-aef3cbac-5bdd-4069-adf5-75e8fdf2dfc2 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:33:38.257155 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-aef3cbac-5bdd-4069-adf5-75e8fdf2dfc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:38.334173 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1196/2368] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:33:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:33:38.335238 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2b5dc5-06e8-4126-b648-47186fdf094d None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:38.335533 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2b5dc5-06e8-4126-b648-47186fdf094d None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:38.335809 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2b5dc5-06e8-4126-b648-47186fdf094d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:38.356700 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-af2b5dc5-06e8-4126-b648-47186fdf094d None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:33:38.358641 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-af2b5dc5-06e8-4126-b648-47186fdf094d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:38.368218 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1173/2369] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:33:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 16:33:38.373129 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef3cbac-5bdd-4069-adf5-75e8fdf2dfc2 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:38.384195 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef3cbac-5bdd-4069-adf5-75e8fdf2dfc2 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:38.401592 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dc9877-f185-4fee-a80e-3940c784c93c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:38.403522 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dc9877-f185-4fee-a80e-3940c784c93c admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:38.403871 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dc9877-f185-4fee-a80e-3940c784c93c admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:38.405149 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dc9877-f185-4fee-a80e-3940c784c93c admin admin] PATH_INFO: `/v3/domains` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:38.405149 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dc9877-f185-4fee-a80e-3940c784c93c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:33:38.405363 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dc9877-f185-4fee-a80e-3940c784c93c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:38.407995 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dc9877-f185-4fee-a80e-3940c784c93c admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:38.423600 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1197/2370] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Sep 9 16:33:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:33:38.427580 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2b5dc5-06e8-4126-b648-47186fdf094d None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:38.446736 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2b5dc5-06e8-4126-b648-47186fdf094d None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:38.446736 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4bbc7d-5e46-4e4f-b28a-edc28971c9bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:38.446736 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4bbc7d-5e46-4e4f-b28a-edc28971c9bf admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:38.446736 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4bbc7d-5e46-4e4f-b28a-edc28971c9bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:38.447168 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4bbc7d-5e46-4e4f-b28a-edc28971c9bf admin admin] PATH_INFO: `/v3/projects` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:38.447168 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4bbc7d-5e46-4e4f-b28a-edc28971c9bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:38.447168 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4bbc7d-5e46-4e4f-b28a-edc28971c9bf admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:38.475761 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1174/2371] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 16:33:38 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:33:38.480160 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dc9877-f185-4fee-a80e-3940c784c93c admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:38.491741 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dc9877-f185-4fee-a80e-3940c784c93c admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:38.555855 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:33:38.568503 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89d734f-4651-412d-a0dc-17502de8bb7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:38.569137 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89d734f-4651-412d-a0dc-17502de8bb7a admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:38.569403 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89d734f-4651-412d-a0dc-17502de8bb7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:38.569671 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89d734f-4651-412d-a0dc-17502de8bb7a admin admin] PATH_INFO: `/v3/users` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:38.570317 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89d734f-4651-412d-a0dc-17502de8bb7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:38.572639 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89d734f-4651-412d-a0dc-17502de8bb7a admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:38.598610 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1198/2372] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 16:33:38 2022] POST /identity/v3/users => generated 293 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:33:38.602698 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4bbc7d-5e46-4e4f-b28a-edc28971c9bf admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:38.613227 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4bbc7d-5e46-4e4f-b28a-edc28971c9bf admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:38.618894 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202a1d32-8494-4bdd-a914-61654c8d3d4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:38.619506 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202a1d32-8494-4bdd-a914-61654c8d3d4f admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:38.619785 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202a1d32-8494-4bdd-a914-61654c8d3d4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:38.620110 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202a1d32-8494-4bdd-a914-61654c8d3d4f admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:38.620754 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202a1d32-8494-4bdd-a914-61654c8d3d4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:38.622642 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202a1d32-8494-4bdd-a914-61654c8d3d4f admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:38.645408 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1175/2373] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:33:38 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:33:38.649598 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89d734f-4651-412d-a0dc-17502de8bb7a admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:38.662101 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89d734f-4651-412d-a0dc-17502de8bb7a admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:38.667567 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbc882c-168c-437c-bfa4-5a6018a2e9ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:38.668275 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbc882c-168c-437c-bfa4-5a6018a2e9ba admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:38.668508 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbc882c-168c-437c-bfa4-5a6018a2e9ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:38.668787 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbc882c-168c-437c-bfa4-5a6018a2e9ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:38.669452 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbc882c-168c-437c-bfa4-5a6018a2e9ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:38.671059 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbc882c-168c-437c-bfa4-5a6018a2e9ba admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:38.689267 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1199/2374] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:33:38 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 16:33:38.693968 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202a1d32-8494-4bdd-a914-61654c8d3d4f admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:38.705376 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202a1d32-8494-4bdd-a914-61654c8d3d4f admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:38.710294 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b73e219-e2ed-4bb6-b5e5-8cf45795f499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:38.710964 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b73e219-e2ed-4bb6-b5e5-8cf45795f499 admin admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:38.711241 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b73e219-e2ed-4bb6-b5e5-8cf45795f499 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:38.711507 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b73e219-e2ed-4bb6-b5e5-8cf45795f499 admin admin] PATH_INFO: `/v3/projects/2ea4f7629d844ae2916622bf56bda1a6/users/86e21d94c615492fb68249591445e448/roles/b38e84bf077846ee802e6bb1bad83522` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:38.728538 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b73e219-e2ed-4bb6-b5e5-8cf45795f499 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ea4f7629d844ae2916622bf56bda1a6, user_id=86e21d94c615492fb68249591445e448, role_id=b38e84bf077846ee802e6bb1bad83522)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:38.731233 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b73e219-e2ed-4bb6-b5e5-8cf45795f499 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:38.752458 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1176/2375] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 16:33:38 2022] PUT /identity/v3/projects/2ea4f7629d844ae2916622bf56bda1a6/users/86e21d94c615492fb68249591445e448/roles/b38e84bf077846ee802e6bb1bad83522 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:33:38.757742 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe2bd95-7821-4e26-abc0-4370dcc3cc65 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:38.758192 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe2bd95-7821-4e26-abc0-4370dcc3cc65 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:38.758589 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe2bd95-7821-4e26-abc0-4370dcc3cc65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:38.780410 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-5fe2bd95-7821-4e26-abc0-4370dcc3cc65 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:33:38.781622 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-5fe2bd95-7821-4e26-abc0-4370dcc3cc65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:38.848496 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1200/2376] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:33:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:33:38.859307 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b73e219-e2ed-4bb6-b5e5-8cf45795f499 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:38.861334 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-7b73e219-e2ed-4bb6-b5e5-8cf45795f499 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:38.920449 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b73e219-e2ed-4bb6-b5e5-8cf45795f499 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:38.924858 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0409383-03e8-4eae-8a3e-e68f9eff1af1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f44bfdd5214e8d84a2c0a5b1fd9b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:38.925466 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0409383-03e8-4eae-8a3e-e68f9eff1af1 service neutron] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:38.925730 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0409383-03e8-4eae-8a3e-e68f9eff1af1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:38.926002 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0409383-03e8-4eae-8a3e-e68f9eff1af1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:38.935430 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0409383-03e8-4eae-8a3e-e68f9eff1af1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:38.936870 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0409383-03e8-4eae-8a3e-e68f9eff1af1 service neutron] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:38.948636 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1177/2377] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:33:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:33:42.840300 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe2bd95-7821-4e26-abc0-4370dcc3cc65 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:42.847883 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-5fe2bd95-7821-4e26-abc0-4370dcc3cc65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:42.880748 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe2bd95-7821-4e26-abc0-4370dcc3cc65 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:42.895012 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813263f3-f4f5-45bb-813f-3e7c1a093465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:42.895665 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813263f3-f4f5-45bb-813f-3e7c1a093465 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:42.896000 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813263f3-f4f5-45bb-813f-3e7c1a093465 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:42.896257 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813263f3-f4f5-45bb-813f-3e7c1a093465 admin admin] PATH_INFO: `/v3/users/256c3030c923440784ab9b36ae67a3ad` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:42.900773 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813263f3-f4f5-45bb-813f-3e7c1a093465 admin admin] RBAC: Authorizing `identity:delete_user(user_id=256c3030c923440784ab9b36ae67a3ad)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:42.902806 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813263f3-f4f5-45bb-813f-3e7c1a093465 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:43.001333 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-813263f3-f4f5-45bb-813f-3e7c1a093465 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '256c3030c923440784ab9b36ae67a3ad'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:43.032810 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-813263f3-f4f5-45bb-813f-3e7c1a093465 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '256c3030c923440784ab9b36ae67a3ad'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:43.051613 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-813263f3-f4f5-45bb-813f-3e7c1a093465 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '256c3030c923440784ab9b36ae67a3ad'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:43.061177 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-813263f3-f4f5-45bb-813f-3e7c1a093465 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '256c3030c923440784ab9b36ae67a3ad'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:43.061812 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-813263f3-f4f5-45bb-813f-3e7c1a093465 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '256c3030c923440784ab9b36ae67a3ad'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:43.069686 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1201/2378] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 16:33:42 2022] DELETE /identity/v3/users/256c3030c923440784ab9b36ae67a3ad => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:33:43.075510 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a8dca2-2219-4409-a6d5-872ea027dc25 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:43.076016 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a8dca2-2219-4409-a6d5-872ea027dc25 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:43.076162 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a8dca2-2219-4409-a6d5-872ea027dc25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:43.109755 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-d2a8dca2-2219-4409-a6d5-872ea027dc25 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:33:43.110091 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-d2a8dca2-2219-4409-a6d5-872ea027dc25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:43.217828 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=91,keystone:DELETE=6,keystone:INSERT=3 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:33:43.248154 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1178/2379] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:33:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:33:43.308759 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813263f3-f4f5-45bb-813f-3e7c1a093465 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:43.314845 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-813263f3-f4f5-45bb-813f-3e7c1a093465 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:43.439718 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:33:43.439718 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813263f3-f4f5-45bb-813f-3e7c1a093465 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:43.451038 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c5d251-a8bb-4d94-8d06-e660d6736a95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f44bfdd5214e8d84a2c0a5b1fd9b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:43.451038 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c5d251-a8bb-4d94-8d06-e660d6736a95 service neutron] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:43.451038 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c5d251-a8bb-4d94-8d06-e660d6736a95 service neutron] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:43.451038 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c5d251-a8bb-4d94-8d06-e660d6736a95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:43.478051 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c5d251-a8bb-4d94-8d06-e660d6736a95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:43.481399 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c5d251-a8bb-4d94-8d06-e660d6736a95 service neutron] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:43.508241 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1202/2380] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:33:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:33:44.659781 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a8dca2-2219-4409-a6d5-872ea027dc25 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:44.662017 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-d2a8dca2-2219-4409-a6d5-872ea027dc25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:44.695756 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a8dca2-2219-4409-a6d5-872ea027dc25 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:44.751299 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0003d7-ad1e-4ccc-a36a-f9923a876826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:44.754329 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0003d7-ad1e-4ccc-a36a-f9923a876826 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:44.759127 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0003d7-ad1e-4ccc-a36a-f9923a876826 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:44.759481 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0003d7-ad1e-4ccc-a36a-f9923a876826 admin admin] PATH_INFO: `/v3/projects/0d291eb8df024a76a4052c56e76f5443` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:44.770379 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0003d7-ad1e-4ccc-a36a-f9923a876826 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d291eb8df024a76a4052c56e76f5443)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:44.776789 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0003d7-ad1e-4ccc-a36a-f9923a876826 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:44.920537 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-0f0003d7-ad1e-4ccc-a36a-f9923a876826 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d291eb8df024a76a4052c56e76f5443', 'request_id': 'req-0f0003d7-ad1e-4ccc-a36a-f9923a876826'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:44.931067 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-0f0003d7-ad1e-4ccc-a36a-f9923a876826 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d291eb8df024a76a4052c56e76f5443', 'request_id': 'req-0f0003d7-ad1e-4ccc-a36a-f9923a876826'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:44.942004 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-0f0003d7-ad1e-4ccc-a36a-f9923a876826 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d291eb8df024a76a4052c56e76f5443', 'request_id': 'req-0f0003d7-ad1e-4ccc-a36a-f9923a876826'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:44.960795 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-0f0003d7-ad1e-4ccc-a36a-f9923a876826 admin admin] The token cache is being invalidate because project 0d291eb8df024a76a4052c56e76f5443 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81445) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 16:33:44.961598 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-0f0003d7-ad1e-4ccc-a36a-f9923a876826 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:44.963065 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-0f0003d7-ad1e-4ccc-a36a-f9923a876826 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:33:44.966432 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1179/2381] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 16:33:44 2022] DELETE /identity/v3/projects/0d291eb8df024a76a4052c56e76f5443 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:33:46.180126 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005b1ff4-3947-4d0a-8f06-37e159b66483 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:46.180635 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005b1ff4-3947-4d0a-8f06-37e159b66483 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:46.180746 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005b1ff4-3947-4d0a-8f06-37e159b66483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:46.223083 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-005b1ff4-3947-4d0a-8f06-37e159b66483 None None] MFA Rules not processed for user `86e21d94c615492fb68249591445e448`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:33:46.224542 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-005b1ff4-3947-4d0a-8f06-37e159b66483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:46.299435 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1203/2382] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:33:46 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:33:46.304031 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0003d7-ad1e-4ccc-a36a-f9923a876826 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:46.305451 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-0f0003d7-ad1e-4ccc-a36a-f9923a876826 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:46.394732 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0003d7-ad1e-4ccc-a36a-f9923a876826 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:46.399721 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bda29f-65bd-42ec-89ee-4aea49a17ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:46.400337 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bda29f-65bd-42ec-89ee-4aea49a17ae6 admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:46.400616 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bda29f-65bd-42ec-89ee-4aea49a17ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:46.400888 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bda29f-65bd-42ec-89ee-4aea49a17ae6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:46.401533 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bda29f-65bd-42ec-89ee-4aea49a17ae6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:46.404591 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bda29f-65bd-42ec-89ee-4aea49a17ae6 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:46.442523 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1180/2383] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 16:33:46 2022] POST /identity/v3/projects => generated 383 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:33:46.446186 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005b1ff4-3947-4d0a-8f06-37e159b66483 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:46.463093 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005b1ff4-3947-4d0a-8f06-37e159b66483 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:46.619530 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5149d5b6-ab98-46b9-a144-7164e4bb74af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:46.620338 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5149d5b6-ab98-46b9-a144-7164e4bb74af admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:46.620619 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5149d5b6-ab98-46b9-a144-7164e4bb74af admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:46.620891 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5149d5b6-ab98-46b9-a144-7164e4bb74af admin admin] PATH_INFO: `/v3/users` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:46.622067 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5149d5b6-ab98-46b9-a144-7164e4bb74af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:46.624077 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5149d5b6-ab98-46b9-a144-7164e4bb74af admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:46.662421 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1204/2384] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 16:33:46 2022] POST /identity/v3/users => generated 298 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:33:46.670452 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bda29f-65bd-42ec-89ee-4aea49a17ae6 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:46.681605 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bda29f-65bd-42ec-89ee-4aea49a17ae6 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:46.687726 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce71de84-93e9-4c31-8f3e-5aa4b647d71a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:46.688451 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce71de84-93e9-4c31-8f3e-5aa4b647d71a admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:46.688836 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce71de84-93e9-4c31-8f3e-5aa4b647d71a admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:46.689281 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce71de84-93e9-4c31-8f3e-5aa4b647d71a admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:46.690208 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce71de84-93e9-4c31-8f3e-5aa4b647d71a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:46.692694 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce71de84-93e9-4c31-8f3e-5aa4b647d71a admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:46.705770 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1181/2385] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:33:46 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:33:46.709806 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5149d5b6-ab98-46b9-a144-7164e4bb74af admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:46.721343 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5149d5b6-ab98-46b9-a144-7164e4bb74af admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:46.726470 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98afdb3-79e8-4c39-94c9-66cedc216395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:46.727377 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98afdb3-79e8-4c39-94c9-66cedc216395 admin admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:46.727858 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98afdb3-79e8-4c39-94c9-66cedc216395 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:46.728238 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98afdb3-79e8-4c39-94c9-66cedc216395 admin admin] PATH_INFO: `/v3/projects/b099351fdeef4ab4b21b82c9802d06ce/users/d1c2d257c7074dd792956162c4b95d01/roles/0a36d1be416f4089be19be979943b731` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:46.747037 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98afdb3-79e8-4c39-94c9-66cedc216395 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b099351fdeef4ab4b21b82c9802d06ce, user_id=d1c2d257c7074dd792956162c4b95d01, role_id=0a36d1be416f4089be19be979943b731)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:46.749995 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98afdb3-79e8-4c39-94c9-66cedc216395 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:46.773126 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1205/2386] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 16:33:46 2022] PUT /identity/v3/projects/b099351fdeef4ab4b21b82c9802d06ce/users/d1c2d257c7074dd792956162c4b95d01/roles/0a36d1be416f4089be19be979943b731 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:33:46.776946 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce71de84-93e9-4c31-8f3e-5aa4b647d71a admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:46.788976 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce71de84-93e9-4c31-8f3e-5aa4b647d71a admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:46.858170 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:33:46.875230 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a87ab56-dd70-4676-857d-e1b043088bde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:46.875950 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a87ab56-dd70-4676-857d-e1b043088bde admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:46.876299 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a87ab56-dd70-4676-857d-e1b043088bde admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:46.876672 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a87ab56-dd70-4676-857d-e1b043088bde admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:46.877652 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a87ab56-dd70-4676-857d-e1b043088bde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:46.879713 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a87ab56-dd70-4676-857d-e1b043088bde admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:46.896242 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1182/2387] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:33:46 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:33:46.900642 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98afdb3-79e8-4c39-94c9-66cedc216395 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:46.917886 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98afdb3-79e8-4c39-94c9-66cedc216395 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:46.923905 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87836fb1-adb1-4ce1-b037-2255a6c7772d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:46.924924 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87836fb1-adb1-4ce1-b037-2255a6c7772d admin admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:46.925286 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87836fb1-adb1-4ce1-b037-2255a6c7772d admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:46.925620 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87836fb1-adb1-4ce1-b037-2255a6c7772d admin admin] PATH_INFO: `/v3/projects/b099351fdeef4ab4b21b82c9802d06ce/users/d1c2d257c7074dd792956162c4b95d01/roles/0a36d1be416f4089be19be979943b731` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:46.931462 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87836fb1-adb1-4ce1-b037-2255a6c7772d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b099351fdeef4ab4b21b82c9802d06ce, user_id=d1c2d257c7074dd792956162c4b95d01, role_id=0a36d1be416f4089be19be979943b731)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:46.934330 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87836fb1-adb1-4ce1-b037-2255a6c7772d admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:46.946984 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1206/2388] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 16:33:46 2022] PUT /identity/v3/projects/b099351fdeef4ab4b21b82c9802d06ce/users/d1c2d257c7074dd792956162c4b95d01/roles/0a36d1be416f4089be19be979943b731 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 16:33:51.453443 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423ae85d-29fd-4598-b5fd-8075f1bc446c None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:51.453971 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423ae85d-29fd-4598-b5fd-8075f1bc446c None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:51.454152 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423ae85d-29fd-4598-b5fd-8075f1bc446c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:51.499233 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-423ae85d-29fd-4598-b5fd-8075f1bc446c None None] MFA Rules not processed for user `c85e41cec8cc45608a3f7415884e750c`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:33:51.500745 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-423ae85d-29fd-4598-b5fd-8075f1bc446c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:51.615296 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1183/2389] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:33:51 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:33:53.827579 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eabf97-a75a-4c25-b107-ac617a763800 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:53.828772 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eabf97-a75a-4c25-b107-ac617a763800 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:53.829265 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eabf97-a75a-4c25-b107-ac617a763800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:53.871700 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-38eabf97-a75a-4c25-b107-ac617a763800 None None] MFA Rules not processed for user `d1c2d257c7074dd792956162c4b95d01`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:33:53.873427 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-38eabf97-a75a-4c25-b107-ac617a763800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:53.908277 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:33:54.048185 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1207/2390] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:33:53 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:33:54.072527 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423ae85d-29fd-4598-b5fd-8075f1bc446c None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:54.075393 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-423ae85d-29fd-4598-b5fd-8075f1bc446c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:54.253080 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423ae85d-29fd-4598-b5fd-8075f1bc446c None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:54.259699 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3de461-b22a-4f76-b98d-8185620cc206 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ddd42508eee4412ae139cb8526090d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:54.260672 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3de461-b22a-4f76-b98d-8185620cc206 service glance] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:54.261178 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3de461-b22a-4f76-b98d-8185620cc206 service glance] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:54.261600 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3de461-b22a-4f76-b98d-8185620cc206 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:54.374994 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3de461-b22a-4f76-b98d-8185620cc206 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:54.377632 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3de461-b22a-4f76-b98d-8185620cc206 service glance] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:54.412222 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1184/2391] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:33:54 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:33:54.589432 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ab9a53-13e4-48a4-b9f4-04823c1b6ade None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:54.589718 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ab9a53-13e4-48a4-b9f4-04823c1b6ade None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:54.590196 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ab9a53-13e4-48a4-b9f4-04823c1b6ade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:54.620904 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-c0ab9a53-13e4-48a4-b9f4-04823c1b6ade None None] MFA Rules not processed for user `b9d05f3782d24127aa613c8d7ac8041b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:33:54.622769 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-c0ab9a53-13e4-48a4-b9f4-04823c1b6ade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:54.678431 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1208/2392] 10.222.0.27 () {58 vars in 1009 bytes} [Fri Sep 9 16:33:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:33:54.721069 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3de461-b22a-4f76-b98d-8185620cc206 service glance] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:33:54.722447 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-1f3de461-b22a-4f76-b98d-8185620cc206 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:33:54.772264 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:33:54.797288 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3de461-b22a-4f76-b98d-8185620cc206 service glance] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:33:54.803199 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f0b405-539b-4475-bfb9-253ac41c6ce2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2350bbc4a194c2dab2e3be830fd0eba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:33:54.803794 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f0b405-539b-4475-bfb9-253ac41c6ce2 service swift] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:33:54.804071 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f0b405-539b-4475-bfb9-253ac41c6ce2 service swift] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:33:54.804339 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f0b405-539b-4475-bfb9-253ac41c6ce2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:33:54.812379 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f0b405-539b-4475-bfb9-253ac41c6ce2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:33:54.813971 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f0b405-539b-4475-bfb9-253ac41c6ce2 service swift] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:33:54.822135 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1185/2393] 10.222.0.27 () {60 vars in 1384 bytes} [Fri Sep 9 16:33:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 09 16:34:01.160558 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2772b2-4a5e-4eb5-89c1-0b810ae6b7f1 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:34:01.161481 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2772b2-4a5e-4eb5-89c1-0b810ae6b7f1 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:34:01.161948 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2772b2-4a5e-4eb5-89c1-0b810ae6b7f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:34:01.200044 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-1b2772b2-4a5e-4eb5-89c1-0b810ae6b7f1 None None] MFA Rules not processed for user `b9d05f3782d24127aa613c8d7ac8041b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:34:01.201595 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-1b2772b2-4a5e-4eb5-89c1-0b810ae6b7f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:34:01.218834 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1209/2394] 10.222.0.27 () {58 vars in 1009 bytes} [Fri Sep 9 16:34:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:34:01.245530 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f0b405-539b-4475-bfb9-253ac41c6ce2 service swift] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:34:01.278343 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f0b405-539b-4475-bfb9-253ac41c6ce2 service swift] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:34:01.294163 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f2b0d8-f36d-48e3-a19a-ca0803e180d3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2350bbc4a194c2dab2e3be830fd0eba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:34:01.295438 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f2b0d8-f36d-48e3-a19a-ca0803e180d3 service swift] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:34:01.295438 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f2b0d8-f36d-48e3-a19a-ca0803e180d3 service swift] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:34:01.295438 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f2b0d8-f36d-48e3-a19a-ca0803e180d3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:34:01.314578 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f2b0d8-f36d-48e3-a19a-ca0803e180d3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:34:01.316793 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f2b0d8-f36d-48e3-a19a-ca0803e180d3 service swift] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:34:01.332905 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1186/2395] 10.222.0.27 () {60 vars in 1384 bytes} [Fri Sep 9 16:34:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 09 16:34:02.529970 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ebda1f-71c6-44f8-8a7f-03db3cdb6ca1 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:34:02.531308 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ebda1f-71c6-44f8-8a7f-03db3cdb6ca1 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:34:02.531755 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ebda1f-71c6-44f8-8a7f-03db3cdb6ca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:34:02.571634 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-d7ebda1f-71c6-44f8-8a7f-03db3cdb6ca1 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:34:02.573439 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-d7ebda1f-71c6-44f8-8a7f-03db3cdb6ca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:34:02.773959 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1210/2396] 10.222.0.20 () {58 vars in 1016 bytes} [Fri Sep 9 16:34:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:34:02.792492 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f2b0d8-f36d-48e3-a19a-ca0803e180d3 service swift] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:34:02.795352 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-41f2b0d8-f36d-48e3-a19a-ca0803e180d3 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:34:03.051973 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f2b0d8-f36d-48e3-a19a-ca0803e180d3 service swift] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:34:03.097773 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b7e248-114e-4e93-84b5-353db129fe0a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a332b9b4980646a3b14633293f77b505', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:34:03.099437 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b7e248-114e-4e93-84b5-353db129fe0a service nova] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:34:03.099437 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b7e248-114e-4e93-84b5-353db129fe0a service nova] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:34:03.099437 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b7e248-114e-4e93-84b5-353db129fe0a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:34:03.154648 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b7e248-114e-4e93-84b5-353db129fe0a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:34:03.156207 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b7e248-114e-4e93-84b5-353db129fe0a service nova] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:34:03.224378 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1187/2397] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:34:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:34:08.081393 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25fd57a-1443-4db3-bb48-367e69d63f03 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:34:08.082041 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25fd57a-1443-4db3-bb48-367e69d63f03 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:34:08.082041 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25fd57a-1443-4db3-bb48-367e69d63f03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:34:08.178715 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-d25fd57a-1443-4db3-bb48-367e69d63f03 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:34:08.179983 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-d25fd57a-1443-4db3-bb48-367e69d63f03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:34:08.204120 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1211/2398] 10.222.0.20 () {58 vars in 1016 bytes} [Fri Sep 9 16:34:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:34:08.220469 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b7e248-114e-4e93-84b5-353db129fe0a service nova] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:34:08.234030 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b7e248-114e-4e93-84b5-353db129fe0a service nova] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:34:08.240669 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936d1a84-85a4-446e-87d9-fffdae7b1af7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a332b9b4980646a3b14633293f77b505', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:34:08.241476 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936d1a84-85a4-446e-87d9-fffdae7b1af7 service nova] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:34:08.241929 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936d1a84-85a4-446e-87d9-fffdae7b1af7 service nova] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:34:08.242401 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936d1a84-85a4-446e-87d9-fffdae7b1af7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:34:08.254273 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936d1a84-85a4-446e-87d9-fffdae7b1af7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:34:08.256532 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936d1a84-85a4-446e-87d9-fffdae7b1af7 service nova] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:34:08.279937 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1188/2399] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:34:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:34:08.625579 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c9eba2-f3e4-43cd-840e-8992a4005b90 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:34:08.626450 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c9eba2-f3e4-43cd-840e-8992a4005b90 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:34:08.627270 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c9eba2-f3e4-43cd-840e-8992a4005b90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:34:08.652429 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-04c9eba2-f3e4-43cd-840e-8992a4005b90 None None] MFA Rules not processed for user `86e21d94c615492fb68249591445e448`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:34:08.653915 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-04c9eba2-f3e4-43cd-840e-8992a4005b90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:34:08.687354 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1212/2400] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:34:08 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:34:08.714169 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e0975c-231f-4bcb-a8a3-c6026754b0b2 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:34:08.714488 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e0975c-231f-4bcb-a8a3-c6026754b0b2 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:34:08.714835 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e0975c-231f-4bcb-a8a3-c6026754b0b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:34:08.737968 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-27e0975c-231f-4bcb-a8a3-c6026754b0b2 None None] MFA Rules not processed for user `b9d05f3782d24127aa613c8d7ac8041b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:34:08.739317 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-27e0975c-231f-4bcb-a8a3-c6026754b0b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:34:08.747007 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1189/2401] 10.222.0.27 () {58 vars in 1009 bytes} [Fri Sep 9 16:34:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:34:08.768376 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c9eba2-f3e4-43cd-840e-8992a4005b90 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:34:08.786506 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c9eba2-f3e4-43cd-840e-8992a4005b90 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:34:08.791876 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5817e3ae-04d6-4db9-afe7-70e9621f841c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2350bbc4a194c2dab2e3be830fd0eba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:34:08.796295 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5817e3ae-04d6-4db9-afe7-70e9621f841c service swift] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:34:08.796680 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5817e3ae-04d6-4db9-afe7-70e9621f841c service swift] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:34:08.797188 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5817e3ae-04d6-4db9-afe7-70e9621f841c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:34:08.809224 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5817e3ae-04d6-4db9-afe7-70e9621f841c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:34:08.810851 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5817e3ae-04d6-4db9-afe7-70e9621f841c service swift] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:34:08.821787 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1213/2402] 10.222.0.27 () {60 vars in 1384 bytes} [Fri Sep 9 16:34:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 09 16:34:09.882338 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406ab7bc-2615-4cd3-b471-7e6272f9a98e None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:34:09.883132 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406ab7bc-2615-4cd3-b471-7e6272f9a98e None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:34:09.883132 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406ab7bc-2615-4cd3-b471-7e6272f9a98e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:34:09.922896 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-406ab7bc-2615-4cd3-b471-7e6272f9a98e None None] MFA Rules not processed for user `b9d05f3782d24127aa613c8d7ac8041b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:34:09.927732 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-406ab7bc-2615-4cd3-b471-7e6272f9a98e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:34:09.946957 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1190/2403] 10.222.0.27 () {58 vars in 967 bytes} [Fri Sep 9 16:34:09 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:34:09.960805 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5817e3ae-04d6-4db9-afe7-70e9621f841c service swift] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:34:09.972641 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5817e3ae-04d6-4db9-afe7-70e9621f841c service swift] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:34:09.989744 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbea742-1143-4908-9cde-5576abc99e48 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2350bbc4a194c2dab2e3be830fd0eba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:34:09.990390 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbea742-1143-4908-9cde-5576abc99e48 service swift] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:34:09.990674 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbea742-1143-4908-9cde-5576abc99e48 service swift] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:34:09.990947 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbea742-1143-4908-9cde-5576abc99e48 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:34:10.013358 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbea742-1143-4908-9cde-5576abc99e48 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:34:10.024882 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbea742-1143-4908-9cde-5576abc99e48 service swift] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:34:10.040026 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1214/2404] 10.222.0.27 () {60 vars in 1384 bytes} [Fri Sep 9 16:34:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 09 16:34:10.613054 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4021ed73-7ca1-4a08-a428-ab140bf46ed6 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:34:10.613315 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4021ed73-7ca1-4a08-a428-ab140bf46ed6 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:34:10.613594 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4021ed73-7ca1-4a08-a428-ab140bf46ed6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:34:10.634659 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-4021ed73-7ca1-4a08-a428-ab140bf46ed6 None None] MFA Rules not processed for user `b9d05f3782d24127aa613c8d7ac8041b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:34:10.636100 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-4021ed73-7ca1-4a08-a428-ab140bf46ed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:34:10.645909 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1191/2405] 10.222.0.27 () {58 vars in 1009 bytes} [Fri Sep 9 16:34:10 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:34:10.667037 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbea742-1143-4908-9cde-5576abc99e48 service swift] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:34:10.686974 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbea742-1143-4908-9cde-5576abc99e48 service swift] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:34:10.693993 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545e088d-4d0c-49a8-8578-e919f21fb0e9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2350bbc4a194c2dab2e3be830fd0eba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:34:10.694954 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545e088d-4d0c-49a8-8578-e919f21fb0e9 service swift] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:34:10.695479 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545e088d-4d0c-49a8-8578-e919f21fb0e9 service swift] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:34:10.695985 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545e088d-4d0c-49a8-8578-e919f21fb0e9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:34:10.705495 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545e088d-4d0c-49a8-8578-e919f21fb0e9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:34:10.707356 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545e088d-4d0c-49a8-8578-e919f21fb0e9 service swift] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:34:10.718411 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1215/2406] 10.222.0.27 () {60 vars in 1384 bytes} [Fri Sep 9 16:34:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 09 16:34:11.157966 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126bdf71-652e-4cb0-80c2-45048cc862cd None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:34:11.159014 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126bdf71-652e-4cb0-80c2-45048cc862cd None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:34:11.159516 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126bdf71-652e-4cb0-80c2-45048cc862cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:34:11.184987 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-126bdf71-652e-4cb0-80c2-45048cc862cd None None] MFA Rules not processed for user `b9d05f3782d24127aa613c8d7ac8041b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:34:11.187248 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-126bdf71-652e-4cb0-80c2-45048cc862cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:34:11.205216 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1192/2407] 10.222.0.27 () {58 vars in 967 bytes} [Fri Sep 9 16:34:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:34:11.237992 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545e088d-4d0c-49a8-8578-e919f21fb0e9 service swift] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:34:11.248784 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:34:11.259293 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545e088d-4d0c-49a8-8578-e919f21fb0e9 service swift] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:34:11.273398 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d853c8f5-2662-4444-abf5-39f41146ca25 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2350bbc4a194c2dab2e3be830fd0eba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:34:11.274215 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d853c8f5-2662-4444-abf5-39f41146ca25 service swift] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:34:11.274706 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d853c8f5-2662-4444-abf5-39f41146ca25 service swift] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:34:11.294047 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d853c8f5-2662-4444-abf5-39f41146ca25 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:34:11.338773 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d853c8f5-2662-4444-abf5-39f41146ca25 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:34:11.344033 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d853c8f5-2662-4444-abf5-39f41146ca25 service swift] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:34:11.364074 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1216/2408] 10.222.0.27 () {60 vars in 1384 bytes} [Fri Sep 9 16:34:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 09 16:34:11.521690 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc950535-ef56-4ac2-9b27-12606978a578 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:34:11.522077 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc950535-ef56-4ac2-9b27-12606978a578 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:34:11.522552 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc950535-ef56-4ac2-9b27-12606978a578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:34:11.549644 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-dc950535-ef56-4ac2-9b27-12606978a578 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:34:11.551044 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-dc950535-ef56-4ac2-9b27-12606978a578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:34:11.572271 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1193/2409] 10.222.0.20 () {58 vars in 1016 bytes} [Fri Sep 9 16:34:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:34:11.592808 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d853c8f5-2662-4444-abf5-39f41146ca25 service swift] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:34:11.597989 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-d853c8f5-2662-4444-abf5-39f41146ca25 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:34:11.626578 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d853c8f5-2662-4444-abf5-39f41146ca25 service swift] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:34:11.632745 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38be312-c3b0-4adb-b40e-a47da0e625d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a332b9b4980646a3b14633293f77b505', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:34:11.633582 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38be312-c3b0-4adb-b40e-a47da0e625d3 service nova] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:34:11.634048 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38be312-c3b0-4adb-b40e-a47da0e625d3 service nova] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:34:11.634611 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38be312-c3b0-4adb-b40e-a47da0e625d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:34:11.646176 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38be312-c3b0-4adb-b40e-a47da0e625d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:34:11.648630 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38be312-c3b0-4adb-b40e-a47da0e625d3 service nova] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:34:11.668733 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1217/2410] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:34:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:34:13.788680 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc950535-ef56-4ac2-9b27-12606978a578 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:34:13.790128 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-dc950535-ef56-4ac2-9b27-12606978a578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:34:13.821222 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc950535-ef56-4ac2-9b27-12606978a578 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:34:13.836167 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8835d9-3e62-4650-b37d-6fdf15dadbed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:34:13.836826 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8835d9-3e62-4650-b37d-6fdf15dadbed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:34:13.837109 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8835d9-3e62-4650-b37d-6fdf15dadbed admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:34:13.837385 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8835d9-3e62-4650-b37d-6fdf15dadbed admin admin] PATH_INFO: `/v3/users/fa068d40100441e78f79499d51e6f471` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:34:13.839215 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8835d9-3e62-4650-b37d-6fdf15dadbed admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa068d40100441e78f79499d51e6f471)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:34:13.841399 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8835d9-3e62-4650-b37d-6fdf15dadbed admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:34:13.907783 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-1c8835d9-3e62-4650-b37d-6fdf15dadbed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa068d40100441e78f79499d51e6f471'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:34:13.917719 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-1c8835d9-3e62-4650-b37d-6fdf15dadbed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa068d40100441e78f79499d51e6f471'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:34:13.919270 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-1c8835d9-3e62-4650-b37d-6fdf15dadbed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa068d40100441e78f79499d51e6f471'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:34:13.923850 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:34:13.935251 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-1c8835d9-3e62-4650-b37d-6fdf15dadbed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa068d40100441e78f79499d51e6f471'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:34:13.952172 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-1c8835d9-3e62-4650-b37d-6fdf15dadbed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa068d40100441e78f79499d51e6f471'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:34:13.958685 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1194/2411] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 16:34:13 2022] DELETE /identity/v3/users/fa068d40100441e78f79499d51e6f471 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:34:13.963206 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b235eea-62ba-4d72-9bc1-52e983096825 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:34:13.964061 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b235eea-62ba-4d72-9bc1-52e983096825 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:34:13.964665 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b235eea-62ba-4d72-9bc1-52e983096825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:34:13.984842 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-0b235eea-62ba-4d72-9bc1-52e983096825 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:34:13.986053 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-0b235eea-62ba-4d72-9bc1-52e983096825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:34:14.048122 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1218/2412] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:34:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 16:34:14.058570 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8835d9-3e62-4650-b37d-6fdf15dadbed admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:34:14.060145 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-1c8835d9-3e62-4650-b37d-6fdf15dadbed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:34:14.124439 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8835d9-3e62-4650-b37d-6fdf15dadbed admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:34:14.128189 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f06cc6-a5b0-4e06-84cb-8c90b27e5f0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f44bfdd5214e8d84a2c0a5b1fd9b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:34:14.128791 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f06cc6-a5b0-4e06-84cb-8c90b27e5f0a service neutron] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:34:14.129068 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f06cc6-a5b0-4e06-84cb-8c90b27e5f0a service neutron] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:34:14.129337 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f06cc6-a5b0-4e06-84cb-8c90b27e5f0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:34:14.140459 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f06cc6-a5b0-4e06-84cb-8c90b27e5f0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:34:14.141997 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f06cc6-a5b0-4e06-84cb-8c90b27e5f0a service neutron] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:34:14.152853 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1195/2413] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:34:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 16:34:14.379762 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b235eea-62ba-4d72-9bc1-52e983096825 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:34:14.381680 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-0b235eea-62ba-4d72-9bc1-52e983096825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:34:14.408872 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b235eea-62ba-4d72-9bc1-52e983096825 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:34:14.414157 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affa7720-d0e3-4a21-9591-eaa3c8f868a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:34:14.414897 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affa7720-d0e3-4a21-9591-eaa3c8f868a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:34:14.415178 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affa7720-d0e3-4a21-9591-eaa3c8f868a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:34:14.415470 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affa7720-d0e3-4a21-9591-eaa3c8f868a0 admin admin] PATH_INFO: `/v3/projects/6b42b5fa0eab4f9f9e8a485d07f06c12` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:34:14.416683 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affa7720-d0e3-4a21-9591-eaa3c8f868a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b42b5fa0eab4f9f9e8a485d07f06c12)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:34:14.418687 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affa7720-d0e3-4a21-9591-eaa3c8f868a0 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:34:14.477320 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-affa7720-d0e3-4a21-9591-eaa3c8f868a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b42b5fa0eab4f9f9e8a485d07f06c12', 'request_id': 'req-affa7720-d0e3-4a21-9591-eaa3c8f868a0'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:34:14.483829 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-affa7720-d0e3-4a21-9591-eaa3c8f868a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b42b5fa0eab4f9f9e8a485d07f06c12', 'request_id': 'req-affa7720-d0e3-4a21-9591-eaa3c8f868a0'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:34:14.496716 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-affa7720-d0e3-4a21-9591-eaa3c8f868a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b42b5fa0eab4f9f9e8a485d07f06c12', 'request_id': 'req-affa7720-d0e3-4a21-9591-eaa3c8f868a0'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:34:14.511474 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-affa7720-d0e3-4a21-9591-eaa3c8f868a0 admin admin] The token cache is being invalidate because project 6b42b5fa0eab4f9f9e8a485d07f06c12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81446) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 16:34:14.511926 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-affa7720-d0e3-4a21-9591-eaa3c8f868a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:34:14.512655 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-affa7720-d0e3-4a21-9591-eaa3c8f868a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:34:14.529793 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1219/2414] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 16:34:14 2022] DELETE /identity/v3/projects/6b42b5fa0eab4f9f9e8a485d07f06c12 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:34:15.071195 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150cdec1-3f1d-4a7f-aaa3-f86e7f651d01 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:34:15.071697 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150cdec1-3f1d-4a7f-aaa3-f86e7f651d01 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:34:15.071798 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150cdec1-3f1d-4a7f-aaa3-f86e7f651d01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:34:15.099058 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-150cdec1-3f1d-4a7f-aaa3-f86e7f651d01 None None] MFA Rules not processed for user `b9d05f3782d24127aa613c8d7ac8041b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:34:15.112550 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-150cdec1-3f1d-4a7f-aaa3-f86e7f651d01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:34:15.200268 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1196/2415] 10.222.0.27 () {58 vars in 1009 bytes} [Fri Sep 9 16:34:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 16:34:15.222923 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affa7720-d0e3-4a21-9591-eaa3c8f868a0 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:34:15.225093 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-affa7720-d0e3-4a21-9591-eaa3c8f868a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:34:15.344679 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:34:15.359052 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affa7720-d0e3-4a21-9591-eaa3c8f868a0 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:34:15.365888 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c527c8-61f1-45d2-81b1-8bfadda70f2e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2350bbc4a194c2dab2e3be830fd0eba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:34:15.367254 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c527c8-61f1-45d2-81b1-8bfadda70f2e service swift] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:34:15.367920 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c527c8-61f1-45d2-81b1-8bfadda70f2e service swift] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:34:15.368402 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c527c8-61f1-45d2-81b1-8bfadda70f2e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:34:15.381821 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c527c8-61f1-45d2-81b1-8bfadda70f2e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:34:15.384417 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c527c8-61f1-45d2-81b1-8bfadda70f2e service swift] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:34:15.395982 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1220/2416] 10.222.0.27 () {60 vars in 1384 bytes} [Fri Sep 9 16:34:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 09 16:34:15.682754 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3932a5-f393-4a48-89a0-a7d444b2655e None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:34:15.683179 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3932a5-f393-4a48-89a0-a7d444b2655e None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:34:15.684273 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3932a5-f393-4a48-89a0-a7d444b2655e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:34:15.733433 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-0c3932a5-f393-4a48-89a0-a7d444b2655e None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:34:15.738739 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-0c3932a5-f393-4a48-89a0-a7d444b2655e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:34:15.892313 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1197/2417] 10.222.0.20 () {58 vars in 1016 bytes} [Fri Sep 9 16:34:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:34:15.908200 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c527c8-61f1-45d2-81b1-8bfadda70f2e service swift] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:34:15.909621 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-f3c527c8-61f1-45d2-81b1-8bfadda70f2e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:34:15.998258 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c527c8-61f1-45d2-81b1-8bfadda70f2e service swift] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:34:16.004951 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65913268-a7bc-4c01-b9f3-18147d583628 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a332b9b4980646a3b14633293f77b505', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:34:16.005565 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65913268-a7bc-4c01-b9f3-18147d583628 service nova] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:34:16.005839 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65913268-a7bc-4c01-b9f3-18147d583628 service nova] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:34:16.006106 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65913268-a7bc-4c01-b9f3-18147d583628 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:34:16.016743 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65913268-a7bc-4c01-b9f3-18147d583628 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:34:16.018580 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65913268-a7bc-4c01-b9f3-18147d583628 service nova] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:34:16.038696 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1221/2418] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:34:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:34:25.874716 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=89,keystone:DELETE=2 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:34:26.024664 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=38 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:34:29.330595 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb3782d-e694-4da8-a89f-c28a3850b987 None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:34:29.331212 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb3782d-e694-4da8-a89f-c28a3850b987 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:34:29.331359 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb3782d-e694-4da8-a89f-c28a3850b987 None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:34:29.333116 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1198/2419] 10.222.0.27 () {54 vars in 921 bytes} [Fri Sep 9 16:34:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:34:29.341695 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f941f24-3106-4bd4-8273-c32cc2c86444 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:34:29.342280 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f941f24-3106-4bd4-8273-c32cc2c86444 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:34:29.342280 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f941f24-3106-4bd4-8273-c32cc2c86444 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:34:29.364010 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-3f941f24-3106-4bd4-8273-c32cc2c86444 None None] MFA Rules not processed for user `a332b9b4980646a3b14633293f77b505`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:34:29.365234 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-3f941f24-3106-4bd4-8273-c32cc2c86444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:34:29.374669 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1222/2420] 10.222.0.27 () {58 vars in 1018 bytes} [Fri Sep 9 16:34:29 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:34:29.386881 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb3782d-e694-4da8-a89f-c28a3850b987 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:34:29.388682 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-acb3782d-e694-4da8-a89f-c28a3850b987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:34:29.498855 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb3782d-e694-4da8-a89f-c28a3850b987 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:34:29.502857 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d906be-26e2-4c20-84cb-db6f0355a2b9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ddd42508eee4412ae139cb8526090d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:34:29.503483 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d906be-26e2-4c20-84cb-db6f0355a2b9 service glance] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:34:29.503760 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d906be-26e2-4c20-84cb-db6f0355a2b9 service glance] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:34:29.504025 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d906be-26e2-4c20-84cb-db6f0355a2b9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:34:29.515479 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d906be-26e2-4c20-84cb-db6f0355a2b9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:34:29.516952 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d906be-26e2-4c20-84cb-db6f0355a2b9 service glance] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:34:29.529446 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1199/2421] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:34:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:34:29.605589 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174065b9-9585-4beb-8f8d-fbdae2383790 None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:34:29.605871 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174065b9-9585-4beb-8f8d-fbdae2383790 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:34:29.606145 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174065b9-9585-4beb-8f8d-fbdae2383790 None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:34:29.607548 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1223/2422] 10.222.0.27 () {54 vars in 921 bytes} [Fri Sep 9 16:34:29 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:34:29.612554 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a28e30-fe5a-408e-b141-4d06b1d797de None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:34:29.612832 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a28e30-fe5a-408e-b141-4d06b1d797de None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:34:29.613102 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a28e30-fe5a-408e-b141-4d06b1d797de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:34:29.634173 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-50a28e30-fe5a-408e-b141-4d06b1d797de None None] MFA Rules not processed for user `d5f44bfdd5214e8d84a2c0a5b1fd9b84`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:34:29.635380 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-50a28e30-fe5a-408e-b141-4d06b1d797de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:34:29.685039 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1200/2423] 10.222.0.27 () {58 vars in 1018 bytes} [Fri Sep 9 16:34:29 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:34:29.697119 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174065b9-9585-4beb-8f8d-fbdae2383790 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:34:29.699321 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-174065b9-9585-4beb-8f8d-fbdae2383790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:34:29.712436 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174065b9-9585-4beb-8f8d-fbdae2383790 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:34:29.716762 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8972b5-1676-4800-a897-d77c2c9b6f15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f44bfdd5214e8d84a2c0a5b1fd9b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:34:29.717346 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8972b5-1676-4800-a897-d77c2c9b6f15 service neutron] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:34:29.717625 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8972b5-1676-4800-a897-d77c2c9b6f15 service neutron] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:34:29.717889 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8972b5-1676-4800-a897-d77c2c9b6f15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:34:29.724828 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8972b5-1676-4800-a897-d77c2c9b6f15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:34:29.726260 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8972b5-1676-4800-a897-d77c2c9b6f15 service neutron] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:34:29.733772 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1224/2424] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:34:29 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:34:29.816074 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de10606-ccfd-499a-a9d5-1c7ece4f42b1 None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:34:29.816387 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de10606-ccfd-499a-a9d5-1c7ece4f42b1 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:34:29.816654 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de10606-ccfd-499a-a9d5-1c7ece4f42b1 None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:34:29.818278 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1201/2425] 10.222.0.27 () {54 vars in 921 bytes} [Fri Sep 9 16:34:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:34:29.823580 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46aefb0-78f3-49fd-9def-11670424a414 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:34:29.824364 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46aefb0-78f3-49fd-9def-11670424a414 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:34:29.824635 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46aefb0-78f3-49fd-9def-11670424a414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:34:29.844337 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-c46aefb0-78f3-49fd-9def-11670424a414 None None] MFA Rules not processed for user `a332b9b4980646a3b14633293f77b505`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:34:29.845567 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-c46aefb0-78f3-49fd-9def-11670424a414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:34:29.855139 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1225/2426] 10.222.0.27 () {58 vars in 1018 bytes} [Fri Sep 9 16:34:29 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:34:29.865874 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de10606-ccfd-499a-a9d5-1c7ece4f42b1 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:34:29.877317 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de10606-ccfd-499a-a9d5-1c7ece4f42b1 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:34:29.881344 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6edf37-016b-4f7c-86fc-a7069c61f481 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f44bfdd5214e8d84a2c0a5b1fd9b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:34:29.882169 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6edf37-016b-4f7c-86fc-a7069c61f481 service neutron] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:34:29.882324 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6edf37-016b-4f7c-86fc-a7069c61f481 service neutron] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:34:29.882686 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6edf37-016b-4f7c-86fc-a7069c61f481 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:34:29.894916 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6edf37-016b-4f7c-86fc-a7069c61f481 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:34:29.896540 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6edf37-016b-4f7c-86fc-a7069c61f481 service neutron] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:34:29.909338 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1202/2427] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:34:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:34:32.235738 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056f7cb3-51c4-4d3a-a23a-cc411104e8a5 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:34:32.236284 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056f7cb3-51c4-4d3a-a23a-cc411104e8a5 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:34:32.236284 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056f7cb3-51c4-4d3a-a23a-cc411104e8a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:34:32.255835 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-056f7cb3-51c4-4d3a-a23a-cc411104e8a5 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:34:32.257023 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-056f7cb3-51c4-4d3a-a23a-cc411104e8a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:34:32.264836 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1226/2428] 10.222.0.20 () {58 vars in 1016 bytes} [Fri Sep 9 16:34:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:34:32.306681 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6edf37-016b-4f7c-86fc-a7069c61f481 service neutron] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:34:32.308176 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-ef6edf37-016b-4f7c-86fc-a7069c61f481 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:34:32.323442 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6edf37-016b-4f7c-86fc-a7069c61f481 service neutron] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:34:32.328776 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2a2e14-982e-40fd-aef8-fdd8b1387918 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a332b9b4980646a3b14633293f77b505', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:34:32.329378 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2a2e14-982e-40fd-aef8-fdd8b1387918 service nova] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:34:32.329656 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2a2e14-982e-40fd-aef8-fdd8b1387918 service nova] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:34:32.329921 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2a2e14-982e-40fd-aef8-fdd8b1387918 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:34:32.337778 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2a2e14-982e-40fd-aef8-fdd8b1387918 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:34:32.339933 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2a2e14-982e-40fd-aef8-fdd8b1387918 service nova] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:34:32.349071 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1203/2429] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:34:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:34:34.766228 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0931b2-05d0-4fe9-9fbb-0cbd90a54f55 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:34:34.766695 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0931b2-05d0-4fe9-9fbb-0cbd90a54f55 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:34:34.767087 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0931b2-05d0-4fe9-9fbb-0cbd90a54f55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:34:34.786413 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-9a0931b2-05d0-4fe9-9fbb-0cbd90a54f55 None None] MFA Rules not processed for user `b9d05f3782d24127aa613c8d7ac8041b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:34:34.787531 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-9a0931b2-05d0-4fe9-9fbb-0cbd90a54f55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:34:34.795213 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1227/2430] 10.222.0.27 () {58 vars in 1009 bytes} [Fri Sep 9 16:34:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:34:34.807140 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2a2e14-982e-40fd-aef8-fdd8b1387918 service nova] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:34:34.820197 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2a2e14-982e-40fd-aef8-fdd8b1387918 service nova] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:34:34.825743 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563b29a2-3c79-430e-867c-03d8712cd5df service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2350bbc4a194c2dab2e3be830fd0eba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:34:34.826365 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563b29a2-3c79-430e-867c-03d8712cd5df service swift] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:34:34.826646 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563b29a2-3c79-430e-867c-03d8712cd5df service swift] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:34:34.826916 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563b29a2-3c79-430e-867c-03d8712cd5df service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:34:34.835043 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563b29a2-3c79-430e-867c-03d8712cd5df service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:34:34.836607 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563b29a2-3c79-430e-867c-03d8712cd5df service swift] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:34:34.845193 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1204/2431] 10.222.0.27 () {60 vars in 1384 bytes} [Fri Sep 9 16:34:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 09 16:34:35.430769 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519fcebf-1ebf-41e4-bfb9-425c02c0135e None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:34:35.431175 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519fcebf-1ebf-41e4-bfb9-425c02c0135e None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:34:35.431578 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519fcebf-1ebf-41e4-bfb9-425c02c0135e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:34:35.465386 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-519fcebf-1ebf-41e4-bfb9-425c02c0135e None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:34:35.467229 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-519fcebf-1ebf-41e4-bfb9-425c02c0135e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:34:35.475692 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1228/2432] 10.222.0.20 () {58 vars in 1016 bytes} [Fri Sep 9 16:34:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:34:35.491807 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563b29a2-3c79-430e-867c-03d8712cd5df service swift] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:34:35.505356 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563b29a2-3c79-430e-867c-03d8712cd5df service swift] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:34:35.511169 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ab6972-63ee-49c9-97a6-a8eb57325936 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a332b9b4980646a3b14633293f77b505', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:34:35.511872 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ab6972-63ee-49c9-97a6-a8eb57325936 service nova] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:34:35.512237 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ab6972-63ee-49c9-97a6-a8eb57325936 service nova] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:34:35.512988 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ab6972-63ee-49c9-97a6-a8eb57325936 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:34:35.523158 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ab6972-63ee-49c9-97a6-a8eb57325936 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:34:35.524868 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ab6972-63ee-49c9-97a6-a8eb57325936 service nova] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:34:35.536359 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1205/2433] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:34:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:34:45.450367 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=21 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:34:45.531965 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=73 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:34:54.466612 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83210211-008f-4092-aeb8-446bb48f1649 None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:34:54.467422 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83210211-008f-4092-aeb8-446bb48f1649 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:34:54.467855 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83210211-008f-4092-aeb8-446bb48f1649 None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:34:54.469737 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1229/2434] 10.222.0.27 () {54 vars in 961 bytes} [Fri Sep 9 16:34:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:34:54.475209 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b0e0a6-0ee0-4382-bdbd-5b9b3a428600 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:34:54.475692 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b0e0a6-0ee0-4382-bdbd-5b9b3a428600 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:34:54.476086 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b0e0a6-0ee0-4382-bdbd-5b9b3a428600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:34:54.507452 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-97b0e0a6-0ee0-4382-bdbd-5b9b3a428600 None None] MFA Rules not processed for user `2d73df92393c43b2b5ccc32a2d43d952`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:34:54.508759 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-97b0e0a6-0ee0-4382-bdbd-5b9b3a428600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:34:54.596916 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1206/2435] 10.222.0.27 () {58 vars in 1058 bytes} [Fri Sep 9 16:34:54 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 16:34:54.604105 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83210211-008f-4092-aeb8-446bb48f1649 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:34:54.620401 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83210211-008f-4092-aeb8-446bb48f1649 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:34:54.626067 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4687a5e9-5ac0-44eb-af1f-34f55d04817a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d73df92393c43b2b5ccc32a2d43d952', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:34:54.626692 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4687a5e9-5ac0-44eb-af1f-34f55d04817a service placement] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:34:54.626969 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4687a5e9-5ac0-44eb-af1f-34f55d04817a service placement] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:34:54.627235 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4687a5e9-5ac0-44eb-af1f-34f55d04817a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:34:54.628981 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-4687a5e9-5ac0-44eb-af1f-34f55d04817a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:34:54.642505 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4687a5e9-5ac0-44eb-af1f-34f55d04817a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:34:54.648077 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4687a5e9-5ac0-44eb-af1f-34f55d04817a service placement] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:34:54.668114 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1230/2436] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:34:54 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:34:56.428186 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffbaac4-696a-46d7-9cd9-bc70d53cdc5a None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:34:56.428672 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffbaac4-696a-46d7-9cd9-bc70d53cdc5a None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:34:56.428772 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffbaac4-696a-46d7-9cd9-bc70d53cdc5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:34:56.448302 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-2ffbaac4-696a-46d7-9cd9-bc70d53cdc5a None None] MFA Rules not processed for user `b9d05f3782d24127aa613c8d7ac8041b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:34:56.449499 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-2ffbaac4-696a-46d7-9cd9-bc70d53cdc5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:34:56.457269 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1207/2437] 10.222.0.27 () {58 vars in 967 bytes} [Fri Sep 9 16:34:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:34:56.480524 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4687a5e9-5ac0-44eb-af1f-34f55d04817a service placement] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:34:56.491989 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4687a5e9-5ac0-44eb-af1f-34f55d04817a service placement] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:34:56.497210 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c085061-568f-41c7-a977-63089583f9d2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2350bbc4a194c2dab2e3be830fd0eba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:34:56.497797 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c085061-568f-41c7-a977-63089583f9d2 service swift] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:34:56.498072 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c085061-568f-41c7-a977-63089583f9d2 service swift] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:34:56.498372 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c085061-568f-41c7-a977-63089583f9d2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:34:56.506330 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c085061-568f-41c7-a977-63089583f9d2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:34:56.507897 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c085061-568f-41c7-a977-63089583f9d2 service swift] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:34:56.515739 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1231/2438] 10.222.0.27 () {60 vars in 1384 bytes} [Fri Sep 9 16:34:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 09 16:34:57.118395 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffbaac4-696a-46d7-9cd9-bc70d53cdc5a None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:34:57.128508 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffbaac4-696a-46d7-9cd9-bc70d53cdc5a None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:34:57.132152 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664f3f1b-99d5-4212-bdb2-c3ad511135d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f44bfdd5214e8d84a2c0a5b1fd9b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:34:57.132750 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664f3f1b-99d5-4212-bdb2-c3ad511135d3 service neutron] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:34:57.133026 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664f3f1b-99d5-4212-bdb2-c3ad511135d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:34:57.133293 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664f3f1b-99d5-4212-bdb2-c3ad511135d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:34:57.135062 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-664f3f1b-99d5-4212-bdb2-c3ad511135d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:34:57.198234 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664f3f1b-99d5-4212-bdb2-c3ad511135d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:34:57.199936 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664f3f1b-99d5-4212-bdb2-c3ad511135d3 service neutron] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:34:57.210067 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1208/2439] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:34:57 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:35:02.305674 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3ed4da-c15e-4a1e-8aee-22e4a12a1b62 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:35:02.306178 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3ed4da-c15e-4a1e-8aee-22e4a12a1b62 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:35:02.306326 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3ed4da-c15e-4a1e-8aee-22e4a12a1b62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:35:02.326683 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-4b3ed4da-c15e-4a1e-8aee-22e4a12a1b62 None None] MFA Rules not processed for user `44f59fc6c4044b9491e9eded27d9422e`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:35:02.327876 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-4b3ed4da-c15e-4a1e-8aee-22e4a12a1b62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:35:02.383892 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1232/2440] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:35:02 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:35:07.205260 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=62 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:35:12.376796 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=37 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:35:17.404799 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f29bff-6662-44ef-972f-b2397ccc04f7 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:35:17.405351 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f29bff-6662-44ef-972f-b2397ccc04f7 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:35:17.405351 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f29bff-6662-44ef-972f-b2397ccc04f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:35:17.424674 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-e9f29bff-6662-44ef-972f-b2397ccc04f7 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:35:17.425906 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-e9f29bff-6662-44ef-972f-b2397ccc04f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:35:17.434640 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1209/2441] 10.222.0.20 () {58 vars in 1016 bytes} [Fri Sep 9 16:35:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:35:17.461503 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3ed4da-c15e-4a1e-8aee-22e4a12a1b62 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:35:17.474460 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3ed4da-c15e-4a1e-8aee-22e4a12a1b62 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:35:17.479985 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a26ed8a-8282-433a-8b87-823d8dd5545b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a332b9b4980646a3b14633293f77b505', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:35:17.480600 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a26ed8a-8282-433a-8b87-823d8dd5545b service nova] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:35:17.480895 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a26ed8a-8282-433a-8b87-823d8dd5545b service nova] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:35:17.481153 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a26ed8a-8282-433a-8b87-823d8dd5545b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:35:17.489908 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a26ed8a-8282-433a-8b87-823d8dd5545b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:35:17.491517 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a26ed8a-8282-433a-8b87-823d8dd5545b service nova] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:35:17.501487 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1233/2442] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:35:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:35:20.672206 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715ec14e-bbd0-4458-acdd-11cbe7d22d8b None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:35:20.672772 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715ec14e-bbd0-4458-acdd-11cbe7d22d8b None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:35:20.672871 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715ec14e-bbd0-4458-acdd-11cbe7d22d8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:35:20.692191 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-715ec14e-bbd0-4458-acdd-11cbe7d22d8b None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:35:20.693735 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-715ec14e-bbd0-4458-acdd-11cbe7d22d8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:35:20.702494 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1210/2443] 10.222.0.20 () {58 vars in 1016 bytes} [Fri Sep 9 16:35:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:35:20.717638 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a26ed8a-8282-433a-8b87-823d8dd5545b service nova] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:35:20.728582 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a26ed8a-8282-433a-8b87-823d8dd5545b service nova] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:35:20.734119 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d96f42-3e58-4e21-a635-3fb81e9e9ae3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a332b9b4980646a3b14633293f77b505', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:35:20.734800 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d96f42-3e58-4e21-a635-3fb81e9e9ae3 service nova] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:35:20.735145 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d96f42-3e58-4e21-a635-3fb81e9e9ae3 service nova] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:35:20.735420 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d96f42-3e58-4e21-a635-3fb81e9e9ae3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:35:20.743616 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d96f42-3e58-4e21-a635-3fb81e9e9ae3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:35:20.745172 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d96f42-3e58-4e21-a635-3fb81e9e9ae3 service nova] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:35:20.754765 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1234/2444] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:35:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:35:23.219996 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58b1a0e-62e4-4d4e-9488-0b809916b42d None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:35:23.220476 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58b1a0e-62e4-4d4e-9488-0b809916b42d None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:35:23.220580 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58b1a0e-62e4-4d4e-9488-0b809916b42d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:35:23.238772 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-e58b1a0e-62e4-4d4e-9488-0b809916b42d None None] MFA Rules not processed for user `c85e41cec8cc45608a3f7415884e750c`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:35:23.239945 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-e58b1a0e-62e4-4d4e-9488-0b809916b42d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:35:23.292753 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1211/2445] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:35:23 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:35:24.790917 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a384ce43-6010-4e2d-9d96-e5f32adc61e4 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:35:24.791439 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a384ce43-6010-4e2d-9d96-e5f32adc61e4 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:35:24.791546 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a384ce43-6010-4e2d-9d96-e5f32adc61e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:35:24.811586 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-a384ce43-6010-4e2d-9d96-e5f32adc61e4 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:35:24.813154 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-a384ce43-6010-4e2d-9d96-e5f32adc61e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:35:24.825792 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1235/2446] 10.222.0.20 () {58 vars in 1016 bytes} [Fri Sep 9 16:35:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:35:24.909390 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58b1a0e-62e4-4d4e-9488-0b809916b42d None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:35:24.923874 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58b1a0e-62e4-4d4e-9488-0b809916b42d None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:35:24.929580 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93646fce-2663-4f67-87a8-fb9d9c724fc1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a332b9b4980646a3b14633293f77b505', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:35:24.930271 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93646fce-2663-4f67-87a8-fb9d9c724fc1 service nova] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:35:24.930652 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93646fce-2663-4f67-87a8-fb9d9c724fc1 service nova] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:35:24.930935 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93646fce-2663-4f67-87a8-fb9d9c724fc1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:35:24.939394 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93646fce-2663-4f67-87a8-fb9d9c724fc1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:35:24.940989 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93646fce-2663-4f67-87a8-fb9d9c724fc1 service nova] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:35:24.950939 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1212/2447] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:35:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:35:29.028914 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5262d094-170e-4d76-9144-c32c49611848 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:35:29.029450 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5262d094-170e-4d76-9144-c32c49611848 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:35:29.029450 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5262d094-170e-4d76-9144-c32c49611848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:35:29.048901 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-5262d094-170e-4d76-9144-c32c49611848 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:35:29.050245 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-5262d094-170e-4d76-9144-c32c49611848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:35:29.058268 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1236/2448] 10.222.0.20 () {58 vars in 1016 bytes} [Fri Sep 9 16:35:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:35:29.073267 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93646fce-2663-4f67-87a8-fb9d9c724fc1 service nova] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:35:29.084919 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93646fce-2663-4f67-87a8-fb9d9c724fc1 service nova] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:35:29.091396 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f88fa3c-afec-4416-a5ce-6dcb7d2fd5d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a332b9b4980646a3b14633293f77b505', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:35:29.091995 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f88fa3c-afec-4416-a5ce-6dcb7d2fd5d4 service nova] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:35:29.092274 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f88fa3c-afec-4416-a5ce-6dcb7d2fd5d4 service nova] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:35:29.092582 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f88fa3c-afec-4416-a5ce-6dcb7d2fd5d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:35:29.101148 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f88fa3c-afec-4416-a5ce-6dcb7d2fd5d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:35:29.102789 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f88fa3c-afec-4416-a5ce-6dcb7d2fd5d4 service nova] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:35:29.113163 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1213/2449] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:35:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:35:33.210826 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f28921c-4b27-4a41-a892-cbdeed9a6811 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:35:33.211318 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f28921c-4b27-4a41-a892-cbdeed9a6811 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:35:33.211472 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f28921c-4b27-4a41-a892-cbdeed9a6811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:35:33.230546 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-2f28921c-4b27-4a41-a892-cbdeed9a6811 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:35:33.231731 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-2f28921c-4b27-4a41-a892-cbdeed9a6811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:35:33.239439 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1237/2450] 10.222.0.20 () {58 vars in 1016 bytes} [Fri Sep 9 16:35:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:35:33.258896 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f88fa3c-afec-4416-a5ce-6dcb7d2fd5d4 service nova] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:35:33.270296 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f88fa3c-afec-4416-a5ce-6dcb7d2fd5d4 service nova] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:35:33.275678 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1a38ad-58e3-46f4-b7ee-efcd1b9aa1b0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a332b9b4980646a3b14633293f77b505', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:35:33.276255 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1a38ad-58e3-46f4-b7ee-efcd1b9aa1b0 service nova] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:35:33.276535 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1a38ad-58e3-46f4-b7ee-efcd1b9aa1b0 service nova] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:35:33.277994 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1a38ad-58e3-46f4-b7ee-efcd1b9aa1b0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:35:33.287534 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1a38ad-58e3-46f4-b7ee-efcd1b9aa1b0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:35:33.289131 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1a38ad-58e3-46f4-b7ee-efcd1b9aa1b0 service nova] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:35:33.299027 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1214/2451] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:35:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:35:43.225031 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=21 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:35:43.294554 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=49 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:35:49.105293 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a932a5-ddc0-4553-9710-8082b66df147 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:35:49.105982 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a932a5-ddc0-4553-9710-8082b66df147 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:35:49.105982 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a932a5-ddc0-4553-9710-8082b66df147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:35:49.125322 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-16a932a5-ddc0-4553-9710-8082b66df147 None None] MFA Rules not processed for user `7ea10dd1db74490687a8be5a6f5a6f8a`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:35:49.126623 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-16a932a5-ddc0-4553-9710-8082b66df147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:35:49.180126 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1238/2452] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:35:49 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:35:59.173511 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=25 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:36:03.767414 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab20f6a-e4b4-4da2-b3ab-54200a121394 None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:36:03.767893 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab20f6a-e4b4-4da2-b3ab-54200a121394 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:36:03.767988 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab20f6a-e4b4-4da2-b3ab-54200a121394 None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:36:03.769287 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1215/2453] 10.222.0.27 () {54 vars in 921 bytes} [Fri Sep 9 16:36:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:36:03.779529 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f55783-07c7-46ab-9fbb-6c01e82c88e5 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:36:03.779977 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f55783-07c7-46ab-9fbb-6c01e82c88e5 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:36:03.780236 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f55783-07c7-46ab-9fbb-6c01e82c88e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:36:03.800415 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-05f55783-07c7-46ab-9fbb-6c01e82c88e5 None None] MFA Rules not processed for user `2d73df92393c43b2b5ccc32a2d43d952`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:36:03.801689 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-05f55783-07c7-46ab-9fbb-6c01e82c88e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:36:03.810371 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1239/2454] 10.222.0.27 () {58 vars in 1018 bytes} [Fri Sep 9 16:36:03 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:36:03.830027 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab20f6a-e4b4-4da2-b3ab-54200a121394 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:36:03.832296 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-bab20f6a-e4b4-4da2-b3ab-54200a121394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:36:03.845685 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f55783-07c7-46ab-9fbb-6c01e82c88e5 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:36:03.847112 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-05f55783-07c7-46ab-9fbb-6c01e82c88e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:36:03.853357 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab20f6a-e4b4-4da2-b3ab-54200a121394 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:36:03.860868 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e56bedc-5208-431e-9b71-cb030e53bede service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d73df92393c43b2b5ccc32a2d43d952', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:36:03.861477 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e56bedc-5208-431e-9b71-cb030e53bede service placement] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:36:03.861755 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e56bedc-5208-431e-9b71-cb030e53bede service placement] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:36:03.862019 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e56bedc-5208-431e-9b71-cb030e53bede service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:36:03.864124 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f55783-07c7-46ab-9fbb-6c01e82c88e5 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:36:03.871195 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141a1277-dbaa-4c27-b6c8-9ba26183450a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:36:03.871719 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e56bedc-5208-431e-9b71-cb030e53bede service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:36:03.871829 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141a1277-dbaa-4c27-b6c8-9ba26183450a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:36:03.872082 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141a1277-dbaa-4c27-b6c8-9ba26183450a admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:36:03.872347 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141a1277-dbaa-4c27-b6c8-9ba26183450a admin admin] PATH_INFO: `/v3/users/44f59fc6c4044b9491e9eded27d9422e` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:36:03.873296 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e56bedc-5208-431e-9b71-cb030e53bede service placement] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:36:03.874907 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141a1277-dbaa-4c27-b6c8-9ba26183450a admin admin] RBAC: Authorizing `identity:delete_user(user_id=44f59fc6c4044b9491e9eded27d9422e)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:36:03.878132 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141a1277-dbaa-4c27-b6c8-9ba26183450a admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:36:03.887401 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1216/2455] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:36:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 16:36:03.927781 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-141a1277-dbaa-4c27-b6c8-9ba26183450a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44f59fc6c4044b9491e9eded27d9422e'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:36:03.934694 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-141a1277-dbaa-4c27-b6c8-9ba26183450a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44f59fc6c4044b9491e9eded27d9422e'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:36:03.946723 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-141a1277-dbaa-4c27-b6c8-9ba26183450a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44f59fc6c4044b9491e9eded27d9422e'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:36:03.954077 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-141a1277-dbaa-4c27-b6c8-9ba26183450a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44f59fc6c4044b9491e9eded27d9422e'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:36:03.954725 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-141a1277-dbaa-4c27-b6c8-9ba26183450a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44f59fc6c4044b9491e9eded27d9422e'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:36:03.960808 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1240/2456] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 16:36:03 2022] DELETE /identity/v3/users/44f59fc6c4044b9491e9eded27d9422e => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 16:36:04.130723 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e56bedc-5208-431e-9b71-cb030e53bede service placement] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:36:04.141770 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e56bedc-5208-431e-9b71-cb030e53bede service placement] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:36:04.198844 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4af078-fe98-4a40-96e3-7e8cff3cbffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:36:04.199392 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4af078-fe98-4a40-96e3-7e8cff3cbffa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:36:04.199667 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4af078-fe98-4a40-96e3-7e8cff3cbffa admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:36:04.199935 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4af078-fe98-4a40-96e3-7e8cff3cbffa admin admin] PATH_INFO: `/v3/projects/3053b6ffe03c40a0a2831d64c90ad3d9` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:36:04.201034 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4af078-fe98-4a40-96e3-7e8cff3cbffa admin admin] RBAC: Authorizing `identity:delete_project(project_id=3053b6ffe03c40a0a2831d64c90ad3d9)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:36:04.202978 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4af078-fe98-4a40-96e3-7e8cff3cbffa admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:36:04.248116 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-fc4af078-fe98-4a40-96e3-7e8cff3cbffa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3053b6ffe03c40a0a2831d64c90ad3d9', 'request_id': 'req-fc4af078-fe98-4a40-96e3-7e8cff3cbffa'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:36:04.254662 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-fc4af078-fe98-4a40-96e3-7e8cff3cbffa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3053b6ffe03c40a0a2831d64c90ad3d9', 'request_id': 'req-fc4af078-fe98-4a40-96e3-7e8cff3cbffa'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:36:04.262745 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-fc4af078-fe98-4a40-96e3-7e8cff3cbffa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3053b6ffe03c40a0a2831d64c90ad3d9', 'request_id': 'req-fc4af078-fe98-4a40-96e3-7e8cff3cbffa'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:36:04.272810 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-fc4af078-fe98-4a40-96e3-7e8cff3cbffa admin admin] The token cache is being invalidate because project 3053b6ffe03c40a0a2831d64c90ad3d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81445) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 16:36:04.273112 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-fc4af078-fe98-4a40-96e3-7e8cff3cbffa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:36:04.273716 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-fc4af078-fe98-4a40-96e3-7e8cff3cbffa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:36:04.275216 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1217/2457] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 16:36:04 2022] DELETE /identity/v3/projects/3053b6ffe03c40a0a2831d64c90ad3d9 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:36:13.957165 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=32,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:36:14.269785 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=57,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:36:21.939922 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b543954d-ffe3-4337-b647-4d3909e3a870 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:36:21.940434 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b543954d-ffe3-4337-b647-4d3909e3a870 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:36:21.940549 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b543954d-ffe3-4337-b647-4d3909e3a870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:36:21.960322 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-b543954d-ffe3-4337-b647-4d3909e3a870 None None] MFA Rules not processed for user `8c3919b9f57e4604b89d3f6a2763b0b4`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:36:21.961512 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-b543954d-ffe3-4337-b647-4d3909e3a870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:36:22.014478 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1241/2458] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:36:21 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:36:32.007408 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=25 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:36:36.652960 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4af078-fe98-4a40-96e3-7e8cff3cbffa admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:36:36.655650 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-fc4af078-fe98-4a40-96e3-7e8cff3cbffa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:36:36.743454 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4af078-fe98-4a40-96e3-7e8cff3cbffa admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:36:36.750579 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ccff46-0a04-4551-9b5e-0eb80fc8ced2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:36:36.751463 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ccff46-0a04-4551-9b5e-0eb80fc8ced2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:36:36.751739 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ccff46-0a04-4551-9b5e-0eb80fc8ced2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:36:36.751998 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ccff46-0a04-4551-9b5e-0eb80fc8ced2 admin admin] PATH_INFO: `/v3/users/c85e41cec8cc45608a3f7415884e750c` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:36:36.753285 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ccff46-0a04-4551-9b5e-0eb80fc8ced2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c85e41cec8cc45608a3f7415884e750c)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:36:36.755312 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ccff46-0a04-4551-9b5e-0eb80fc8ced2 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:36:36.812234 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-99ccff46-0a04-4551-9b5e-0eb80fc8ced2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c85e41cec8cc45608a3f7415884e750c'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:36:36.821644 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-99ccff46-0a04-4551-9b5e-0eb80fc8ced2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c85e41cec8cc45608a3f7415884e750c'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:36:36.823385 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-99ccff46-0a04-4551-9b5e-0eb80fc8ced2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c85e41cec8cc45608a3f7415884e750c'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:36:36.831661 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-99ccff46-0a04-4551-9b5e-0eb80fc8ced2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c85e41cec8cc45608a3f7415884e750c'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:36:36.846187 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-99ccff46-0a04-4551-9b5e-0eb80fc8ced2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c85e41cec8cc45608a3f7415884e750c'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:36:36.860101 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1218/2459] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 16:36:36 2022] DELETE /identity/v3/users/c85e41cec8cc45608a3f7415884e750c => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:36:37.054372 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b543954d-ffe3-4337-b647-4d3909e3a870 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:36:37.069988 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b543954d-ffe3-4337-b647-4d3909e3a870 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:36:37.130124 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d97884-0314-4b4a-8d2f-2210f3025040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:36:37.130877 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d97884-0314-4b4a-8d2f-2210f3025040 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:36:37.131161 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d97884-0314-4b4a-8d2f-2210f3025040 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:36:37.131437 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d97884-0314-4b4a-8d2f-2210f3025040 admin admin] PATH_INFO: `/v3/projects/67f04562cdbc4a5a9fc822e383c5de6a` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:36:37.132556 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d97884-0314-4b4a-8d2f-2210f3025040 admin admin] RBAC: Authorizing `identity:delete_project(project_id=67f04562cdbc4a5a9fc822e383c5de6a)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:36:37.134531 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d97884-0314-4b4a-8d2f-2210f3025040 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:36:37.184907 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-06d97884-0314-4b4a-8d2f-2210f3025040 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67f04562cdbc4a5a9fc822e383c5de6a', 'request_id': 'req-06d97884-0314-4b4a-8d2f-2210f3025040'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:36:37.190690 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-06d97884-0314-4b4a-8d2f-2210f3025040 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67f04562cdbc4a5a9fc822e383c5de6a', 'request_id': 'req-06d97884-0314-4b4a-8d2f-2210f3025040'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:36:37.199728 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-06d97884-0314-4b4a-8d2f-2210f3025040 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67f04562cdbc4a5a9fc822e383c5de6a', 'request_id': 'req-06d97884-0314-4b4a-8d2f-2210f3025040'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:36:37.211125 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-06d97884-0314-4b4a-8d2f-2210f3025040 admin admin] The token cache is being invalidate because project 67f04562cdbc4a5a9fc822e383c5de6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81446) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 16:36:37.211455 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-06d97884-0314-4b4a-8d2f-2210f3025040 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:36:37.212128 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-06d97884-0314-4b4a-8d2f-2210f3025040 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:36:37.213891 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1242/2460] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 16:36:37 2022] DELETE /identity/v3/projects/67f04562cdbc4a5a9fc822e383c5de6a => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:36:37.218449 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d328d2cb-bc7c-45a8-8626-06c16c4143a5 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:36:37.218728 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d328d2cb-bc7c-45a8-8626-06c16c4143a5 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:36:37.218995 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d328d2cb-bc7c-45a8-8626-06c16c4143a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:36:37.239336 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-d328d2cb-bc7c-45a8-8626-06c16c4143a5 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:36:37.240583 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-d328d2cb-bc7c-45a8-8626-06c16c4143a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:36:37.312978 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1219/2461] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:36:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 16:36:37.314816 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bda5edf-b319-44a0-b1cc-8e157b37de90 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:36:37.315108 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bda5edf-b319-44a0-b1cc-8e157b37de90 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:36:37.315407 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bda5edf-b319-44a0-b1cc-8e157b37de90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:36:37.335529 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-3bda5edf-b319-44a0-b1cc-8e157b37de90 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:36:37.336762 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-3bda5edf-b319-44a0-b1cc-8e157b37de90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:36:37.344918 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1243/2462] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:36:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:36:37.349135 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d328d2cb-bc7c-45a8-8626-06c16c4143a5 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:36:37.359739 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d328d2cb-bc7c-45a8-8626-06c16c4143a5 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:36:37.364426 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd409ec9-6958-481e-9fa4-afffda854cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:36:37.365046 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd409ec9-6958-481e-9fa4-afffda854cb7 admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:36:37.365320 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd409ec9-6958-481e-9fa4-afffda854cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:36:37.365587 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd409ec9-6958-481e-9fa4-afffda854cb7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:36:37.366247 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd409ec9-6958-481e-9fa4-afffda854cb7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:36:37.366575 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd409ec9-6958-481e-9fa4-afffda854cb7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:36:37.368179 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd409ec9-6958-481e-9fa4-afffda854cb7 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:36:37.381080 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1220/2463] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Sep 9 16:36:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:36:37.385580 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bda5edf-b319-44a0-b1cc-8e157b37de90 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:36:37.394912 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bda5edf-b319-44a0-b1cc-8e157b37de90 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:36:37.399658 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d37168-7596-4031-bced-8dce0bcbbd4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:36:37.400250 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d37168-7596-4031-bced-8dce0bcbbd4e admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:36:37.400527 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d37168-7596-4031-bced-8dce0bcbbd4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:36:37.400817 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d37168-7596-4031-bced-8dce0bcbbd4e admin admin] PATH_INFO: `/v3/projects` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:36:37.401413 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d37168-7596-4031-bced-8dce0bcbbd4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:36:37.403391 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d37168-7596-4031-bced-8dce0bcbbd4e admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:36:37.434370 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1244/2464] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 16:36:37 2022] POST /identity/v3/projects => generated 363 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 16:36:37.435639 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd409ec9-6958-481e-9fa4-afffda854cb7 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:36:37.445984 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd409ec9-6958-481e-9fa4-afffda854cb7 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:36:37.449689 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:36:37.506091 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee05cd55-591d-4898-80ee-be25fe8df78e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:36:37.506741 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee05cd55-591d-4898-80ee-be25fe8df78e admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:36:37.507157 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee05cd55-591d-4898-80ee-be25fe8df78e admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:36:37.508066 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee05cd55-591d-4898-80ee-be25fe8df78e admin admin] PATH_INFO: `/v3/users` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:36:37.508066 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee05cd55-591d-4898-80ee-be25fe8df78e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:36:37.510649 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee05cd55-591d-4898-80ee-be25fe8df78e admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:36:37.533292 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1221/2465] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 16:36:37 2022] POST /identity/v3/users => generated 282 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:36:37.537569 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d37168-7596-4031-bced-8dce0bcbbd4e admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:36:37.547949 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d37168-7596-4031-bced-8dce0bcbbd4e admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:36:37.552566 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24af70ab-ad3a-4d3d-bc3b-5e204a49dda1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:36:37.553157 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24af70ab-ad3a-4d3d-bc3b-5e204a49dda1 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:36:37.553434 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24af70ab-ad3a-4d3d-bc3b-5e204a49dda1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:36:37.553708 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24af70ab-ad3a-4d3d-bc3b-5e204a49dda1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:36:37.554364 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24af70ab-ad3a-4d3d-bc3b-5e204a49dda1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:36:37.556016 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24af70ab-ad3a-4d3d-bc3b-5e204a49dda1 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:36:37.566720 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1245/2466] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:36:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 16:36:37.570900 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee05cd55-591d-4898-80ee-be25fe8df78e admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:36:37.581003 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee05cd55-591d-4898-80ee-be25fe8df78e admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:36:37.586698 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0045d72f-1d7d-4148-8f48-3e2bc3da37be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:36:37.587273 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0045d72f-1d7d-4148-8f48-3e2bc3da37be admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:36:37.587581 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0045d72f-1d7d-4148-8f48-3e2bc3da37be admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:36:37.587855 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0045d72f-1d7d-4148-8f48-3e2bc3da37be admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:36:37.589075 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0045d72f-1d7d-4148-8f48-3e2bc3da37be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:36:37.590720 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0045d72f-1d7d-4148-8f48-3e2bc3da37be admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:36:37.602103 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1222/2467] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:36:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 16:36:37.606350 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24af70ab-ad3a-4d3d-bc3b-5e204a49dda1 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:36:37.616707 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24af70ab-ad3a-4d3d-bc3b-5e204a49dda1 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:36:37.622031 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fbd06b-b60d-4f13-9867-c3f1984bcc39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:36:37.622735 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fbd06b-b60d-4f13-9867-c3f1984bcc39 admin admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:36:37.623012 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fbd06b-b60d-4f13-9867-c3f1984bcc39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:36:37.623285 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fbd06b-b60d-4f13-9867-c3f1984bcc39 admin admin] PATH_INFO: `/v3/projects/35a1715d0e2342d49030f8870f5f580b/users/b50855074f8e4de38e56bdfc9cebf987/roles/b38e84bf077846ee802e6bb1bad83522` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:36:37.638508 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fbd06b-b60d-4f13-9867-c3f1984bcc39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35a1715d0e2342d49030f8870f5f580b, user_id=b50855074f8e4de38e56bdfc9cebf987, role_id=b38e84bf077846ee802e6bb1bad83522)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:36:37.641165 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fbd06b-b60d-4f13-9867-c3f1984bcc39 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:36:37.655224 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1246/2468] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 16:36:37 2022] PUT /identity/v3/projects/35a1715d0e2342d49030f8870f5f580b/users/b50855074f8e4de38e56bdfc9cebf987/roles/b38e84bf077846ee802e6bb1bad83522 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:36:37.666103 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31562745-722b-40a4-a4fc-8ed6467d68ee None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:36:37.667165 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31562745-722b-40a4-a4fc-8ed6467d68ee None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:36:37.667417 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31562745-722b-40a4-a4fc-8ed6467d68ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:36:37.696316 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-31562745-722b-40a4-a4fc-8ed6467d68ee None None] MFA Rules not processed for user `b50855074f8e4de38e56bdfc9cebf987`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:36:37.698044 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-31562745-722b-40a4-a4fc-8ed6467d68ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:36:37.789995 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1223/2469] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:36:37 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:36:37.795087 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fbd06b-b60d-4f13-9867-c3f1984bcc39 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:36:37.831026 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:36:37.869347 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fbd06b-b60d-4f13-9867-c3f1984bcc39 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:36:37.874136 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6689bfd-3124-4e57-875b-6b09dda22e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:36:37.874773 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6689bfd-3124-4e57-875b-6b09dda22e31 admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:36:37.875054 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6689bfd-3124-4e57-875b-6b09dda22e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:36:37.875459 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6689bfd-3124-4e57-875b-6b09dda22e31 admin admin] PATH_INFO: `/v3/projects` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:36:37.876093 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6689bfd-3124-4e57-875b-6b09dda22e31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:36:37.878460 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6689bfd-3124-4e57-875b-6b09dda22e31 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:36:37.910784 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1247/2470] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 16:36:37 2022] POST /identity/v3/projects => generated 363 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 16:36:37.914836 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31562745-722b-40a4-a4fc-8ed6467d68ee None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:36:37.926069 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31562745-722b-40a4-a4fc-8ed6467d68ee None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:36:37.994760 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4721510c-4bf8-4c8b-8803-f287a6d965e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:36:37.995525 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4721510c-4bf8-4c8b-8803-f287a6d965e1 admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:36:37.995864 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4721510c-4bf8-4c8b-8803-f287a6d965e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:36:37.996208 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4721510c-4bf8-4c8b-8803-f287a6d965e1 admin admin] PATH_INFO: `/v3/users` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:36:37.996909 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4721510c-4bf8-4c8b-8803-f287a6d965e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:36:37.998988 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4721510c-4bf8-4c8b-8803-f287a6d965e1 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:36:38.024489 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1224/2471] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 16:36:37 2022] POST /identity/v3/users => generated 288 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:36:38.025765 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6689bfd-3124-4e57-875b-6b09dda22e31 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:36:38.037120 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6689bfd-3124-4e57-875b-6b09dda22e31 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:36:38.041996 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38b2b4d-4d41-4cf1-a54a-410864d1d4ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:36:38.042853 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38b2b4d-4d41-4cf1-a54a-410864d1d4ef admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:36:38.043134 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38b2b4d-4d41-4cf1-a54a-410864d1d4ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:36:38.043407 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38b2b4d-4d41-4cf1-a54a-410864d1d4ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:36:38.044038 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38b2b4d-4d41-4cf1-a54a-410864d1d4ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:36:38.045655 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38b2b4d-4d41-4cf1-a54a-410864d1d4ef admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:36:38.056576 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1248/2472] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:36:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:36:38.061053 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4721510c-4bf8-4c8b-8803-f287a6d965e1 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:36:38.067991 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:36:38.072195 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4721510c-4bf8-4c8b-8803-f287a6d965e1 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:36:38.078696 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cbd7f8-0ba3-4f6a-9a2c-15cc9f720510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:36:38.079348 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cbd7f8-0ba3-4f6a-9a2c-15cc9f720510 admin admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:36:38.079622 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cbd7f8-0ba3-4f6a-9a2c-15cc9f720510 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:36:38.079892 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cbd7f8-0ba3-4f6a-9a2c-15cc9f720510 admin admin] PATH_INFO: `/v3/projects/5d8723b72db14045809363b6648e2222/users/11bef4cdea764de59a2311e608b81b2d/roles/0a36d1be416f4089be19be979943b731` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:36:38.095745 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cbd7f8-0ba3-4f6a-9a2c-15cc9f720510 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d8723b72db14045809363b6648e2222, user_id=11bef4cdea764de59a2311e608b81b2d, role_id=0a36d1be416f4089be19be979943b731)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:36:38.098316 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cbd7f8-0ba3-4f6a-9a2c-15cc9f720510 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:36:38.112294 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1225/2473] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 16:36:38 2022] PUT /identity/v3/projects/5d8723b72db14045809363b6648e2222/users/11bef4cdea764de59a2311e608b81b2d/roles/0a36d1be416f4089be19be979943b731 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:36:38.116466 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38b2b4d-4d41-4cf1-a54a-410864d1d4ef admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:36:38.126987 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38b2b4d-4d41-4cf1-a54a-410864d1d4ef admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:36:38.189619 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff76162-69de-452a-860d-8f2a1f3555b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:36:38.190618 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff76162-69de-452a-860d-8f2a1f3555b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:36:38.190618 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff76162-69de-452a-860d-8f2a1f3555b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:36:38.190857 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff76162-69de-452a-860d-8f2a1f3555b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:36:38.191425 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff76162-69de-452a-860d-8f2a1f3555b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:36:38.193047 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff76162-69de-452a-860d-8f2a1f3555b8 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:36:38.204984 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1249/2474] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:36:38 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:36:38.209093 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cbd7f8-0ba3-4f6a-9a2c-15cc9f720510 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:36:38.221162 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cbd7f8-0ba3-4f6a-9a2c-15cc9f720510 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:36:38.226455 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d65a50a-ec7a-4714-a75f-2bc6f1be0386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:36:38.227194 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d65a50a-ec7a-4714-a75f-2bc6f1be0386 admin admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:36:38.227532 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d65a50a-ec7a-4714-a75f-2bc6f1be0386 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:36:38.227872 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d65a50a-ec7a-4714-a75f-2bc6f1be0386 admin admin] PATH_INFO: `/v3/projects/5d8723b72db14045809363b6648e2222/users/11bef4cdea764de59a2311e608b81b2d/roles/0a36d1be416f4089be19be979943b731` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:36:38.230187 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d65a50a-ec7a-4714-a75f-2bc6f1be0386 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d8723b72db14045809363b6648e2222, user_id=11bef4cdea764de59a2311e608b81b2d, role_id=0a36d1be416f4089be19be979943b731)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:36:38.232953 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d65a50a-ec7a-4714-a75f-2bc6f1be0386 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:36:38.248187 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1226/2475] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 16:36:38 2022] PUT /identity/v3/projects/5d8723b72db14045809363b6648e2222/users/11bef4cdea764de59a2311e608b81b2d/roles/0a36d1be416f4089be19be979943b731 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:36:38.261758 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975d2313-fadd-462a-bf95-db3d1b4fc43f None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:36:38.262492 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975d2313-fadd-462a-bf95-db3d1b4fc43f None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:36:38.262970 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975d2313-fadd-462a-bf95-db3d1b4fc43f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:36:38.297593 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-975d2313-fadd-462a-bf95-db3d1b4fc43f None None] MFA Rules not processed for user `11bef4cdea764de59a2311e608b81b2d`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:36:38.298877 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-975d2313-fadd-462a-bf95-db3d1b4fc43f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:36:38.376150 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1250/2476] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:36:38 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 16:36:38.388044 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d65a50a-ec7a-4714-a75f-2bc6f1be0386 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:36:38.390276 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-0d65a50a-ec7a-4714-a75f-2bc6f1be0386 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:36:38.460114 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d65a50a-ec7a-4714-a75f-2bc6f1be0386 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:36:38.464908 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb141e3-06f5-4755-840b-a3fc0de7d83e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8078e791ba68460f8b3aeafb4b79b73a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:36:38.465653 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb141e3-06f5-4755-840b-a3fc0de7d83e service cinder] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:36:38.466032 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb141e3-06f5-4755-840b-a3fc0de7d83e service cinder] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:36:38.466674 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb141e3-06f5-4755-840b-a3fc0de7d83e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:36:38.476615 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb141e3-06f5-4755-840b-a3fc0de7d83e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:36:38.478387 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb141e3-06f5-4755-840b-a3fc0de7d83e service cinder] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:36:38.489754 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1227/2477] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:36:38 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:36:38.987439 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975d2313-fadd-462a-bf95-db3d1b4fc43f None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:36:39.018573 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:36:39.059314 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975d2313-fadd-462a-bf95-db3d1b4fc43f None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:36:39.064501 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc41822-c46f-4120-ba35-66cdb42e1035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:36:39.065159 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc41822-c46f-4120-ba35-66cdb42e1035 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:36:39.065434 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc41822-c46f-4120-ba35-66cdb42e1035 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:36:39.065729 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc41822-c46f-4120-ba35-66cdb42e1035 admin admin] PATH_INFO: `/v3/users/b50855074f8e4de38e56bdfc9cebf987` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:36:39.066913 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc41822-c46f-4120-ba35-66cdb42e1035 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b50855074f8e4de38e56bdfc9cebf987)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:36:39.068862 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc41822-c46f-4120-ba35-66cdb42e1035 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:36:39.125423 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-3dc41822-c46f-4120-ba35-66cdb42e1035 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b50855074f8e4de38e56bdfc9cebf987'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:36:39.133268 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-3dc41822-c46f-4120-ba35-66cdb42e1035 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b50855074f8e4de38e56bdfc9cebf987'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:36:39.147481 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-3dc41822-c46f-4120-ba35-66cdb42e1035 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b50855074f8e4de38e56bdfc9cebf987'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:36:39.160315 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-3dc41822-c46f-4120-ba35-66cdb42e1035 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b50855074f8e4de38e56bdfc9cebf987'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:36:39.160999 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-3dc41822-c46f-4120-ba35-66cdb42e1035 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b50855074f8e4de38e56bdfc9cebf987'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:36:39.168083 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1251/2478] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 16:36:38 2022] DELETE /identity/v3/users/b50855074f8e4de38e56bdfc9cebf987 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:36:39.173121 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f638979-90a0-4373-90ac-738b6b3a2db4 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:36:39.173670 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f638979-90a0-4373-90ac-738b6b3a2db4 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:36:39.174101 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f638979-90a0-4373-90ac-738b6b3a2db4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:36:39.196660 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-0f638979-90a0-4373-90ac-738b6b3a2db4 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:36:39.198498 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-0f638979-90a0-4373-90ac-738b6b3a2db4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:36:39.272479 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1228/2479] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:36:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:36:39.282813 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc41822-c46f-4120-ba35-66cdb42e1035 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:36:39.284580 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-3dc41822-c46f-4120-ba35-66cdb42e1035 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:36:39.344722 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc41822-c46f-4120-ba35-66cdb42e1035 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:36:39.348601 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0ea521-2736-449f-a96c-0bab48c777c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f44bfdd5214e8d84a2c0a5b1fd9b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:36:39.349255 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0ea521-2736-449f-a96c-0bab48c777c3 service neutron] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:36:39.349542 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0ea521-2736-449f-a96c-0bab48c777c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:36:39.349816 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0ea521-2736-449f-a96c-0bab48c777c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:36:39.359597 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0ea521-2736-449f-a96c-0bab48c777c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:36:39.361042 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0ea521-2736-449f-a96c-0bab48c777c3 service neutron] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:36:39.371298 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1252/2480] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:36:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:36:39.703270 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f638979-90a0-4373-90ac-738b6b3a2db4 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:36:39.704735 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-0f638979-90a0-4373-90ac-738b6b3a2db4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:36:39.718946 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f638979-90a0-4373-90ac-738b6b3a2db4 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:36:39.723365 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fb1f29-3a5c-4ee0-9e58-6b1b2eba191c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:36:39.724010 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fb1f29-3a5c-4ee0-9e58-6b1b2eba191c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:36:39.724294 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fb1f29-3a5c-4ee0-9e58-6b1b2eba191c admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:36:39.724569 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fb1f29-3a5c-4ee0-9e58-6b1b2eba191c admin admin] PATH_INFO: `/v3/projects/35a1715d0e2342d49030f8870f5f580b` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:36:39.726422 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fb1f29-3a5c-4ee0-9e58-6b1b2eba191c admin admin] RBAC: Authorizing `identity:delete_project(project_id=35a1715d0e2342d49030f8870f5f580b)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:36:39.729845 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fb1f29-3a5c-4ee0-9e58-6b1b2eba191c admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:36:39.809038 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-56fb1f29-3a5c-4ee0-9e58-6b1b2eba191c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35a1715d0e2342d49030f8870f5f580b', 'request_id': 'req-56fb1f29-3a5c-4ee0-9e58-6b1b2eba191c'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:36:39.821652 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-56fb1f29-3a5c-4ee0-9e58-6b1b2eba191c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35a1715d0e2342d49030f8870f5f580b', 'request_id': 'req-56fb1f29-3a5c-4ee0-9e58-6b1b2eba191c'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:36:39.831726 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-56fb1f29-3a5c-4ee0-9e58-6b1b2eba191c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35a1715d0e2342d49030f8870f5f580b', 'request_id': 'req-56fb1f29-3a5c-4ee0-9e58-6b1b2eba191c'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:36:39.837431 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:36:39.855460 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-56fb1f29-3a5c-4ee0-9e58-6b1b2eba191c admin admin] The token cache is being invalidate because project 35a1715d0e2342d49030f8870f5f580b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81445) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 16:36:39.855851 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-56fb1f29-3a5c-4ee0-9e58-6b1b2eba191c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:36:39.856454 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-56fb1f29-3a5c-4ee0-9e58-6b1b2eba191c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:36:39.859012 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1229/2481] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 16:36:39 2022] DELETE /identity/v3/projects/35a1715d0e2342d49030f8870f5f580b => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:36:39.863432 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0ea521-2736-449f-a96c-0bab48c777c3 service neutron] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:36:39.875034 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0ea521-2736-449f-a96c-0bab48c777c3 service neutron] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:36:39.932305 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:36:39.953489 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27723e2-2dff-41fe-a41c-e789f6a9ad0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:36:39.954275 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27723e2-2dff-41fe-a41c-e789f6a9ad0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:36:39.954771 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27723e2-2dff-41fe-a41c-e789f6a9ad0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:36:39.955317 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27723e2-2dff-41fe-a41c-e789f6a9ad0f admin admin] PATH_INFO: `/v3/users/11bef4cdea764de59a2311e608b81b2d` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:36:39.956776 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27723e2-2dff-41fe-a41c-e789f6a9ad0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=11bef4cdea764de59a2311e608b81b2d)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:36:39.959061 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27723e2-2dff-41fe-a41c-e789f6a9ad0f admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:36:40.023640 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-e27723e2-2dff-41fe-a41c-e789f6a9ad0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11bef4cdea764de59a2311e608b81b2d'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:36:40.031501 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-e27723e2-2dff-41fe-a41c-e789f6a9ad0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11bef4cdea764de59a2311e608b81b2d'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:36:40.044911 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-e27723e2-2dff-41fe-a41c-e789f6a9ad0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11bef4cdea764de59a2311e608b81b2d'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:36:40.053413 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-e27723e2-2dff-41fe-a41c-e789f6a9ad0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11bef4cdea764de59a2311e608b81b2d'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:36:40.054328 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-e27723e2-2dff-41fe-a41c-e789f6a9ad0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11bef4cdea764de59a2311e608b81b2d'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:36:40.063123 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1253/2482] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 16:36:39 2022] DELETE /identity/v3/users/11bef4cdea764de59a2311e608b81b2d => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 16:36:40.340257 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fb1f29-3a5c-4ee0-9e58-6b1b2eba191c admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:36:40.341783 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-56fb1f29-3a5c-4ee0-9e58-6b1b2eba191c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:36:40.356165 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fb1f29-3a5c-4ee0-9e58-6b1b2eba191c admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:36:40.419173 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47be40fe-fd91-4e58-b5f1-6b0528c3aa65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:36:40.419891 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47be40fe-fd91-4e58-b5f1-6b0528c3aa65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:36:40.420156 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47be40fe-fd91-4e58-b5f1-6b0528c3aa65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:36:40.420420 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47be40fe-fd91-4e58-b5f1-6b0528c3aa65 admin admin] PATH_INFO: `/v3/projects/5d8723b72db14045809363b6648e2222` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:36:40.421549 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47be40fe-fd91-4e58-b5f1-6b0528c3aa65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d8723b72db14045809363b6648e2222)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:36:40.423514 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47be40fe-fd91-4e58-b5f1-6b0528c3aa65 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:36:40.476612 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-47be40fe-fd91-4e58-b5f1-6b0528c3aa65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d8723b72db14045809363b6648e2222', 'request_id': 'req-47be40fe-fd91-4e58-b5f1-6b0528c3aa65'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:36:40.482597 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-47be40fe-fd91-4e58-b5f1-6b0528c3aa65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d8723b72db14045809363b6648e2222', 'request_id': 'req-47be40fe-fd91-4e58-b5f1-6b0528c3aa65'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:36:40.490147 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-47be40fe-fd91-4e58-b5f1-6b0528c3aa65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d8723b72db14045809363b6648e2222', 'request_id': 'req-47be40fe-fd91-4e58-b5f1-6b0528c3aa65'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:36:40.501211 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-47be40fe-fd91-4e58-b5f1-6b0528c3aa65 admin admin] The token cache is being invalidate because project 5d8723b72db14045809363b6648e2222 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81445) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 16:36:40.501489 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-47be40fe-fd91-4e58-b5f1-6b0528c3aa65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:36:40.502114 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-47be40fe-fd91-4e58-b5f1-6b0528c3aa65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:36:40.503633 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1230/2483] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 16:36:40 2022] DELETE /identity/v3/projects/5d8723b72db14045809363b6648e2222 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:36:40.508454 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c99c29-0053-4a91-ab37-22da00692a55 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:36:40.508734 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c99c29-0053-4a91-ab37-22da00692a55 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:36:40.508999 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c99c29-0053-4a91-ab37-22da00692a55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:36:40.528962 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-05c99c29-0053-4a91-ab37-22da00692a55 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:36:40.530171 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-05c99c29-0053-4a91-ab37-22da00692a55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:36:40.591202 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1254/2484] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:36:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 16:36:40.598716 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aab6fe5-e437-4a3e-9376-aa822a739877 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:36:40.599099 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aab6fe5-e437-4a3e-9376-aa822a739877 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:36:40.599446 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aab6fe5-e437-4a3e-9376-aa822a739877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:36:40.620423 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-4aab6fe5-e437-4a3e-9376-aa822a739877 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:36:40.621838 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-4aab6fe5-e437-4a3e-9376-aa822a739877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:36:40.631646 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1231/2485] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:36:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:36:40.636587 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c99c29-0053-4a91-ab37-22da00692a55 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:36:40.646610 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c99c29-0053-4a91-ab37-22da00692a55 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:36:40.651320 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2c3072-a4f4-433e-8624-232933cfc9e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:36:40.651915 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2c3072-a4f4-433e-8624-232933cfc9e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:36:40.652190 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2c3072-a4f4-433e-8624-232933cfc9e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:36:40.652451 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2c3072-a4f4-433e-8624-232933cfc9e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:36:40.653076 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2c3072-a4f4-433e-8624-232933cfc9e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:36:40.653486 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2c3072-a4f4-433e-8624-232933cfc9e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:36:40.655151 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2c3072-a4f4-433e-8624-232933cfc9e3 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:36:40.670733 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1255/2486] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Sep 9 16:36:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:36:40.671877 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aab6fe5-e437-4a3e-9376-aa822a739877 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:36:40.681409 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aab6fe5-e437-4a3e-9376-aa822a739877 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:36:40.687016 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64302a7-3e47-4126-9512-428f6fc785a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:36:40.687657 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64302a7-3e47-4126-9512-428f6fc785a8 admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:36:40.687931 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64302a7-3e47-4126-9512-428f6fc785a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:36:40.688841 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64302a7-3e47-4126-9512-428f6fc785a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:36:40.689489 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64302a7-3e47-4126-9512-428f6fc785a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:36:40.691419 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64302a7-3e47-4126-9512-428f6fc785a8 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:36:40.718755 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1232/2487] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 16:36:40 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:36:40.722771 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2c3072-a4f4-433e-8624-232933cfc9e3 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:36:40.733283 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2c3072-a4f4-433e-8624-232933cfc9e3 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:36:40.787684 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:36:40.801393 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c54fc6d-c444-4f48-8bc8-6fd64db20dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:36:40.801991 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c54fc6d-c444-4f48-8bc8-6fd64db20dc3 admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:36:40.802265 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c54fc6d-c444-4f48-8bc8-6fd64db20dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:36:40.802561 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c54fc6d-c444-4f48-8bc8-6fd64db20dc3 admin admin] PATH_INFO: `/v3/users` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:36:40.803192 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c54fc6d-c444-4f48-8bc8-6fd64db20dc3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:36:40.805093 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c54fc6d-c444-4f48-8bc8-6fd64db20dc3 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:36:40.833252 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1256/2488] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 16:36:40 2022] POST /identity/v3/users => generated 293 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 16:36:40.834102 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64302a7-3e47-4126-9512-428f6fc785a8 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:36:40.845293 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64302a7-3e47-4126-9512-428f6fc785a8 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:36:40.850062 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f6159a-b03a-40c8-a5ac-f2729664f973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:36:40.850799 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f6159a-b03a-40c8-a5ac-f2729664f973 admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:36:40.851138 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f6159a-b03a-40c8-a5ac-f2729664f973 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:36:40.851471 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f6159a-b03a-40c8-a5ac-f2729664f973 admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:36:40.852208 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f6159a-b03a-40c8-a5ac-f2729664f973 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:36:40.854436 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f6159a-b03a-40c8-a5ac-f2729664f973 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:36:40.864550 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1233/2489] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:36:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:36:40.868609 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c54fc6d-c444-4f48-8bc8-6fd64db20dc3 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:36:40.879319 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c54fc6d-c444-4f48-8bc8-6fd64db20dc3 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:36:40.883873 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e059184-7a4a-456d-831c-c5e9d929e055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:36:40.884473 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e059184-7a4a-456d-831c-c5e9d929e055 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:36:40.884744 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e059184-7a4a-456d-831c-c5e9d929e055 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:36:40.885010 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e059184-7a4a-456d-831c-c5e9d929e055 admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:36:40.885668 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e059184-7a4a-456d-831c-c5e9d929e055 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:36:40.887405 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e059184-7a4a-456d-831c-c5e9d929e055 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:36:40.898848 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1257/2490] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:36:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:36:40.903055 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f6159a-b03a-40c8-a5ac-f2729664f973 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:36:40.913713 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f6159a-b03a-40c8-a5ac-f2729664f973 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:36:40.919277 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc17e86-a554-4bba-b048-97fcebeb9b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:36:40.919927 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc17e86-a554-4bba-b048-97fcebeb9b85 admin admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:36:40.920319 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc17e86-a554-4bba-b048-97fcebeb9b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:36:40.920599 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc17e86-a554-4bba-b048-97fcebeb9b85 admin admin] PATH_INFO: `/v3/projects/01ec71804e8849a7a00d51f34dd324f9/users/03c4b355762e4c5885638060da0a56e6/roles/b38e84bf077846ee802e6bb1bad83522` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:36:40.935744 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc17e86-a554-4bba-b048-97fcebeb9b85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01ec71804e8849a7a00d51f34dd324f9, user_id=03c4b355762e4c5885638060da0a56e6, role_id=b38e84bf077846ee802e6bb1bad83522)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:36:40.938422 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc17e86-a554-4bba-b048-97fcebeb9b85 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:36:40.951797 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1234/2491] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 16:36:40 2022] PUT /identity/v3/projects/01ec71804e8849a7a00d51f34dd324f9/users/03c4b355762e4c5885638060da0a56e6/roles/b38e84bf077846ee802e6bb1bad83522 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:36:40.962155 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b299594-56da-48ec-a597-8bf369495b9e None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:36:40.962485 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b299594-56da-48ec-a597-8bf369495b9e None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:36:40.962738 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b299594-56da-48ec-a597-8bf369495b9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:36:40.991408 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-0b299594-56da-48ec-a597-8bf369495b9e None None] MFA Rules not processed for user `03c4b355762e4c5885638060da0a56e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:36:40.992544 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-0b299594-56da-48ec-a597-8bf369495b9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:36:41.058132 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1258/2492] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:36:40 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:36:41.062276 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc17e86-a554-4bba-b048-97fcebeb9b85 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:36:41.083511 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:DELETE=8,keystone:SELECT=89,keystone:INSERT=3 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:36:41.127497 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc17e86-a554-4bba-b048-97fcebeb9b85 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:36:41.132134 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef9b42d-e7d6-48e6-a8c2-0c110d26a641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:36:41.132727 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef9b42d-e7d6-48e6-a8c2-0c110d26a641 admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:36:41.132998 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef9b42d-e7d6-48e6-a8c2-0c110d26a641 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:36:41.133262 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef9b42d-e7d6-48e6-a8c2-0c110d26a641 admin admin] PATH_INFO: `/v3/projects` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:36:41.133886 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef9b42d-e7d6-48e6-a8c2-0c110d26a641 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:36:41.136351 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef9b42d-e7d6-48e6-a8c2-0c110d26a641 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:36:41.165404 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1235/2493] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 16:36:41 2022] POST /identity/v3/projects => generated 385 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:36:41.170052 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b299594-56da-48ec-a597-8bf369495b9e None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:36:41.181347 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b299594-56da-48ec-a597-8bf369495b9e None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:36:41.242241 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f8241c-2869-4ef3-895b-0755db60b766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:36:41.242937 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f8241c-2869-4ef3-895b-0755db60b766 admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:36:41.243218 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f8241c-2869-4ef3-895b-0755db60b766 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:36:41.243490 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f8241c-2869-4ef3-895b-0755db60b766 admin admin] PATH_INFO: `/v3/users` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:36:41.244139 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f8241c-2869-4ef3-895b-0755db60b766 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:36:41.246667 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f8241c-2869-4ef3-895b-0755db60b766 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:36:41.273156 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1259/2494] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 16:36:41 2022] POST /identity/v3/users => generated 299 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 16:36:41.274567 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef9b42d-e7d6-48e6-a8c2-0c110d26a641 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:36:41.286440 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef9b42d-e7d6-48e6-a8c2-0c110d26a641 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:36:41.291769 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b30ad6-7d19-4f37-8f8d-c064e76826ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:36:41.292474 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b30ad6-7d19-4f37-8f8d-c064e76826ef admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:36:41.292849 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b30ad6-7d19-4f37-8f8d-c064e76826ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:36:41.293196 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b30ad6-7d19-4f37-8f8d-c064e76826ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:36:41.293874 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b30ad6-7d19-4f37-8f8d-c064e76826ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:36:41.295546 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b30ad6-7d19-4f37-8f8d-c064e76826ef admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:36:41.308104 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1236/2495] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:36:41 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:36:41.312057 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f8241c-2869-4ef3-895b-0755db60b766 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:36:41.323410 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f8241c-2869-4ef3-895b-0755db60b766 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:36:41.328252 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1ca063-080e-4307-ba55-8da5fb00c680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:36:41.328926 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1ca063-080e-4307-ba55-8da5fb00c680 admin admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:36:41.329206 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1ca063-080e-4307-ba55-8da5fb00c680 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:36:41.329478 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1ca063-080e-4307-ba55-8da5fb00c680 admin admin] PATH_INFO: `/v3/projects/aa75140cf8874bfc8c665721ce56e888/users/25ea797519cc43b8a7cc09c3a67a8b4d/roles/0a36d1be416f4089be19be979943b731` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:36:41.345433 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1ca063-080e-4307-ba55-8da5fb00c680 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa75140cf8874bfc8c665721ce56e888, user_id=25ea797519cc43b8a7cc09c3a67a8b4d, role_id=0a36d1be416f4089be19be979943b731)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:36:41.348141 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1ca063-080e-4307-ba55-8da5fb00c680 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:36:41.361775 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1260/2496] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 16:36:41 2022] PUT /identity/v3/projects/aa75140cf8874bfc8c665721ce56e888/users/25ea797519cc43b8a7cc09c3a67a8b4d/roles/0a36d1be416f4089be19be979943b731 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:36:41.365985 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b30ad6-7d19-4f37-8f8d-c064e76826ef admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:36:41.377546 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b30ad6-7d19-4f37-8f8d-c064e76826ef admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:36:41.450954 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11167e6b-fa29-469c-987b-5756e0337646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:36:41.451776 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11167e6b-fa29-469c-987b-5756e0337646 admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:36:41.452154 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11167e6b-fa29-469c-987b-5756e0337646 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:36:41.452686 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11167e6b-fa29-469c-987b-5756e0337646 admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:36:41.453439 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11167e6b-fa29-469c-987b-5756e0337646 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:36:41.456574 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11167e6b-fa29-469c-987b-5756e0337646 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:36:41.471582 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1237/2497] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:36:41 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:36:41.472673 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1ca063-080e-4307-ba55-8da5fb00c680 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:36:41.486975 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1ca063-080e-4307-ba55-8da5fb00c680 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:36:41.497350 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671937c5-bdcd-4b52-aac1-a484131e780e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:36:41.498099 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671937c5-bdcd-4b52-aac1-a484131e780e admin admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:36:41.498631 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671937c5-bdcd-4b52-aac1-a484131e780e admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:36:41.498833 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671937c5-bdcd-4b52-aac1-a484131e780e admin admin] PATH_INFO: `/v3/projects/aa75140cf8874bfc8c665721ce56e888/users/25ea797519cc43b8a7cc09c3a67a8b4d/roles/0a36d1be416f4089be19be979943b731` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:36:41.502347 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671937c5-bdcd-4b52-aac1-a484131e780e admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa75140cf8874bfc8c665721ce56e888, user_id=25ea797519cc43b8a7cc09c3a67a8b4d, role_id=0a36d1be416f4089be19be979943b731)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:36:41.505880 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671937c5-bdcd-4b52-aac1-a484131e780e admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:36:41.519522 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1261/2498] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 16:36:41 2022] PUT /identity/v3/projects/aa75140cf8874bfc8c665721ce56e888/users/25ea797519cc43b8a7cc09c3a67a8b4d/roles/0a36d1be416f4089be19be979943b731 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:36:41.532010 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3d7636-5ba1-45fc-bce5-e46bdcbffc89 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:36:41.532711 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3d7636-5ba1-45fc-bce5-e46bdcbffc89 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:36:41.533231 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3d7636-5ba1-45fc-bce5-e46bdcbffc89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:36:41.573272 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-bd3d7636-5ba1-45fc-bce5-e46bdcbffc89 None None] MFA Rules not processed for user `25ea797519cc43b8a7cc09c3a67a8b4d`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:36:41.574706 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-bd3d7636-5ba1-45fc-bce5-e46bdcbffc89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:36:41.662349 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1238/2499] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:36:41 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 16:36:41.674018 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671937c5-bdcd-4b52-aac1-a484131e780e admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:36:41.675758 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-671937c5-bdcd-4b52-aac1-a484131e780e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:36:41.695991 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:36:41.795743 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671937c5-bdcd-4b52-aac1-a484131e780e admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:36:41.807535 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38c7a3c-31fa-4442-9fa3-66b931892b71 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8078e791ba68460f8b3aeafb4b79b73a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:36:41.808165 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38c7a3c-31fa-4442-9fa3-66b931892b71 service cinder] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:36:41.808446 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38c7a3c-31fa-4442-9fa3-66b931892b71 service cinder] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:36:41.808720 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38c7a3c-31fa-4442-9fa3-66b931892b71 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:36:41.823899 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38c7a3c-31fa-4442-9fa3-66b931892b71 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:36:41.825382 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38c7a3c-31fa-4442-9fa3-66b931892b71 service cinder] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:36:41.835719 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1262/2500] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:36:41 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:36:41.922643 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3d7636-5ba1-45fc-bce5-e46bdcbffc89 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:36:41.952791 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:36:42.021586 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3d7636-5ba1-45fc-bce5-e46bdcbffc89 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:36:42.026884 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40331d30-3a09-4204-9351-1da6f6cc52e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:36:42.027573 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40331d30-3a09-4204-9351-1da6f6cc52e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:36:42.028009 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40331d30-3a09-4204-9351-1da6f6cc52e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:36:42.028285 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40331d30-3a09-4204-9351-1da6f6cc52e4 admin admin] PATH_INFO: `/v3/users/03c4b355762e4c5885638060da0a56e6` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:36:42.029488 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40331d30-3a09-4204-9351-1da6f6cc52e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=03c4b355762e4c5885638060da0a56e6)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:36:42.031455 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40331d30-3a09-4204-9351-1da6f6cc52e4 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:36:42.085894 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-40331d30-3a09-4204-9351-1da6f6cc52e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03c4b355762e4c5885638060da0a56e6'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:36:42.094287 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-40331d30-3a09-4204-9351-1da6f6cc52e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03c4b355762e4c5885638060da0a56e6'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:36:42.095121 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-40331d30-3a09-4204-9351-1da6f6cc52e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03c4b355762e4c5885638060da0a56e6'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:36:42.102656 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-40331d30-3a09-4204-9351-1da6f6cc52e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03c4b355762e4c5885638060da0a56e6'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:36:42.114509 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-40331d30-3a09-4204-9351-1da6f6cc52e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03c4b355762e4c5885638060da0a56e6'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:36:42.121011 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1239/2501] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 16:36:41 2022] DELETE /identity/v3/users/03c4b355762e4c5885638060da0a56e6 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:36:42.125829 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba009f2-b080-4ca5-a718-480d88e8b258 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:36:42.126116 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba009f2-b080-4ca5-a718-480d88e8b258 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:36:42.126425 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba009f2-b080-4ca5-a718-480d88e8b258 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:36:42.147901 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-5ba009f2-b080-4ca5-a718-480d88e8b258 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:36:42.149305 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-5ba009f2-b080-4ca5-a718-480d88e8b258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:36:42.215762 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1263/2502] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:36:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:36:42.225551 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40331d30-3a09-4204-9351-1da6f6cc52e4 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:36:42.227436 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-40331d30-3a09-4204-9351-1da6f6cc52e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:36:42.296324 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40331d30-3a09-4204-9351-1da6f6cc52e4 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:36:42.300782 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accbce3b-4089-4bd6-b09d-ecdeced39e55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f44bfdd5214e8d84a2c0a5b1fd9b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:36:42.301547 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accbce3b-4089-4bd6-b09d-ecdeced39e55 service neutron] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:36:42.301929 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accbce3b-4089-4bd6-b09d-ecdeced39e55 service neutron] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:36:42.302359 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accbce3b-4089-4bd6-b09d-ecdeced39e55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:36:42.315044 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accbce3b-4089-4bd6-b09d-ecdeced39e55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:36:42.318237 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accbce3b-4089-4bd6-b09d-ecdeced39e55 service neutron] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:36:42.340710 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1240/2503] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:36:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:36:42.657427 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba009f2-b080-4ca5-a718-480d88e8b258 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:36:42.658974 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-5ba009f2-b080-4ca5-a718-480d88e8b258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:36:42.674843 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba009f2-b080-4ca5-a718-480d88e8b258 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:36:42.680737 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3ce265-aa58-486e-acd7-128aca386ddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:36:42.681559 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3ce265-aa58-486e-acd7-128aca386ddc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:36:42.682754 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3ce265-aa58-486e-acd7-128aca386ddc admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:36:42.683069 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3ce265-aa58-486e-acd7-128aca386ddc admin admin] PATH_INFO: `/v3/projects/01ec71804e8849a7a00d51f34dd324f9` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:36:42.684201 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3ce265-aa58-486e-acd7-128aca386ddc admin admin] RBAC: Authorizing `identity:delete_project(project_id=01ec71804e8849a7a00d51f34dd324f9)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:36:42.686221 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3ce265-aa58-486e-acd7-128aca386ddc admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:36:42.733325 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-fb3ce265-aa58-486e-acd7-128aca386ddc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01ec71804e8849a7a00d51f34dd324f9', 'request_id': 'req-fb3ce265-aa58-486e-acd7-128aca386ddc'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:36:42.738758 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-fb3ce265-aa58-486e-acd7-128aca386ddc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01ec71804e8849a7a00d51f34dd324f9', 'request_id': 'req-fb3ce265-aa58-486e-acd7-128aca386ddc'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:36:42.745645 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-fb3ce265-aa58-486e-acd7-128aca386ddc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01ec71804e8849a7a00d51f34dd324f9', 'request_id': 'req-fb3ce265-aa58-486e-acd7-128aca386ddc'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:36:42.756439 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-fb3ce265-aa58-486e-acd7-128aca386ddc admin admin] The token cache is being invalidate because project 01ec71804e8849a7a00d51f34dd324f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81446) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 16:36:42.756726 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-fb3ce265-aa58-486e-acd7-128aca386ddc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:36:42.757335 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-fb3ce265-aa58-486e-acd7-128aca386ddc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:36:42.758815 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1264/2504] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 16:36:42 2022] DELETE /identity/v3/projects/01ec71804e8849a7a00d51f34dd324f9 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 16:36:42.762739 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accbce3b-4089-4bd6-b09d-ecdeced39e55 service neutron] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:36:42.772249 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accbce3b-4089-4bd6-b09d-ecdeced39e55 service neutron] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:36:42.805143 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:36:42.831541 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16603436-135c-44eb-b134-85f06f4541e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:36:42.832171 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16603436-135c-44eb-b134-85f06f4541e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:36:42.832448 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16603436-135c-44eb-b134-85f06f4541e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:36:42.832712 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16603436-135c-44eb-b134-85f06f4541e4 admin admin] PATH_INFO: `/v3/users/25ea797519cc43b8a7cc09c3a67a8b4d` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:36:42.833868 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16603436-135c-44eb-b134-85f06f4541e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=25ea797519cc43b8a7cc09c3a67a8b4d)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:36:42.836539 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16603436-135c-44eb-b134-85f06f4541e4 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:36:42.885986 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-16603436-135c-44eb-b134-85f06f4541e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25ea797519cc43b8a7cc09c3a67a8b4d'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:36:42.893623 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-16603436-135c-44eb-b134-85f06f4541e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25ea797519cc43b8a7cc09c3a67a8b4d'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:36:42.894247 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-16603436-135c-44eb-b134-85f06f4541e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25ea797519cc43b8a7cc09c3a67a8b4d'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:36:42.905406 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-16603436-135c-44eb-b134-85f06f4541e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25ea797519cc43b8a7cc09c3a67a8b4d'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:36:42.918824 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-16603436-135c-44eb-b134-85f06f4541e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25ea797519cc43b8a7cc09c3a67a8b4d'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:36:42.925987 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1241/2505] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 16:36:42 2022] DELETE /identity/v3/users/25ea797519cc43b8a7cc09c3a67a8b4d => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:36:43.224913 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3ce265-aa58-486e-acd7-128aca386ddc admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:36:43.226653 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-fb3ce265-aa58-486e-acd7-128aca386ddc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:36:43.240406 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3ce265-aa58-486e-acd7-128aca386ddc admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:36:43.274131 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:36:43.300608 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348b7bf0-6c6c-4b27-8bd3-18e6acdb5e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:36:43.301270 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348b7bf0-6c6c-4b27-8bd3-18e6acdb5e86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:36:43.301547 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348b7bf0-6c6c-4b27-8bd3-18e6acdb5e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:36:43.301814 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348b7bf0-6c6c-4b27-8bd3-18e6acdb5e86 admin admin] PATH_INFO: `/v3/projects/aa75140cf8874bfc8c665721ce56e888` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:36:43.302933 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348b7bf0-6c6c-4b27-8bd3-18e6acdb5e86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa75140cf8874bfc8c665721ce56e888)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:36:43.304871 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348b7bf0-6c6c-4b27-8bd3-18e6acdb5e86 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:36:43.350791 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-348b7bf0-6c6c-4b27-8bd3-18e6acdb5e86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa75140cf8874bfc8c665721ce56e888', 'request_id': 'req-348b7bf0-6c6c-4b27-8bd3-18e6acdb5e86'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:36:43.356163 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-348b7bf0-6c6c-4b27-8bd3-18e6acdb5e86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa75140cf8874bfc8c665721ce56e888', 'request_id': 'req-348b7bf0-6c6c-4b27-8bd3-18e6acdb5e86'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:36:43.362994 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-348b7bf0-6c6c-4b27-8bd3-18e6acdb5e86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa75140cf8874bfc8c665721ce56e888', 'request_id': 'req-348b7bf0-6c6c-4b27-8bd3-18e6acdb5e86'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:36:43.373684 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-348b7bf0-6c6c-4b27-8bd3-18e6acdb5e86 admin admin] The token cache is being invalidate because project aa75140cf8874bfc8c665721ce56e888 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81446) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 16:36:43.373973 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-348b7bf0-6c6c-4b27-8bd3-18e6acdb5e86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:36:43.374606 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-348b7bf0-6c6c-4b27-8bd3-18e6acdb5e86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:36:43.376054 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1265/2506] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 16:36:43 2022] DELETE /identity/v3/projects/aa75140cf8874bfc8c665721ce56e888 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:36:43.381105 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f22aad-4943-4414-9e6f-0687faee0a0e None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:36:43.381400 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f22aad-4943-4414-9e6f-0687faee0a0e None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:36:43.381674 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f22aad-4943-4414-9e6f-0687faee0a0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:36:43.402191 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-f1f22aad-4943-4414-9e6f-0687faee0a0e None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:36:43.403996 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-f1f22aad-4943-4414-9e6f-0687faee0a0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:36:43.465269 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1242/2507] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:36:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:36:43.473944 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086328c3-fac6-4d60-b648-f0244daace9d None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:36:43.474259 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086328c3-fac6-4d60-b648-f0244daace9d None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:36:43.474563 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086328c3-fac6-4d60-b648-f0244daace9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:36:43.493793 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-086328c3-fac6-4d60-b648-f0244daace9d None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:36:43.495553 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-086328c3-fac6-4d60-b648-f0244daace9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:36:43.503391 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1266/2508] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:36:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:36:43.507725 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f22aad-4943-4414-9e6f-0687faee0a0e None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:36:43.517899 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f22aad-4943-4414-9e6f-0687faee0a0e None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:36:43.522506 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb11a66-d83e-43ec-ab4e-3b4a4a59417f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:36:43.523101 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb11a66-d83e-43ec-ab4e-3b4a4a59417f admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:36:43.523382 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb11a66-d83e-43ec-ab4e-3b4a4a59417f admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:36:43.523656 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb11a66-d83e-43ec-ab4e-3b4a4a59417f admin admin] PATH_INFO: `/v3/domains` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:36:43.524292 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb11a66-d83e-43ec-ab4e-3b4a4a59417f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:36:43.524592 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb11a66-d83e-43ec-ab4e-3b4a4a59417f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:36:43.526195 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb11a66-d83e-43ec-ab4e-3b4a4a59417f admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:36:43.537569 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1243/2509] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Sep 9 16:36:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:36:43.541622 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086328c3-fac6-4d60-b648-f0244daace9d None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:36:43.550660 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086328c3-fac6-4d60-b648-f0244daace9d None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:36:43.555248 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ab7f9a-85e7-4473-b777-3b1530189e6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:36:43.555824 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ab7f9a-85e7-4473-b777-3b1530189e6b admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:36:43.556095 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ab7f9a-85e7-4473-b777-3b1530189e6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:36:43.556360 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ab7f9a-85e7-4473-b777-3b1530189e6b admin admin] PATH_INFO: `/v3/projects` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:36:43.557455 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ab7f9a-85e7-4473-b777-3b1530189e6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:36:43.559382 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ab7f9a-85e7-4473-b777-3b1530189e6b admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:36:43.586732 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1267/2510] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 16:36:43 2022] POST /identity/v3/projects => generated 381 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:36:43.590752 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb11a66-d83e-43ec-ab4e-3b4a4a59417f admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:36:43.600730 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb11a66-d83e-43ec-ab4e-3b4a4a59417f admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:36:43.641079 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:36:43.657458 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6808c92-661a-4cae-af1b-88f7908a563c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:36:43.658089 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6808c92-661a-4cae-af1b-88f7908a563c admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:36:43.658411 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6808c92-661a-4cae-af1b-88f7908a563c admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:36:43.658686 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6808c92-661a-4cae-af1b-88f7908a563c admin admin] PATH_INFO: `/v3/users` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:36:43.659311 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6808c92-661a-4cae-af1b-88f7908a563c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:36:43.661244 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6808c92-661a-4cae-af1b-88f7908a563c admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:36:43.681771 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1244/2511] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 16:36:43 2022] POST /identity/v3/users => generated 291 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:36:43.686506 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ab7f9a-85e7-4473-b777-3b1530189e6b admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:36:43.696793 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ab7f9a-85e7-4473-b777-3b1530189e6b admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:36:43.701871 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23d4fa9-4702-4f92-bac8-763e233874d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:36:43.702497 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23d4fa9-4702-4f92-bac8-763e233874d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:36:43.702772 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23d4fa9-4702-4f92-bac8-763e233874d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:36:43.703037 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23d4fa9-4702-4f92-bac8-763e233874d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:36:43.703658 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23d4fa9-4702-4f92-bac8-763e233874d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:36:43.705241 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23d4fa9-4702-4f92-bac8-763e233874d9 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:36:43.715389 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1268/2512] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:36:43 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:36:43.719200 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6808c92-661a-4cae-af1b-88f7908a563c admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:36:43.728954 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6808c92-661a-4cae-af1b-88f7908a563c admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:36:43.733532 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e742d0a0-96a2-4b20-8dea-560b87335236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:36:43.734111 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e742d0a0-96a2-4b20-8dea-560b87335236 admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:36:43.734411 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e742d0a0-96a2-4b20-8dea-560b87335236 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:36:43.734681 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e742d0a0-96a2-4b20-8dea-560b87335236 admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:36:43.735304 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e742d0a0-96a2-4b20-8dea-560b87335236 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:36:43.736893 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e742d0a0-96a2-4b20-8dea-560b87335236 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:36:43.747808 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1245/2513] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:36:43 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:36:43.751600 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23d4fa9-4702-4f92-bac8-763e233874d9 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:36:43.763723 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23d4fa9-4702-4f92-bac8-763e233874d9 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:36:43.768316 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2b888f-d03c-4255-878c-6951eb5e63af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:36:43.768939 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2b888f-d03c-4255-878c-6951eb5e63af admin admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:36:43.769214 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2b888f-d03c-4255-878c-6951eb5e63af admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:36:43.769481 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2b888f-d03c-4255-878c-6951eb5e63af admin admin] PATH_INFO: `/v3/projects/15696dcd53a04d6c903769a79fc70d09/users/8087df56190a48ebb0692a93c2cfb991/roles/b38e84bf077846ee802e6bb1bad83522` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:36:43.783659 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2b888f-d03c-4255-878c-6951eb5e63af admin admin] RBAC: Authorizing `identity:create_grant(project_id=15696dcd53a04d6c903769a79fc70d09, user_id=8087df56190a48ebb0692a93c2cfb991, role_id=b38e84bf077846ee802e6bb1bad83522)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:36:43.786284 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2b888f-d03c-4255-878c-6951eb5e63af admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:36:43.798554 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1269/2514] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 16:36:43 2022] PUT /identity/v3/projects/15696dcd53a04d6c903769a79fc70d09/users/8087df56190a48ebb0692a93c2cfb991/roles/b38e84bf077846ee802e6bb1bad83522 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:36:43.810123 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f6f3e4-de55-4eca-ba35-97359731e5e5 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:36:43.810639 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f6f3e4-de55-4eca-ba35-97359731e5e5 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:36:43.810737 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f6f3e4-de55-4eca-ba35-97359731e5e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:36:43.839873 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-93f6f3e4-de55-4eca-ba35-97359731e5e5 None None] MFA Rules not processed for user `8087df56190a48ebb0692a93c2cfb991`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:36:43.841089 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-93f6f3e4-de55-4eca-ba35-97359731e5e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:36:43.902861 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1246/2515] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:36:43 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 16:36:43.907225 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2b888f-d03c-4255-878c-6951eb5e63af admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:36:43.968354 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2b888f-d03c-4255-878c-6951eb5e63af admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:36:43.972993 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7439740-fe39-45af-ae31-b8b3319ba6c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:36:43.973586 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7439740-fe39-45af-ae31-b8b3319ba6c7 admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:36:43.973873 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7439740-fe39-45af-ae31-b8b3319ba6c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:36:43.974146 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7439740-fe39-45af-ae31-b8b3319ba6c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:36:43.974794 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7439740-fe39-45af-ae31-b8b3319ba6c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:36:43.976774 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7439740-fe39-45af-ae31-b8b3319ba6c7 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:36:43.986494 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:36:44.006746 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1270/2516] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 16:36:43 2022] POST /identity/v3/projects => generated 383 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:36:44.010963 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f6f3e4-de55-4eca-ba35-97359731e5e5 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:36:44.021716 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f6f3e4-de55-4eca-ba35-97359731e5e5 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:36:44.076527 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d6871a-9ce3-40ed-ba52-bbc03f36b31d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:36:44.077115 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d6871a-9ce3-40ed-ba52-bbc03f36b31d admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:36:44.077386 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d6871a-9ce3-40ed-ba52-bbc03f36b31d admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:36:44.077651 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d6871a-9ce3-40ed-ba52-bbc03f36b31d admin admin] PATH_INFO: `/v3/users` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:36:44.078259 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d6871a-9ce3-40ed-ba52-bbc03f36b31d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:36:44.080172 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d6871a-9ce3-40ed-ba52-bbc03f36b31d admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:36:44.100848 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1247/2517] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 16:36:44 2022] POST /identity/v3/users => generated 298 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:36:44.105432 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7439740-fe39-45af-ae31-b8b3319ba6c7 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:36:44.115571 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7439740-fe39-45af-ae31-b8b3319ba6c7 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:36:44.120762 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365606c7-69e1-4a20-828f-8d3bd0fbd108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:36:44.121353 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365606c7-69e1-4a20-828f-8d3bd0fbd108 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:36:44.121622 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365606c7-69e1-4a20-828f-8d3bd0fbd108 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:36:44.121884 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365606c7-69e1-4a20-828f-8d3bd0fbd108 admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:36:44.122540 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365606c7-69e1-4a20-828f-8d3bd0fbd108 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:36:44.124109 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365606c7-69e1-4a20-828f-8d3bd0fbd108 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:36:44.137463 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1271/2518] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:36:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 16:36:44.138637 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d6871a-9ce3-40ed-ba52-bbc03f36b31d admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:36:44.148481 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d6871a-9ce3-40ed-ba52-bbc03f36b31d admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:36:44.153108 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9938704-8ba0-495e-b1b4-096b5ce3ba45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:36:44.153686 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9938704-8ba0-495e-b1b4-096b5ce3ba45 admin admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:36:44.153959 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9938704-8ba0-495e-b1b4-096b5ce3ba45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:36:44.154226 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9938704-8ba0-495e-b1b4-096b5ce3ba45 admin admin] PATH_INFO: `/v3/projects/eccf240b0d6442469740610d4edb3696/users/c1ed4bda0e5d4fefbee6090a41ff3cf8/roles/0a36d1be416f4089be19be979943b731` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:36:44.170040 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9938704-8ba0-495e-b1b4-096b5ce3ba45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eccf240b0d6442469740610d4edb3696, user_id=c1ed4bda0e5d4fefbee6090a41ff3cf8, role_id=0a36d1be416f4089be19be979943b731)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:36:44.172763 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9938704-8ba0-495e-b1b4-096b5ce3ba45 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:36:44.187599 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1248/2519] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 16:36:44 2022] PUT /identity/v3/projects/eccf240b0d6442469740610d4edb3696/users/c1ed4bda0e5d4fefbee6090a41ff3cf8/roles/0a36d1be416f4089be19be979943b731 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:36:44.191584 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365606c7-69e1-4a20-828f-8d3bd0fbd108 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:36:44.202846 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365606c7-69e1-4a20-828f-8d3bd0fbd108 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:36:44.285301 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95b7baa-2b15-43e9-ba0d-ee4d8644de25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:36:44.285924 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95b7baa-2b15-43e9-ba0d-ee4d8644de25 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:36:44.286213 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95b7baa-2b15-43e9-ba0d-ee4d8644de25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:36:44.287740 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95b7baa-2b15-43e9-ba0d-ee4d8644de25 admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:36:44.288493 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95b7baa-2b15-43e9-ba0d-ee4d8644de25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:36:44.290427 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95b7baa-2b15-43e9-ba0d-ee4d8644de25 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:36:44.304274 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1272/2520] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:36:44 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:36:44.307784 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9938704-8ba0-495e-b1b4-096b5ce3ba45 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:36:44.318446 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9938704-8ba0-495e-b1b4-096b5ce3ba45 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:36:44.323399 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a62d91c-fb1d-4baa-b032-b8e3803fb442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:36:44.324053 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a62d91c-fb1d-4baa-b032-b8e3803fb442 admin admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:36:44.324328 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a62d91c-fb1d-4baa-b032-b8e3803fb442 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:36:44.324596 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a62d91c-fb1d-4baa-b032-b8e3803fb442 admin admin] PATH_INFO: `/v3/projects/eccf240b0d6442469740610d4edb3696/users/c1ed4bda0e5d4fefbee6090a41ff3cf8/roles/0a36d1be416f4089be19be979943b731` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:36:44.326517 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a62d91c-fb1d-4baa-b032-b8e3803fb442 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eccf240b0d6442469740610d4edb3696, user_id=c1ed4bda0e5d4fefbee6090a41ff3cf8, role_id=0a36d1be416f4089be19be979943b731)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:36:44.329132 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a62d91c-fb1d-4baa-b032-b8e3803fb442 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:36:44.340316 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1249/2521] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 16:36:44 2022] PUT /identity/v3/projects/eccf240b0d6442469740610d4edb3696/users/c1ed4bda0e5d4fefbee6090a41ff3cf8/roles/0a36d1be416f4089be19be979943b731 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:36:44.350270 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04db6ef9-789b-4ff1-8ba5-98f130ed907b None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:36:44.350664 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04db6ef9-789b-4ff1-8ba5-98f130ed907b None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:36:44.351027 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04db6ef9-789b-4ff1-8ba5-98f130ed907b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:36:44.381024 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-04db6ef9-789b-4ff1-8ba5-98f130ed907b None None] MFA Rules not processed for user `c1ed4bda0e5d4fefbee6090a41ff3cf8`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:36:44.382280 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-04db6ef9-789b-4ff1-8ba5-98f130ed907b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:36:44.461418 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1273/2522] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:36:44 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 16:36:44.473655 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a62d91c-fb1d-4baa-b032-b8e3803fb442 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:36:44.475496 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-6a62d91c-fb1d-4baa-b032-b8e3803fb442 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:36:44.483853 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:36:44.535896 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a62d91c-fb1d-4baa-b032-b8e3803fb442 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:36:44.539516 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583dc2be-ae36-42df-80fc-b5dd5c8f078f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8078e791ba68460f8b3aeafb4b79b73a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:36:44.540112 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583dc2be-ae36-42df-80fc-b5dd5c8f078f service cinder] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:36:44.540392 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583dc2be-ae36-42df-80fc-b5dd5c8f078f service cinder] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:36:44.540665 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583dc2be-ae36-42df-80fc-b5dd5c8f078f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:36:44.550196 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583dc2be-ae36-42df-80fc-b5dd5c8f078f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:36:44.551752 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583dc2be-ae36-42df-80fc-b5dd5c8f078f service cinder] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:36:44.561479 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1250/2523] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:36:44 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:36:44.634891 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04db6ef9-789b-4ff1-8ba5-98f130ed907b None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:36:44.645058 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04db6ef9-789b-4ff1-8ba5-98f130ed907b None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:36:44.648710 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804f5dd2-f3f2-4ebc-ab84-24e42d16f73e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8078e791ba68460f8b3aeafb4b79b73a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:36:44.649306 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804f5dd2-f3f2-4ebc-ab84-24e42d16f73e service cinder] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:36:44.649587 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804f5dd2-f3f2-4ebc-ab84-24e42d16f73e service cinder] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:36:44.649858 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804f5dd2-f3f2-4ebc-ab84-24e42d16f73e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:36:44.707227 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804f5dd2-f3f2-4ebc-ab84-24e42d16f73e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:36:44.708654 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804f5dd2-f3f2-4ebc-ab84-24e42d16f73e service cinder] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:36:44.712161 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:36:44.724725 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1274/2524] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:36:44 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:36:44.987326 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583dc2be-ae36-42df-80fc-b5dd5c8f078f service cinder] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:36:45.051213 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583dc2be-ae36-42df-80fc-b5dd5c8f078f service cinder] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:36:45.055752 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad12986-7771-4064-83f5-67bb2913e955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:36:45.056359 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad12986-7771-4064-83f5-67bb2913e955 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:36:45.056633 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad12986-7771-4064-83f5-67bb2913e955 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:36:45.056899 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad12986-7771-4064-83f5-67bb2913e955 admin admin] PATH_INFO: `/v3/users/8087df56190a48ebb0692a93c2cfb991` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:36:45.058546 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad12986-7771-4064-83f5-67bb2913e955 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8087df56190a48ebb0692a93c2cfb991)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:36:45.060443 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad12986-7771-4064-83f5-67bb2913e955 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:36:45.133638 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-0ad12986-7771-4064-83f5-67bb2913e955 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8087df56190a48ebb0692a93c2cfb991'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:36:45.141447 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-0ad12986-7771-4064-83f5-67bb2913e955 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8087df56190a48ebb0692a93c2cfb991'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:36:45.142058 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-0ad12986-7771-4064-83f5-67bb2913e955 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8087df56190a48ebb0692a93c2cfb991'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:36:45.148968 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-0ad12986-7771-4064-83f5-67bb2913e955 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8087df56190a48ebb0692a93c2cfb991'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:36:45.160686 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-0ad12986-7771-4064-83f5-67bb2913e955 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8087df56190a48ebb0692a93c2cfb991'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:36:45.166581 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1251/2525] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 16:36:44 2022] DELETE /identity/v3/users/8087df56190a48ebb0692a93c2cfb991 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:36:45.171169 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c30a0f-04df-4662-8af2-ec156ef487df None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:36:45.171454 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c30a0f-04df-4662-8af2-ec156ef487df None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:36:45.171731 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c30a0f-04df-4662-8af2-ec156ef487df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:36:45.190939 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-19c30a0f-04df-4662-8af2-ec156ef487df None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:36:45.192132 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-19c30a0f-04df-4662-8af2-ec156ef487df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:36:45.249360 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1275/2526] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:36:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 16:36:45.258885 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad12986-7771-4064-83f5-67bb2913e955 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:36:45.260875 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-0ad12986-7771-4064-83f5-67bb2913e955 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:36:45.294354 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:36:45.323669 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad12986-7771-4064-83f5-67bb2913e955 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:36:45.327338 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185b4b34-bc36-47e7-a4ff-de68472eebfd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f44bfdd5214e8d84a2c0a5b1fd9b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:36:45.327930 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185b4b34-bc36-47e7-a4ff-de68472eebfd service neutron] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:36:45.328205 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185b4b34-bc36-47e7-a4ff-de68472eebfd service neutron] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:36:45.328474 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185b4b34-bc36-47e7-a4ff-de68472eebfd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:36:45.337216 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185b4b34-bc36-47e7-a4ff-de68472eebfd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:36:45.338719 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185b4b34-bc36-47e7-a4ff-de68472eebfd service neutron] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:36:45.347926 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1252/2527] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:36:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:36:45.791200 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c30a0f-04df-4662-8af2-ec156ef487df None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:36:45.794698 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-19c30a0f-04df-4662-8af2-ec156ef487df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:36:45.806651 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c30a0f-04df-4662-8af2-ec156ef487df None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:36:45.811521 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676f330c-63af-4806-bbf6-1a182cb504c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:36:45.812004 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676f330c-63af-4806-bbf6-1a182cb504c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:36:45.812275 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676f330c-63af-4806-bbf6-1a182cb504c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:36:45.812539 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676f330c-63af-4806-bbf6-1a182cb504c4 admin admin] PATH_INFO: `/v3/projects/15696dcd53a04d6c903769a79fc70d09` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:36:45.813635 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676f330c-63af-4806-bbf6-1a182cb504c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=15696dcd53a04d6c903769a79fc70d09)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:36:45.815564 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676f330c-63af-4806-bbf6-1a182cb504c4 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:36:45.862975 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-676f330c-63af-4806-bbf6-1a182cb504c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15696dcd53a04d6c903769a79fc70d09', 'request_id': 'req-676f330c-63af-4806-bbf6-1a182cb504c4'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:36:45.868499 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-676f330c-63af-4806-bbf6-1a182cb504c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15696dcd53a04d6c903769a79fc70d09', 'request_id': 'req-676f330c-63af-4806-bbf6-1a182cb504c4'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:36:45.875862 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-676f330c-63af-4806-bbf6-1a182cb504c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15696dcd53a04d6c903769a79fc70d09', 'request_id': 'req-676f330c-63af-4806-bbf6-1a182cb504c4'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:36:45.887068 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-676f330c-63af-4806-bbf6-1a182cb504c4 admin admin] The token cache is being invalidate because project 15696dcd53a04d6c903769a79fc70d09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81446) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 16:36:45.887353 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-676f330c-63af-4806-bbf6-1a182cb504c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:36:45.887977 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-676f330c-63af-4806-bbf6-1a182cb504c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:36:45.889434 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1276/2528] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 16:36:45 2022] DELETE /identity/v3/projects/15696dcd53a04d6c903769a79fc70d09 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:36:45.893377 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185b4b34-bc36-47e7-a4ff-de68472eebfd service neutron] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:36:45.904044 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185b4b34-bc36-47e7-a4ff-de68472eebfd service neutron] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:36:45.959842 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8e9665-b890-46a7-8108-96431f6cb58d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:36:45.960557 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8e9665-b890-46a7-8108-96431f6cb58d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:36:45.960859 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8e9665-b890-46a7-8108-96431f6cb58d admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:36:45.961122 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8e9665-b890-46a7-8108-96431f6cb58d admin admin] PATH_INFO: `/v3/users/c1ed4bda0e5d4fefbee6090a41ff3cf8` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:36:45.962231 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8e9665-b890-46a7-8108-96431f6cb58d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1ed4bda0e5d4fefbee6090a41ff3cf8)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:36:45.964697 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8e9665-b890-46a7-8108-96431f6cb58d admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:36:46.008978 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-db8e9665-b890-46a7-8108-96431f6cb58d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1ed4bda0e5d4fefbee6090a41ff3cf8'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:36:46.016226 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-db8e9665-b890-46a7-8108-96431f6cb58d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1ed4bda0e5d4fefbee6090a41ff3cf8'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:36:46.016832 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-db8e9665-b890-46a7-8108-96431f6cb58d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1ed4bda0e5d4fefbee6090a41ff3cf8'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:36:46.023717 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-db8e9665-b890-46a7-8108-96431f6cb58d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1ed4bda0e5d4fefbee6090a41ff3cf8'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:36:46.036037 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-db8e9665-b890-46a7-8108-96431f6cb58d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1ed4bda0e5d4fefbee6090a41ff3cf8'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:36:46.042699 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1253/2529] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 16:36:45 2022] DELETE /identity/v3/users/c1ed4bda0e5d4fefbee6090a41ff3cf8 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:36:46.417989 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676f330c-63af-4806-bbf6-1a182cb504c4 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:36:46.419788 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-676f330c-63af-4806-bbf6-1a182cb504c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:36:46.433541 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676f330c-63af-4806-bbf6-1a182cb504c4 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:36:46.503387 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7def08b-0684-4255-9682-ca3d4f9c46f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:36:46.504093 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7def08b-0684-4255-9682-ca3d4f9c46f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:36:46.504387 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7def08b-0684-4255-9682-ca3d4f9c46f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:36:46.504663 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7def08b-0684-4255-9682-ca3d4f9c46f8 admin admin] PATH_INFO: `/v3/projects/eccf240b0d6442469740610d4edb3696` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:36:46.505853 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7def08b-0684-4255-9682-ca3d4f9c46f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eccf240b0d6442469740610d4edb3696)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:36:46.507839 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7def08b-0684-4255-9682-ca3d4f9c46f8 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:36:46.537449 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:36:46.563859 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-b7def08b-0684-4255-9682-ca3d4f9c46f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eccf240b0d6442469740610d4edb3696', 'request_id': 'req-b7def08b-0684-4255-9682-ca3d4f9c46f8'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:36:46.571355 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-b7def08b-0684-4255-9682-ca3d4f9c46f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eccf240b0d6442469740610d4edb3696', 'request_id': 'req-b7def08b-0684-4255-9682-ca3d4f9c46f8'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:36:46.579836 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-b7def08b-0684-4255-9682-ca3d4f9c46f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eccf240b0d6442469740610d4edb3696', 'request_id': 'req-b7def08b-0684-4255-9682-ca3d4f9c46f8'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:36:46.599306 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-b7def08b-0684-4255-9682-ca3d4f9c46f8 admin admin] The token cache is being invalidate because project eccf240b0d6442469740610d4edb3696 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81446) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 16:36:46.599602 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-b7def08b-0684-4255-9682-ca3d4f9c46f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:36:46.600371 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-b7def08b-0684-4255-9682-ca3d4f9c46f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:36:46.602738 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1277/2530] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 16:36:46 2022] DELETE /identity/v3/projects/eccf240b0d6442469740610d4edb3696 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:36:46.606826 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec11b2e3-e14e-4324-addb-31beece139e7 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:36:46.607456 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec11b2e3-e14e-4324-addb-31beece139e7 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:36:46.607804 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec11b2e3-e14e-4324-addb-31beece139e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:36:46.631729 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-ec11b2e3-e14e-4324-addb-31beece139e7 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:36:46.632937 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-ec11b2e3-e14e-4324-addb-31beece139e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:36:46.686778 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:36:46.707929 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1254/2531] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:36:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:36:46.715301 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ec3a4d-bc9c-42c3-b28e-67c7cbbf16d5 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:36:46.715581 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ec3a4d-bc9c-42c3-b28e-67c7cbbf16d5 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:36:46.715850 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ec3a4d-bc9c-42c3-b28e-67c7cbbf16d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:36:46.735799 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-d1ec3a4d-bc9c-42c3-b28e-67c7cbbf16d5 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:36:46.737052 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-d1ec3a4d-bc9c-42c3-b28e-67c7cbbf16d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:36:46.746051 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1278/2532] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:36:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:36:46.750397 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec11b2e3-e14e-4324-addb-31beece139e7 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:36:46.761799 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec11b2e3-e14e-4324-addb-31beece139e7 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:36:46.766489 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e48e42f-65ce-49e3-a5a7-09728b53f020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:36:46.767162 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e48e42f-65ce-49e3-a5a7-09728b53f020 admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:36:46.767439 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e48e42f-65ce-49e3-a5a7-09728b53f020 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:36:46.767709 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e48e42f-65ce-49e3-a5a7-09728b53f020 admin admin] PATH_INFO: `/v3/domains` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:36:46.768345 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e48e42f-65ce-49e3-a5a7-09728b53f020 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:36:46.768642 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e48e42f-65ce-49e3-a5a7-09728b53f020 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:36:46.770260 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e48e42f-65ce-49e3-a5a7-09728b53f020 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:36:46.782748 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1255/2533] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Sep 9 16:36:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:36:46.787395 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ec3a4d-bc9c-42c3-b28e-67c7cbbf16d5 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:36:46.797171 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ec3a4d-bc9c-42c3-b28e-67c7cbbf16d5 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:36:46.802997 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcc7a6e-3845-4bf7-b084-592847ea33fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:36:46.803607 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcc7a6e-3845-4bf7-b084-592847ea33fc admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:36:46.804060 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcc7a6e-3845-4bf7-b084-592847ea33fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:36:46.804257 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcc7a6e-3845-4bf7-b084-592847ea33fc admin admin] PATH_INFO: `/v3/projects` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:36:46.804832 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcc7a6e-3845-4bf7-b084-592847ea33fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:36:46.806836 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcc7a6e-3845-4bf7-b084-592847ea33fc admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:36:46.845367 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e48e42f-65ce-49e3-a5a7-09728b53f020 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:36:46.852116 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1279/2534] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 16:36:46 2022] POST /identity/v3/projects => generated 373 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:36:46.859768 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e48e42f-65ce-49e3-a5a7-09728b53f020 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:36:46.931747 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d088ef8a-1458-4973-aa0d-7956d9c07ce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:36:46.933424 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d088ef8a-1458-4973-aa0d-7956d9c07ce3 admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:36:46.933643 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d088ef8a-1458-4973-aa0d-7956d9c07ce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:36:46.933842 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d088ef8a-1458-4973-aa0d-7956d9c07ce3 admin admin] PATH_INFO: `/v3/users` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:36:46.934529 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d088ef8a-1458-4973-aa0d-7956d9c07ce3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:36:46.936469 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d088ef8a-1458-4973-aa0d-7956d9c07ce3 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:36:46.962314 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1256/2535] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 16:36:46 2022] POST /identity/v3/users => generated 287 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:36:46.966579 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcc7a6e-3845-4bf7-b084-592847ea33fc admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:36:46.977656 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcc7a6e-3845-4bf7-b084-592847ea33fc admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:36:46.984057 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769398f6-4047-4ffd-94fe-8c6d32b7dd5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:36:46.984686 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769398f6-4047-4ffd-94fe-8c6d32b7dd5c admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:36:46.984967 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769398f6-4047-4ffd-94fe-8c6d32b7dd5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:36:46.985239 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769398f6-4047-4ffd-94fe-8c6d32b7dd5c admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:36:46.985883 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769398f6-4047-4ffd-94fe-8c6d32b7dd5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:36:46.987944 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769398f6-4047-4ffd-94fe-8c6d32b7dd5c admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:36:47.001977 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1280/2536] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:36:46 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:36:47.003223 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d088ef8a-1458-4973-aa0d-7956d9c07ce3 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:36:47.017640 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d088ef8a-1458-4973-aa0d-7956d9c07ce3 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:36:47.027133 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9d061f-6d15-4f59-98e7-8c35ab110c7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:36:47.027755 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9d061f-6d15-4f59-98e7-8c35ab110c7c admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:36:47.028031 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9d061f-6d15-4f59-98e7-8c35ab110c7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:36:47.028299 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9d061f-6d15-4f59-98e7-8c35ab110c7c admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:36:47.028937 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9d061f-6d15-4f59-98e7-8c35ab110c7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:36:47.030584 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9d061f-6d15-4f59-98e7-8c35ab110c7c admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:36:47.042668 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1257/2537] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:36:47 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:36:47.046762 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769398f6-4047-4ffd-94fe-8c6d32b7dd5c admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:36:47.057626 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769398f6-4047-4ffd-94fe-8c6d32b7dd5c admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:36:47.062533 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de1ac02-ba64-454d-8680-43ede9a489f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:36:47.063202 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de1ac02-ba64-454d-8680-43ede9a489f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:36:47.063480 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de1ac02-ba64-454d-8680-43ede9a489f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:36:47.063754 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de1ac02-ba64-454d-8680-43ede9a489f3 admin admin] PATH_INFO: `/v3/projects/5dad54d3fcb0429f94d2421eafe885d2/users/912b44700c0846518914eda5e1d7b4c3/roles/b38e84bf077846ee802e6bb1bad83522` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:36:47.080082 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de1ac02-ba64-454d-8680-43ede9a489f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5dad54d3fcb0429f94d2421eafe885d2, user_id=912b44700c0846518914eda5e1d7b4c3, role_id=b38e84bf077846ee802e6bb1bad83522)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:36:47.082817 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de1ac02-ba64-454d-8680-43ede9a489f3 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:36:47.101343 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1281/2538] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 16:36:47 2022] PUT /identity/v3/projects/5dad54d3fcb0429f94d2421eafe885d2/users/912b44700c0846518914eda5e1d7b4c3/roles/b38e84bf077846ee802e6bb1bad83522 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 16:36:47.106904 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2962d42a-0564-42b0-a129-4e6da310d964 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:36:47.107189 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2962d42a-0564-42b0-a129-4e6da310d964 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:36:47.107466 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2962d42a-0564-42b0-a129-4e6da310d964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:36:47.127205 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-2962d42a-0564-42b0-a129-4e6da310d964 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:36:47.128661 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-2962d42a-0564-42b0-a129-4e6da310d964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:36:47.191879 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1258/2539] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:36:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:36:47.202399 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de1ac02-ba64-454d-8680-43ede9a489f3 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:36:47.204232 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-4de1ac02-ba64-454d-8680-43ede9a489f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:36:47.273993 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de1ac02-ba64-454d-8680-43ede9a489f3 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:36:47.279047 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e21a81-d45a-4429-b0a4-782adbcaf6bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f44bfdd5214e8d84a2c0a5b1fd9b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:36:47.279439 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e21a81-d45a-4429-b0a4-782adbcaf6bf service neutron] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:36:47.279810 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e21a81-d45a-4429-b0a4-782adbcaf6bf service neutron] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:36:47.279998 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e21a81-d45a-4429-b0a4-782adbcaf6bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:36:47.290505 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e21a81-d45a-4429-b0a4-782adbcaf6bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:36:47.293274 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e21a81-d45a-4429-b0a4-782adbcaf6bf service neutron] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:36:47.303422 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1282/2540] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:36:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:36:47.925255 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8376aecb-65b8-40d2-bf07-737493d0ed71 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:36:47.925541 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8376aecb-65b8-40d2-bf07-737493d0ed71 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:36:47.925816 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8376aecb-65b8-40d2-bf07-737493d0ed71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:36:47.957286 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-8376aecb-65b8-40d2-bf07-737493d0ed71 None None] MFA Rules not processed for user `912b44700c0846518914eda5e1d7b4c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:36:47.958862 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-8376aecb-65b8-40d2-bf07-737493d0ed71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:36:48.021303 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:36:48.048073 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5911c4-e6b7-4c32-93e2-5d1375ad4f06 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:36:48.048646 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5911c4-e6b7-4c32-93e2-5d1375ad4f06 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:36:48.048907 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5911c4-e6b7-4c32-93e2-5d1375ad4f06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:36:48.053812 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1259/2541] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:36:47 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:36:48.055182 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8376aecb-65b8-40d2-bf07-737493d0ed71 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:36:48.072685 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8376aecb-65b8-40d2-bf07-737493d0ed71 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:36:48.075650 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-ca5911c4-e6b7-4c32-93e2-5d1375ad4f06 None None] MFA Rules not processed for user `b9d05f3782d24127aa613c8d7ac8041b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:36:48.076921 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-ca5911c4-e6b7-4c32-93e2-5d1375ad4f06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:36:48.077661 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff35a46d-d894-4ac9-bef6-cdb8edd0e73a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:36:48.078420 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff35a46d-d894-4ac9-bef6-cdb8edd0e73a admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:36:48.078758 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff35a46d-d894-4ac9-bef6-cdb8edd0e73a admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:36:48.079256 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff35a46d-d894-4ac9-bef6-cdb8edd0e73a admin admin] PATH_INFO: `/v3/projects` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:36:48.080183 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff35a46d-d894-4ac9-bef6-cdb8edd0e73a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:36:48.082286 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff35a46d-d894-4ac9-bef6-cdb8edd0e73a admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:36:48.118347 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1260/2542] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 16:36:48 2022] POST /identity/v3/projects => generated 371 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:36:48.119415 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff35a46d-d894-4ac9-bef6-cdb8edd0e73a admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:36:48.135072 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=91,keystone:DELETE=6,keystone:INSERT=3 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:36:48.148610 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1283/2543] 10.222.0.27 () {58 vars in 967 bytes} [Fri Sep 9 16:36:48 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:36:48.149741 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5911c4-e6b7-4c32-93e2-5d1375ad4f06 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:36:48.163319 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5911c4-e6b7-4c32-93e2-5d1375ad4f06 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:36:48.191650 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff35a46d-d894-4ac9-bef6-cdb8edd0e73a admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:36:48.195775 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa4a26f-7578-4017-b1bb-da407fd65f6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f44bfdd5214e8d84a2c0a5b1fd9b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:36:48.196232 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa4a26f-7578-4017-b1bb-da407fd65f6f service neutron] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:36:48.196516 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa4a26f-7578-4017-b1bb-da407fd65f6f service neutron] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:36:48.196780 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa4a26f-7578-4017-b1bb-da407fd65f6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:36:48.198774 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-0fa4a26f-7578-4017-b1bb-da407fd65f6f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:36:48.233387 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a188a38-f8dd-4e6b-808d-64f211ba483b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:36:48.233992 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a188a38-f8dd-4e6b-808d-64f211ba483b admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:36:48.234267 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a188a38-f8dd-4e6b-808d-64f211ba483b admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:36:48.234562 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a188a38-f8dd-4e6b-808d-64f211ba483b admin admin] PATH_INFO: `/v3/users` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:36:48.235198 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a188a38-f8dd-4e6b-808d-64f211ba483b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:36:48.237092 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a188a38-f8dd-4e6b-808d-64f211ba483b admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:36:48.257629 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1284/2544] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 16:36:48 2022] POST /identity/v3/users => generated 292 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:36:48.258535 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a188a38-f8dd-4e6b-808d-64f211ba483b admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:36:48.260113 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-9a188a38-f8dd-4e6b-808d-64f211ba483b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:36:48.272656 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa4a26f-7578-4017-b1bb-da407fd65f6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:36:48.274116 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa4a26f-7578-4017-b1bb-da407fd65f6f service neutron] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:36:48.290046 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1261/2545] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:36:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:36:48.290928 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa4a26f-7578-4017-b1bb-da407fd65f6f service neutron] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:36:48.301454 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa4a26f-7578-4017-b1bb-da407fd65f6f service neutron] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:36:48.306484 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e39d2e-bef1-49c6-a482-20dc5ff9179b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:36:48.307197 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e39d2e-bef1-49c6-a482-20dc5ff9179b admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:36:48.307557 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e39d2e-bef1-49c6-a482-20dc5ff9179b admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:36:48.307764 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e39d2e-bef1-49c6-a482-20dc5ff9179b admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:36:48.308434 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e39d2e-bef1-49c6-a482-20dc5ff9179b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:36:48.310078 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e39d2e-bef1-49c6-a482-20dc5ff9179b admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:36:48.327178 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1262/2546] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:36:48 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:36:48.328428 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e39d2e-bef1-49c6-a482-20dc5ff9179b admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:36:48.339328 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a188a38-f8dd-4e6b-808d-64f211ba483b admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:36:48.340810 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e39d2e-bef1-49c6-a482-20dc5ff9179b admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:36:48.344481 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c703fe-928c-4aa9-b641-3f7490005f5e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2350bbc4a194c2dab2e3be830fd0eba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:36:48.345096 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c703fe-928c-4aa9-b641-3f7490005f5e service swift] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:36:48.345375 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c703fe-928c-4aa9-b641-3f7490005f5e service swift] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:36:48.345640 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c703fe-928c-4aa9-b641-3f7490005f5e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:36:48.348148 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3558b6ea-f2ba-4f89-9d18-7f23f7a645f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:36:48.349215 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3558b6ea-f2ba-4f89-9d18-7f23f7a645f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:36:48.349564 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3558b6ea-f2ba-4f89-9d18-7f23f7a645f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:36:48.349905 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3558b6ea-f2ba-4f89-9d18-7f23f7a645f9 admin admin] PATH_INFO: `/v3/projects/33fb4775a72143d6ac5e3cdb5f5d68c2/users/ce3e63d5e92e42adbee959f3385d81f6/roles/0a36d1be416f4089be19be979943b731` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:36:48.365940 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3558b6ea-f2ba-4f89-9d18-7f23f7a645f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33fb4775a72143d6ac5e3cdb5f5d68c2, user_id=ce3e63d5e92e42adbee959f3385d81f6, role_id=0a36d1be416f4089be19be979943b731)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:36:48.368559 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3558b6ea-f2ba-4f89-9d18-7f23f7a645f9 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:36:48.384800 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1263/2547] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 16:36:48 2022] PUT /identity/v3/projects/33fb4775a72143d6ac5e3cdb5f5d68c2/users/ce3e63d5e92e42adbee959f3385d81f6/roles/0a36d1be416f4089be19be979943b731 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:36:48.388266 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3558b6ea-f2ba-4f89-9d18-7f23f7a645f9 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:36:48.411085 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c703fe-928c-4aa9-b641-3f7490005f5e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:36:48.412669 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c703fe-928c-4aa9-b641-3f7490005f5e service swift] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:36:48.421890 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1285/2548] 10.222.0.27 () {60 vars in 1384 bytes} [Fri Sep 9 16:36:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 09 16:36:48.425774 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:36:48.462938 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3558b6ea-f2ba-4f89-9d18-7f23f7a645f9 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:36:48.468343 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4961b9-82cd-44d5-a43d-085db64d834b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:36:48.468939 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4961b9-82cd-44d5-a43d-085db64d834b admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:36:48.469268 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4961b9-82cd-44d5-a43d-085db64d834b admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:36:48.469679 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4961b9-82cd-44d5-a43d-085db64d834b admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:36:48.470456 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4961b9-82cd-44d5-a43d-085db64d834b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:36:48.471920 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4961b9-82cd-44d5-a43d-085db64d834b admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:36:48.486340 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1264/2549] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:36:48 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 16:36:48.487549 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c703fe-928c-4aa9-b641-3f7490005f5e service swift] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:36:48.499616 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c703fe-928c-4aa9-b641-3f7490005f5e service swift] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:36:48.504323 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fbed0f-03fe-46cd-ad72-769d30cf9dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:36:48.505275 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fbed0f-03fe-46cd-ad72-769d30cf9dd0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:36:48.505612 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fbed0f-03fe-46cd-ad72-769d30cf9dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:36:48.506053 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fbed0f-03fe-46cd-ad72-769d30cf9dd0 admin admin] PATH_INFO: `/v3/projects/33fb4775a72143d6ac5e3cdb5f5d68c2/users/ce3e63d5e92e42adbee959f3385d81f6/roles/0a36d1be416f4089be19be979943b731` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:36:48.508045 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fbed0f-03fe-46cd-ad72-769d30cf9dd0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33fb4775a72143d6ac5e3cdb5f5d68c2, user_id=ce3e63d5e92e42adbee959f3385d81f6, role_id=0a36d1be416f4089be19be979943b731)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:36:48.511185 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fbed0f-03fe-46cd-ad72-769d30cf9dd0 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:36:48.528097 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1286/2550] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 16:36:48 2022] PUT /identity/v3/projects/33fb4775a72143d6ac5e3cdb5f5d68c2/users/ce3e63d5e92e42adbee959f3385d81f6/roles/0a36d1be416f4089be19be979943b731 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:36:49.491566 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4961b9-82cd-44d5-a43d-085db64d834b admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:36:49.556222 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab3cfdc-d0be-48d9-ada1-1b00d247b3ca None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:36:49.556766 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab3cfdc-d0be-48d9-ada1-1b00d247b3ca None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:36:49.556932 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab3cfdc-d0be-48d9-ada1-1b00d247b3ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:36:49.574984 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4961b9-82cd-44d5-a43d-085db64d834b admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:36:49.589234 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:36:49.591709 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-bab3cfdc-d0be-48d9-ada1-1b00d247b3ca None None] MFA Rules not processed for user `ce3e63d5e92e42adbee959f3385d81f6`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:36:49.593437 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-bab3cfdc-d0be-48d9-ada1-1b00d247b3ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:36:49.635916 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852728ae-75fa-4004-8e73-7f9138a9b91f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f44bfdd5214e8d84a2c0a5b1fd9b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:36:49.636628 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852728ae-75fa-4004-8e73-7f9138a9b91f service neutron] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:36:49.636992 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852728ae-75fa-4004-8e73-7f9138a9b91f service neutron] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:36:49.637323 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852728ae-75fa-4004-8e73-7f9138a9b91f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:36:49.639808 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-852728ae-75fa-4004-8e73-7f9138a9b91f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:36:49.705714 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1287/2551] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:36:49 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 16:36:49.716658 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98358762-41d7-4e38-b63f-f780af859cfd None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:36:49.716948 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98358762-41d7-4e38-b63f-f780af859cfd None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:36:49.717252 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98358762-41d7-4e38-b63f-f780af859cfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:36:49.730121 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852728ae-75fa-4004-8e73-7f9138a9b91f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:36:49.731728 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852728ae-75fa-4004-8e73-7f9138a9b91f service neutron] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:36:49.737019 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-98358762-41d7-4e38-b63f-f780af859cfd None None] MFA Rules not processed for user `912b44700c0846518914eda5e1d7b4c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:36:49.738726 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-98358762-41d7-4e38-b63f-f780af859cfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:36:49.744060 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1265/2552] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:36:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:36:49.799180 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1288/2553] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:36:49 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 16:36:49.810392 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852728ae-75fa-4004-8e73-7f9138a9b91f service neutron] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:36:49.811916 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-852728ae-75fa-4004-8e73-7f9138a9b91f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:36:49.828165 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852728ae-75fa-4004-8e73-7f9138a9b91f service neutron] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:36:49.835803 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c8eb44-4116-4b41-a641-2352bf4d02ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a332b9b4980646a3b14633293f77b505', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:36:49.836425 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c8eb44-4116-4b41-a641-2352bf4d02ef service nova] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:36:49.836705 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c8eb44-4116-4b41-a641-2352bf4d02ef service nova] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:36:49.836978 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c8eb44-4116-4b41-a641-2352bf4d02ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:36:49.847978 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c8eb44-4116-4b41-a641-2352bf4d02ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:36:49.849738 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c8eb44-4116-4b41-a641-2352bf4d02ef service nova] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:36:49.860515 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1266/2554] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:36:49 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:36:55.263908 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c83aad-30a9-413a-bf59-3153c5867ff9 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:36:55.265095 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c83aad-30a9-413a-bf59-3153c5867ff9 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:36:55.265419 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c83aad-30a9-413a-bf59-3153c5867ff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:36:55.296277 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-e4c83aad-30a9-413a-bf59-3153c5867ff9 None None] MFA Rules not processed for user `b9d05f3782d24127aa613c8d7ac8041b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:36:55.297520 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-e4c83aad-30a9-413a-bf59-3153c5867ff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:36:55.374215 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1289/2555] 10.222.0.27 () {58 vars in 1009 bytes} [Fri Sep 9 16:36:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:36:55.389612 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c8eb44-4116-4b41-a641-2352bf4d02ef service nova] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:36:55.409592 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:36:55.491183 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c8eb44-4116-4b41-a641-2352bf4d02ef service nova] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:36:55.515079 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071a4aaf-8ac5-417d-ada8-4e9351918b5d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2350bbc4a194c2dab2e3be830fd0eba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:36:55.515709 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071a4aaf-8ac5-417d-ada8-4e9351918b5d service swift] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:36:55.515988 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071a4aaf-8ac5-417d-ada8-4e9351918b5d service swift] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:36:55.516261 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071a4aaf-8ac5-417d-ada8-4e9351918b5d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:36:55.535814 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071a4aaf-8ac5-417d-ada8-4e9351918b5d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:36:55.537442 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071a4aaf-8ac5-417d-ada8-4e9351918b5d service swift] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:36:55.561269 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1267/2556] 10.222.0.27 () {60 vars in 1384 bytes} [Fri Sep 9 16:36:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 09 16:36:56.548693 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c83aad-30a9-413a-bf59-3153c5867ff9 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:36:56.550764 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-e4c83aad-30a9-413a-bf59-3153c5867ff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:36:56.647579 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:36:56.669058 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c83aad-30a9-413a-bf59-3153c5867ff9 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:36:56.674458 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea991ea-298d-43d8-9910-f0f115963707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:36:56.675282 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea991ea-298d-43d8-9910-f0f115963707 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:36:56.675556 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea991ea-298d-43d8-9910-f0f115963707 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:36:56.675827 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea991ea-298d-43d8-9910-f0f115963707 admin admin] PATH_INFO: `/v3/users/86e21d94c615492fb68249591445e448` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:36:56.676967 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea991ea-298d-43d8-9910-f0f115963707 admin admin] RBAC: Authorizing `identity:delete_user(user_id=86e21d94c615492fb68249591445e448)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:36:56.678999 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea991ea-298d-43d8-9910-f0f115963707 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:36:56.744735 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-8ea991ea-298d-43d8-9910-f0f115963707 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86e21d94c615492fb68249591445e448'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:36:56.753122 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-8ea991ea-298d-43d8-9910-f0f115963707 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86e21d94c615492fb68249591445e448'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:36:56.770500 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-8ea991ea-298d-43d8-9910-f0f115963707 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86e21d94c615492fb68249591445e448'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:36:56.788703 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-8ea991ea-298d-43d8-9910-f0f115963707 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86e21d94c615492fb68249591445e448'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:36:56.789392 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-8ea991ea-298d-43d8-9910-f0f115963707 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86e21d94c615492fb68249591445e448'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:36:56.804048 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1290/2557] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 16:36:56 2022] DELETE /identity/v3/users/86e21d94c615492fb68249591445e448 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:36:57.105675 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071a4aaf-8ac5-417d-ada8-4e9351918b5d service swift] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:36:57.122386 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071a4aaf-8ac5-417d-ada8-4e9351918b5d service swift] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:36:57.208207 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa36337-ea48-4b82-86e3-b3b176ca71ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:36:57.208860 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa36337-ea48-4b82-86e3-b3b176ca71ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:36:57.209279 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa36337-ea48-4b82-86e3-b3b176ca71ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:36:57.209556 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa36337-ea48-4b82-86e3-b3b176ca71ea admin admin] PATH_INFO: `/v3/projects/2ea4f7629d844ae2916622bf56bda1a6` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:36:57.211175 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa36337-ea48-4b82-86e3-b3b176ca71ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ea4f7629d844ae2916622bf56bda1a6)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:36:57.216056 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa36337-ea48-4b82-86e3-b3b176ca71ea admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:36:57.295552 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-6aa36337-ea48-4b82-86e3-b3b176ca71ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ea4f7629d844ae2916622bf56bda1a6', 'request_id': 'req-6aa36337-ea48-4b82-86e3-b3b176ca71ea'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:36:57.307909 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-6aa36337-ea48-4b82-86e3-b3b176ca71ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ea4f7629d844ae2916622bf56bda1a6', 'request_id': 'req-6aa36337-ea48-4b82-86e3-b3b176ca71ea'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:36:57.323851 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-6aa36337-ea48-4b82-86e3-b3b176ca71ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ea4f7629d844ae2916622bf56bda1a6', 'request_id': 'req-6aa36337-ea48-4b82-86e3-b3b176ca71ea'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:36:57.336835 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-6aa36337-ea48-4b82-86e3-b3b176ca71ea admin admin] The token cache is being invalidate because project 2ea4f7629d844ae2916622bf56bda1a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81445) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 16:36:57.337427 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-6aa36337-ea48-4b82-86e3-b3b176ca71ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:36:57.338343 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-6aa36337-ea48-4b82-86e3-b3b176ca71ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:36:57.340335 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1268/2558] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 16:36:57 2022] DELETE /identity/v3/projects/2ea4f7629d844ae2916622bf56bda1a6 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:36:57.344278 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea991ea-298d-43d8-9910-f0f115963707 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:36:57.345735 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-8ea991ea-298d-43d8-9910-f0f115963707 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:36:57.360549 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea991ea-298d-43d8-9910-f0f115963707 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:36:57.442922 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f88cfd4-c6e9-4198-8e2e-e3d120c9d908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:36:57.443558 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f88cfd4-c6e9-4198-8e2e-e3d120c9d908 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:36:57.443827 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f88cfd4-c6e9-4198-8e2e-e3d120c9d908 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:36:57.444093 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f88cfd4-c6e9-4198-8e2e-e3d120c9d908 admin admin] PATH_INFO: `/v3/users/d1c2d257c7074dd792956162c4b95d01` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:36:57.445264 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f88cfd4-c6e9-4198-8e2e-e3d120c9d908 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1c2d257c7074dd792956162c4b95d01)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:36:57.447664 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f88cfd4-c6e9-4198-8e2e-e3d120c9d908 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:36:57.507799 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-0f88cfd4-c6e9-4198-8e2e-e3d120c9d908 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1c2d257c7074dd792956162c4b95d01'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:36:57.516299 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-0f88cfd4-c6e9-4198-8e2e-e3d120c9d908 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1c2d257c7074dd792956162c4b95d01'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:36:57.529876 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:36:57.533849 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-0f88cfd4-c6e9-4198-8e2e-e3d120c9d908 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1c2d257c7074dd792956162c4b95d01'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:36:57.542915 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-0f88cfd4-c6e9-4198-8e2e-e3d120c9d908 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1c2d257c7074dd792956162c4b95d01'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:36:57.544198 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-0f88cfd4-c6e9-4198-8e2e-e3d120c9d908 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1c2d257c7074dd792956162c4b95d01'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:36:57.551453 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1291/2559] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 16:36:57 2022] DELETE /identity/v3/users/d1c2d257c7074dd792956162c4b95d01 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:36:57.823716 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa36337-ea48-4b82-86e3-b3b176ca71ea admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:36:57.825848 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-6aa36337-ea48-4b82-86e3-b3b176ca71ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:36:57.848945 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa36337-ea48-4b82-86e3-b3b176ca71ea admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:36:57.897456 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:36:57.932510 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081eb5f5-ed40-4261-92d9-c6641158f4ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:36:57.933137 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081eb5f5-ed40-4261-92d9-c6641158f4ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:36:57.933414 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081eb5f5-ed40-4261-92d9-c6641158f4ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:36:57.933684 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081eb5f5-ed40-4261-92d9-c6641158f4ce admin admin] PATH_INFO: `/v3/projects/b099351fdeef4ab4b21b82c9802d06ce` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:36:57.934829 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081eb5f5-ed40-4261-92d9-c6641158f4ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=b099351fdeef4ab4b21b82c9802d06ce)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:36:57.936737 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081eb5f5-ed40-4261-92d9-c6641158f4ce admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:36:57.988942 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-081eb5f5-ed40-4261-92d9-c6641158f4ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b099351fdeef4ab4b21b82c9802d06ce', 'request_id': 'req-081eb5f5-ed40-4261-92d9-c6641158f4ce'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:36:57.995683 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-081eb5f5-ed40-4261-92d9-c6641158f4ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b099351fdeef4ab4b21b82c9802d06ce', 'request_id': 'req-081eb5f5-ed40-4261-92d9-c6641158f4ce'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:36:58.004655 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-081eb5f5-ed40-4261-92d9-c6641158f4ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b099351fdeef4ab4b21b82c9802d06ce', 'request_id': 'req-081eb5f5-ed40-4261-92d9-c6641158f4ce'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:36:58.016006 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-081eb5f5-ed40-4261-92d9-c6641158f4ce admin admin] The token cache is being invalidate because project b099351fdeef4ab4b21b82c9802d06ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81445) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 16:36:58.016383 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-081eb5f5-ed40-4261-92d9-c6641158f4ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:36:58.017080 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-081eb5f5-ed40-4261-92d9-c6641158f4ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:36:58.019021 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1269/2560] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 16:36:57 2022] DELETE /identity/v3/projects/b099351fdeef4ab4b21b82c9802d06ce => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:37:03.622932 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f88cfd4-c6e9-4198-8e2e-e3d120c9d908 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:37:03.624964 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-0f88cfd4-c6e9-4198-8e2e-e3d120c9d908 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:37:03.687434 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f88cfd4-c6e9-4198-8e2e-e3d120c9d908 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:37:03.742509 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7da5ec-1103-4f0a-a09e-5ff499c5f69c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8078e791ba68460f8b3aeafb4b79b73a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:37:03.743321 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7da5ec-1103-4f0a-a09e-5ff499c5f69c service cinder] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:37:03.743693 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7da5ec-1103-4f0a-a09e-5ff499c5f69c service cinder] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:37:03.744067 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7da5ec-1103-4f0a-a09e-5ff499c5f69c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:37:03.749052 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-7a7da5ec-1103-4f0a-a09e-5ff499c5f69c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:37:03.830136 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7da5ec-1103-4f0a-a09e-5ff499c5f69c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:37:03.831985 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7da5ec-1103-4f0a-a09e-5ff499c5f69c service cinder] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:37:03.858227 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1292/2561] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:37:03 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:37:08.012666 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=38,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:37:08.526797 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081eb5f5-ed40-4261-92d9-c6641158f4ce admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:37:08.528280 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-081eb5f5-ed40-4261-92d9-c6641158f4ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:37:08.601652 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081eb5f5-ed40-4261-92d9-c6641158f4ce admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:37:08.607560 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82137fc5-d9c4-426f-8642-e10b3963032a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a332b9b4980646a3b14633293f77b505', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:37:08.608158 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82137fc5-d9c4-426f-8642-e10b3963032a service nova] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:37:08.608437 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82137fc5-d9c4-426f-8642-e10b3963032a service nova] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:37:08.608708 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82137fc5-d9c4-426f-8642-e10b3963032a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:37:08.610413 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-82137fc5-d9c4-426f-8642-e10b3963032a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:37:08.672086 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82137fc5-d9c4-426f-8642-e10b3963032a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:37:08.673821 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82137fc5-d9c4-426f-8642-e10b3963032a service nova] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:37:08.683630 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1270/2562] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:37:08 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:37:11.004657 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed62c051-8dd7-4c22-8f49-006c930fab02 None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:37:11.005469 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed62c051-8dd7-4c22-8f49-006c930fab02 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:37:11.005469 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed62c051-8dd7-4c22-8f49-006c930fab02 None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:37:11.007097 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1293/2563] 10.222.0.27 () {54 vars in 921 bytes} [Fri Sep 9 16:37:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:37:11.014284 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85df0dac-054f-4f6a-95d3-af975f3b294e None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:37:11.014907 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85df0dac-054f-4f6a-95d3-af975f3b294e None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:37:11.014907 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85df0dac-054f-4f6a-95d3-af975f3b294e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:37:11.044126 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-85df0dac-054f-4f6a-95d3-af975f3b294e None None] MFA Rules not processed for user `a332b9b4980646a3b14633293f77b505`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:37:11.045353 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-85df0dac-054f-4f6a-95d3-af975f3b294e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:37:11.055838 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1271/2564] 10.222.0.27 () {58 vars in 1018 bytes} [Fri Sep 9 16:37:11 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:37:11.067835 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed62c051-8dd7-4c22-8f49-006c930fab02 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:37:11.069496 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-ed62c051-8dd7-4c22-8f49-006c930fab02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:37:11.129050 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed62c051-8dd7-4c22-8f49-006c930fab02 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:37:11.132806 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfe9562-d596-4445-901f-627186d3a564 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ddd42508eee4412ae139cb8526090d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:37:11.133408 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfe9562-d596-4445-901f-627186d3a564 service glance] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:37:11.133686 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfe9562-d596-4445-901f-627186d3a564 service glance] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:37:11.133979 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfe9562-d596-4445-901f-627186d3a564 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:37:11.143152 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:DELETE=2,keystone:SELECT=97,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:37:11.145549 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfe9562-d596-4445-901f-627186d3a564 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:37:11.147549 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfe9562-d596-4445-901f-627186d3a564 service glance] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:37:11.160707 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1294/2565] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:37:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 16:37:11.229972 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddefbe80-93fc-4bcf-98dc-d76698845a31 None None] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:37:11.230351 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddefbe80-93fc-4bcf-98dc-d76698845a31 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:37:11.230552 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddefbe80-93fc-4bcf-98dc-d76698845a31 None None] PATH_INFO: `/` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:37:11.231913 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1272/2566] 10.222.0.27 () {54 vars in 921 bytes} [Fri Sep 9 16:37:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:37:11.236708 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d356f01-bbe0-4dc6-bc1c-ef2809c88b42 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:37:11.237028 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d356f01-bbe0-4dc6-bc1c-ef2809c88b42 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:37:11.237302 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d356f01-bbe0-4dc6-bc1c-ef2809c88b42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:37:11.257131 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-9d356f01-bbe0-4dc6-bc1c-ef2809c88b42 None None] MFA Rules not processed for user `d5f44bfdd5214e8d84a2c0a5b1fd9b84`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:37:11.258368 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-9d356f01-bbe0-4dc6-bc1c-ef2809c88b42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:37:11.310320 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1295/2567] 10.222.0.27 () {58 vars in 1018 bytes} [Fri Sep 9 16:37:11 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:37:11.323039 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddefbe80-93fc-4bcf-98dc-d76698845a31 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:37:11.324683 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-ddefbe80-93fc-4bcf-98dc-d76698845a31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:37:11.337365 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddefbe80-93fc-4bcf-98dc-d76698845a31 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:37:11.340875 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8327cfd6-e77f-40b8-953e-5c1458eb02c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f44bfdd5214e8d84a2c0a5b1fd9b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:37:11.341449 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8327cfd6-e77f-40b8-953e-5c1458eb02c8 service neutron] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:37:11.341721 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8327cfd6-e77f-40b8-953e-5c1458eb02c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:37:11.341985 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8327cfd6-e77f-40b8-953e-5c1458eb02c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:37:11.348721 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8327cfd6-e77f-40b8-953e-5c1458eb02c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:37:11.350135 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8327cfd6-e77f-40b8-953e-5c1458eb02c8 service neutron] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:37:11.358012 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1273/2568] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:37:11 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:37:11.441966 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7171c03c-ae27-460d-a61f-a4c3fac650aa None None] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:37:11.442255 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7171c03c-ae27-460d-a61f-a4c3fac650aa None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:37:11.442561 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7171c03c-ae27-460d-a61f-a4c3fac650aa None None] PATH_INFO: `/` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:37:11.443911 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1296/2569] 10.222.0.27 () {54 vars in 921 bytes} [Fri Sep 9 16:37:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 16:37:11.450635 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6739a09c-2608-47b3-a766-1b7b05992888 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:37:11.450915 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6739a09c-2608-47b3-a766-1b7b05992888 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:37:11.451179 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6739a09c-2608-47b3-a766-1b7b05992888 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:37:11.470191 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-6739a09c-2608-47b3-a766-1b7b05992888 None None] MFA Rules not processed for user `a332b9b4980646a3b14633293f77b505`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:37:11.471396 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-6739a09c-2608-47b3-a766-1b7b05992888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:37:11.480439 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1274/2570] 10.222.0.27 () {58 vars in 1018 bytes} [Fri Sep 9 16:37:11 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 16:37:11.491110 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7171c03c-ae27-460d-a61f-a4c3fac650aa None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:37:11.502718 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7171c03c-ae27-460d-a61f-a4c3fac650aa None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:37:11.506328 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3230ff42-3228-4aa0-95f8-ab005d8e5441 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f44bfdd5214e8d84a2c0a5b1fd9b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:37:11.506917 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3230ff42-3228-4aa0-95f8-ab005d8e5441 service neutron] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:37:11.507192 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3230ff42-3228-4aa0-95f8-ab005d8e5441 service neutron] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:37:11.507461 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3230ff42-3228-4aa0-95f8-ab005d8e5441 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:37:11.518324 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3230ff42-3228-4aa0-95f8-ab005d8e5441 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:37:11.519791 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3230ff42-3228-4aa0-95f8-ab005d8e5441 service neutron] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:37:11.530329 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1297/2571] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:37:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:37:11.590184 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6739a09c-2608-47b3-a766-1b7b05992888 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:37:11.591565 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-6739a09c-2608-47b3-a766-1b7b05992888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:37:11.658032 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6739a09c-2608-47b3-a766-1b7b05992888 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:37:11.662986 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ba7bd2-d89a-4f22-8c4b-5c5bbed32a2a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d73df92393c43b2b5ccc32a2d43d952', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:37:11.663578 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ba7bd2-d89a-4f22-8c4b-5c5bbed32a2a service placement] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:37:11.663851 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ba7bd2-d89a-4f22-8c4b-5c5bbed32a2a service placement] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:37:11.664115 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ba7bd2-d89a-4f22-8c4b-5c5bbed32a2a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:37:11.665821 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-79ba7bd2-d89a-4f22-8c4b-5c5bbed32a2a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:37:11.677205 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ba7bd2-d89a-4f22-8c4b-5c5bbed32a2a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:37:11.678786 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ba7bd2-d89a-4f22-8c4b-5c5bbed32a2a service placement] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:37:11.685484 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=100 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:37:11.690792 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1275/2572] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:37:11 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:37:12.559655 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3230ff42-3228-4aa0-95f8-ab005d8e5441 service neutron] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:37:12.561176 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-3230ff42-3228-4aa0-95f8-ab005d8e5441 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:37:12.572919 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3230ff42-3228-4aa0-95f8-ab005d8e5441 service neutron] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:37:12.576455 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeaacce-c43e-4c2d-bc73-89b2b13dea76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f44bfdd5214e8d84a2c0a5b1fd9b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:37:12.577038 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeaacce-c43e-4c2d-bc73-89b2b13dea76 service neutron] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:37:12.577312 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeaacce-c43e-4c2d-bc73-89b2b13dea76 service neutron] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:37:12.577579 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeaacce-c43e-4c2d-bc73-89b2b13dea76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:37:12.579220 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-ebeaacce-c43e-4c2d-bc73-89b2b13dea76 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:37:12.588955 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebeaacce-c43e-4c2d-bc73-89b2b13dea76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:37:12.590382 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebeaacce-c43e-4c2d-bc73-89b2b13dea76 service neutron] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:37:12.598230 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1298/2573] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:37:12 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:37:13.319843 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d7c2b9-9371-45b9-ab02-7117d607d5e8 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:37:13.320328 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d7c2b9-9371-45b9-ab02-7117d607d5e8 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:37:13.320759 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d7c2b9-9371-45b9-ab02-7117d607d5e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:37:13.343353 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-85d7c2b9-9371-45b9-ab02-7117d607d5e8 None None] MFA Rules not processed for user `b9d05f3782d24127aa613c8d7ac8041b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:37:13.344553 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-85d7c2b9-9371-45b9-ab02-7117d607d5e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:37:13.406453 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1276/2574] 10.222.0.27 () {58 vars in 1009 bytes} [Fri Sep 9 16:37:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:37:13.418562 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeaacce-c43e-4c2d-bc73-89b2b13dea76 service neutron] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:37:13.419978 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-ebeaacce-c43e-4c2d-bc73-89b2b13dea76 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:37:13.502610 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeaacce-c43e-4c2d-bc73-89b2b13dea76 service neutron] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:37:13.512832 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d24465-7a8a-41c1-a1df-291cdb8e9650 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2350bbc4a194c2dab2e3be830fd0eba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:37:13.513557 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d24465-7a8a-41c1-a1df-291cdb8e9650 service swift] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:37:13.513899 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d24465-7a8a-41c1-a1df-291cdb8e9650 service swift] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:37:13.514111 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d24465-7a8a-41c1-a1df-291cdb8e9650 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:37:13.523323 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d24465-7a8a-41c1-a1df-291cdb8e9650 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:37:13.524998 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d24465-7a8a-41c1-a1df-291cdb8e9650 service swift] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:37:13.533967 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1299/2575] 10.222.0.27 () {60 vars in 1384 bytes} [Fri Sep 9 16:37:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 09 16:37:15.781135 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d7c2b9-9371-45b9-ab02-7117d607d5e8 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:37:15.795053 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d7c2b9-9371-45b9-ab02-7117d607d5e8 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:37:15.800877 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc606c9-29f8-4eb8-b9ab-a866d2581f6c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a332b9b4980646a3b14633293f77b505', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:37:15.801486 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc606c9-29f8-4eb8-b9ab-a866d2581f6c service nova] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:37:15.801759 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc606c9-29f8-4eb8-b9ab-a866d2581f6c service nova] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:37:15.802034 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc606c9-29f8-4eb8-b9ab-a866d2581f6c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:37:15.803995 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-1dc606c9-29f8-4eb8-b9ab-a866d2581f6c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:37:15.876635 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc606c9-29f8-4eb8-b9ab-a866d2581f6c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:37:15.878236 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc606c9-29f8-4eb8-b9ab-a866d2581f6c service nova] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:37:15.888492 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1277/2576] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:37:15 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:37:23.530851 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=69 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:37:25.572206 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d24465-7a8a-41c1-a1df-291cdb8e9650 service swift] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:37:25.573712 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-01d24465-7a8a-41c1-a1df-291cdb8e9650 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:37:25.638399 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d24465-7a8a-41c1-a1df-291cdb8e9650 service swift] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:37:25.642995 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ee2458-adf2-47a9-91d2-b2f08685d6dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:37:25.643615 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ee2458-adf2-47a9-91d2-b2f08685d6dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:37:25.643893 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ee2458-adf2-47a9-91d2-b2f08685d6dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:37:25.644164 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ee2458-adf2-47a9-91d2-b2f08685d6dd admin admin] PATH_INFO: `/v3/users/912b44700c0846518914eda5e1d7b4c3` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:37:25.645326 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ee2458-adf2-47a9-91d2-b2f08685d6dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=912b44700c0846518914eda5e1d7b4c3)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:37:25.647368 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ee2458-adf2-47a9-91d2-b2f08685d6dd admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:37:25.693139 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-f4ee2458-adf2-47a9-91d2-b2f08685d6dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '912b44700c0846518914eda5e1d7b4c3'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:37:25.700832 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-f4ee2458-adf2-47a9-91d2-b2f08685d6dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '912b44700c0846518914eda5e1d7b4c3'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:37:25.712535 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-f4ee2458-adf2-47a9-91d2-b2f08685d6dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '912b44700c0846518914eda5e1d7b4c3'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:37:25.719763 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-f4ee2458-adf2-47a9-91d2-b2f08685d6dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '912b44700c0846518914eda5e1d7b4c3'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:37:25.720351 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-f4ee2458-adf2-47a9-91d2-b2f08685d6dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '912b44700c0846518914eda5e1d7b4c3'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:37:25.726233 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1300/2577] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 16:37:25 2022] DELETE /identity/v3/users/912b44700c0846518914eda5e1d7b4c3 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:37:25.883417 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=53 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:37:25.907662 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc606c9-29f8-4eb8-b9ab-a866d2581f6c service nova] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:37:25.921101 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc606c9-29f8-4eb8-b9ab-a866d2581f6c service nova] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:37:25.988467 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b5a370-274b-4122-8909-fe08499a110a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:37:25.989292 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b5a370-274b-4122-8909-fe08499a110a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:37:25.989575 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b5a370-274b-4122-8909-fe08499a110a admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:37:25.989847 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b5a370-274b-4122-8909-fe08499a110a admin admin] PATH_INFO: `/v3/projects/5dad54d3fcb0429f94d2421eafe885d2` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:37:25.990990 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b5a370-274b-4122-8909-fe08499a110a admin admin] RBAC: Authorizing `identity:delete_project(project_id=5dad54d3fcb0429f94d2421eafe885d2)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:37:25.992919 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b5a370-274b-4122-8909-fe08499a110a admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:37:26.038122 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-f8b5a370-274b-4122-8909-fe08499a110a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5dad54d3fcb0429f94d2421eafe885d2', 'request_id': 'req-f8b5a370-274b-4122-8909-fe08499a110a'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:37:26.044896 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-f8b5a370-274b-4122-8909-fe08499a110a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5dad54d3fcb0429f94d2421eafe885d2', 'request_id': 'req-f8b5a370-274b-4122-8909-fe08499a110a'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:37:26.052910 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-f8b5a370-274b-4122-8909-fe08499a110a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5dad54d3fcb0429f94d2421eafe885d2', 'request_id': 'req-f8b5a370-274b-4122-8909-fe08499a110a'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:37:26.063962 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-f8b5a370-274b-4122-8909-fe08499a110a admin admin] The token cache is being invalidate because project 5dad54d3fcb0429f94d2421eafe885d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81445) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 16:37:26.064246 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-f8b5a370-274b-4122-8909-fe08499a110a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:37:26.064865 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-f8b5a370-274b-4122-8909-fe08499a110a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:37:26.066340 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1278/2578] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 16:37:25 2022] DELETE /identity/v3/projects/5dad54d3fcb0429f94d2421eafe885d2 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:37:26.070276 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ee2458-adf2-47a9-91d2-b2f08685d6dd admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:37:26.071968 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-f4ee2458-adf2-47a9-91d2-b2f08685d6dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:37:26.084982 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ee2458-adf2-47a9-91d2-b2f08685d6dd admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:37:26.146133 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61030b24-65ce-4fe5-9cf5-90e2677e783d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:37:26.146792 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61030b24-65ce-4fe5-9cf5-90e2677e783d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:37:26.147075 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61030b24-65ce-4fe5-9cf5-90e2677e783d admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:37:26.147348 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61030b24-65ce-4fe5-9cf5-90e2677e783d admin admin] PATH_INFO: `/v3/users/ce3e63d5e92e42adbee959f3385d81f6` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:37:26.148482 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61030b24-65ce-4fe5-9cf5-90e2677e783d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce3e63d5e92e42adbee959f3385d81f6)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:37:26.150490 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61030b24-65ce-4fe5-9cf5-90e2677e783d admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:37:26.174605 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:37:26.199411 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-61030b24-65ce-4fe5-9cf5-90e2677e783d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce3e63d5e92e42adbee959f3385d81f6'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:37:26.206295 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-61030b24-65ce-4fe5-9cf5-90e2677e783d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce3e63d5e92e42adbee959f3385d81f6'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:37:26.218721 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-61030b24-65ce-4fe5-9cf5-90e2677e783d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce3e63d5e92e42adbee959f3385d81f6'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:37:26.226028 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-61030b24-65ce-4fe5-9cf5-90e2677e783d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce3e63d5e92e42adbee959f3385d81f6'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:37:26.226688 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-61030b24-65ce-4fe5-9cf5-90e2677e783d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce3e63d5e92e42adbee959f3385d81f6'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:37:26.233299 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1301/2579] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 16:37:26 2022] DELETE /identity/v3/users/ce3e63d5e92e42adbee959f3385d81f6 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 16:37:26.401211 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b5a370-274b-4122-8909-fe08499a110a admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:37:26.402843 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-f8b5a370-274b-4122-8909-fe08499a110a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:37:26.415610 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b5a370-274b-4122-8909-fe08499a110a admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:37:26.472951 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72bedd8-e34a-4023-a7ff-3eb2d38c6f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:37:26.473587 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72bedd8-e34a-4023-a7ff-3eb2d38c6f46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:37:26.473866 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72bedd8-e34a-4023-a7ff-3eb2d38c6f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:37:26.474343 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72bedd8-e34a-4023-a7ff-3eb2d38c6f46 admin admin] PATH_INFO: `/v3/projects/33fb4775a72143d6ac5e3cdb5f5d68c2` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:37:26.475283 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72bedd8-e34a-4023-a7ff-3eb2d38c6f46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=33fb4775a72143d6ac5e3cdb5f5d68c2)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:37:26.477202 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72bedd8-e34a-4023-a7ff-3eb2d38c6f46 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:37:26.513352 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:37:26.527804 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-d72bedd8-e34a-4023-a7ff-3eb2d38c6f46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33fb4775a72143d6ac5e3cdb5f5d68c2', 'request_id': 'req-d72bedd8-e34a-4023-a7ff-3eb2d38c6f46'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:37:26.534385 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-d72bedd8-e34a-4023-a7ff-3eb2d38c6f46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33fb4775a72143d6ac5e3cdb5f5d68c2', 'request_id': 'req-d72bedd8-e34a-4023-a7ff-3eb2d38c6f46'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:37:26.543306 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-d72bedd8-e34a-4023-a7ff-3eb2d38c6f46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33fb4775a72143d6ac5e3cdb5f5d68c2', 'request_id': 'req-d72bedd8-e34a-4023-a7ff-3eb2d38c6f46'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:37:26.554704 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-d72bedd8-e34a-4023-a7ff-3eb2d38c6f46 admin admin] The token cache is being invalidate because project 33fb4775a72143d6ac5e3cdb5f5d68c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81445) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 16:37:26.554994 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-d72bedd8-e34a-4023-a7ff-3eb2d38c6f46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:37:26.555617 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-d72bedd8-e34a-4023-a7ff-3eb2d38c6f46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:37:26.557108 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1279/2580] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 16:37:26 2022] DELETE /identity/v3/projects/33fb4775a72143d6ac5e3cdb5f5d68c2 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:37:26.561774 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec3054a-e9ef-4783-9677-15ec65dd7549 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:37:26.562063 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec3054a-e9ef-4783-9677-15ec65dd7549 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:37:26.562363 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec3054a-e9ef-4783-9677-15ec65dd7549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:37:26.725191 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-bec3054a-e9ef-4783-9677-15ec65dd7549 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:37:26.726474 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-bec3054a-e9ef-4783-9677-15ec65dd7549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:37:26.810438 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1302/2581] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:37:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:37:26.818280 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbcb944-c2e6-4d7c-a54a-719d3d5834d9 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:37:26.818593 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbcb944-c2e6-4d7c-a54a-719d3d5834d9 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:37:26.818868 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbcb944-c2e6-4d7c-a54a-719d3d5834d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:37:26.847711 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-abbcb944-c2e6-4d7c-a54a-719d3d5834d9 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:37:26.849027 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-abbcb944-c2e6-4d7c-a54a-719d3d5834d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:37:26.858845 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1280/2582] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:37:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:37:26.863141 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec3054a-e9ef-4783-9677-15ec65dd7549 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:37:26.874577 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec3054a-e9ef-4783-9677-15ec65dd7549 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:37:26.879921 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c234680b-3bf7-4d76-8dde-3087ce91bbef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:37:26.880558 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c234680b-3bf7-4d76-8dde-3087ce91bbef admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:37:26.880905 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c234680b-3bf7-4d76-8dde-3087ce91bbef admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:37:26.881266 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c234680b-3bf7-4d76-8dde-3087ce91bbef admin admin] PATH_INFO: `/v3/domains` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:37:26.882044 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c234680b-3bf7-4d76-8dde-3087ce91bbef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:37:26.882368 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c234680b-3bf7-4d76-8dde-3087ce91bbef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:37:26.884132 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c234680b-3bf7-4d76-8dde-3087ce91bbef admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:37:26.898330 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1303/2583] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Sep 9 16:37:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 16:37:26.903368 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbcb944-c2e6-4d7c-a54a-719d3d5834d9 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:37:26.917174 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbcb944-c2e6-4d7c-a54a-719d3d5834d9 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:37:26.922629 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2105ed1f-32f3-402b-a213-ccdb608ef6ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:37:26.923194 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2105ed1f-32f3-402b-a213-ccdb608ef6ea admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:37:26.923459 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2105ed1f-32f3-402b-a213-ccdb608ef6ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:37:26.923756 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2105ed1f-32f3-402b-a213-ccdb608ef6ea admin admin] PATH_INFO: `/v3/projects` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:37:26.924397 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2105ed1f-32f3-402b-a213-ccdb608ef6ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:37:26.926326 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2105ed1f-32f3-402b-a213-ccdb608ef6ea admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:37:26.957227 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1281/2584] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 16:37:26 2022] POST /identity/v3/projects => generated 375 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:37:26.961205 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c234680b-3bf7-4d76-8dde-3087ce91bbef admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:37:26.973468 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c234680b-3bf7-4d76-8dde-3087ce91bbef admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:37:27.065010 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f269c37f-6ce2-4148-8187-20d6445f6159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:37:27.065651 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f269c37f-6ce2-4148-8187-20d6445f6159 admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:37:27.065998 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f269c37f-6ce2-4148-8187-20d6445f6159 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:37:27.066363 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f269c37f-6ce2-4148-8187-20d6445f6159 admin admin] PATH_INFO: `/v3/users` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:37:27.067100 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f269c37f-6ce2-4148-8187-20d6445f6159 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:37:27.069701 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f269c37f-6ce2-4148-8187-20d6445f6159 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:37:27.097789 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1304/2585] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 16:37:26 2022] POST /identity/v3/users => generated 288 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:37:27.101855 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2105ed1f-32f3-402b-a213-ccdb608ef6ea admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:37:27.112573 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2105ed1f-32f3-402b-a213-ccdb608ef6ea admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:37:27.117310 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b54c43-eb79-43c2-a2de-995b293c71d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:37:27.117905 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b54c43-eb79-43c2-a2de-995b293c71d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:37:27.118186 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b54c43-eb79-43c2-a2de-995b293c71d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:37:27.118494 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b54c43-eb79-43c2-a2de-995b293c71d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:37:27.119657 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b54c43-eb79-43c2-a2de-995b293c71d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:37:27.121263 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b54c43-eb79-43c2-a2de-995b293c71d7 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:37:27.131158 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1282/2586] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:37:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:37:27.135891 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f269c37f-6ce2-4148-8187-20d6445f6159 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:37:27.145843 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f269c37f-6ce2-4148-8187-20d6445f6159 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:37:27.150643 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0749810-541f-41b6-96fb-12c6176b0720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:37:27.151264 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0749810-541f-41b6-96fb-12c6176b0720 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:37:27.151539 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0749810-541f-41b6-96fb-12c6176b0720 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:37:27.151803 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0749810-541f-41b6-96fb-12c6176b0720 admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:37:27.152457 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0749810-541f-41b6-96fb-12c6176b0720 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:37:27.154039 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0749810-541f-41b6-96fb-12c6176b0720 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:37:27.164079 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1305/2587] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:37:27 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:37:27.168177 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b54c43-eb79-43c2-a2de-995b293c71d7 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:37:27.178124 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b54c43-eb79-43c2-a2de-995b293c71d7 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:37:27.183432 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dc1f86-b299-4195-9c31-93ac50815baa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:37:27.184077 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dc1f86-b299-4195-9c31-93ac50815baa admin admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:37:27.184358 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dc1f86-b299-4195-9c31-93ac50815baa admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:37:27.184635 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dc1f86-b299-4195-9c31-93ac50815baa admin admin] PATH_INFO: `/v3/projects/ec949b02ece54f6a94dd8e0d948b68c4/users/e1673e2078ca403394621c7b031daefd/roles/b38e84bf077846ee802e6bb1bad83522` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:37:27.200273 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dc1f86-b299-4195-9c31-93ac50815baa admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec949b02ece54f6a94dd8e0d948b68c4, user_id=e1673e2078ca403394621c7b031daefd, role_id=b38e84bf077846ee802e6bb1bad83522)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:37:27.203013 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dc1f86-b299-4195-9c31-93ac50815baa admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:37:27.216603 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1283/2588] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 16:37:27 2022] PUT /identity/v3/projects/ec949b02ece54f6a94dd8e0d948b68c4/users/e1673e2078ca403394621c7b031daefd/roles/b38e84bf077846ee802e6bb1bad83522 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:37:27.226809 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36caaff-5ff7-4e66-a1a1-a0a507778a92 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:37:27.227170 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36caaff-5ff7-4e66-a1a1-a0a507778a92 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:37:27.227511 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36caaff-5ff7-4e66-a1a1-a0a507778a92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:37:27.235602 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:37:27.258706 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-b36caaff-5ff7-4e66-a1a1-a0a507778a92 None None] MFA Rules not processed for user `e1673e2078ca403394621c7b031daefd`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:37:27.260570 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-b36caaff-5ff7-4e66-a1a1-a0a507778a92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:37:27.336110 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1306/2589] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:37:27 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:37:27.347681 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dc1f86-b299-4195-9c31-93ac50815baa admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:37:27.349378 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-28dc1f86-b299-4195-9c31-93ac50815baa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:37:27.405115 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dc1f86-b299-4195-9c31-93ac50815baa admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:37:27.408765 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b2d65f-8bc4-46ee-8b5a-da22477f67b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8078e791ba68460f8b3aeafb4b79b73a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:37:27.409351 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b2d65f-8bc4-46ee-8b5a-da22477f67b0 service cinder] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:37:27.409630 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b2d65f-8bc4-46ee-8b5a-da22477f67b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:37:27.409900 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b2d65f-8bc4-46ee-8b5a-da22477f67b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:37:27.418494 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b2d65f-8bc4-46ee-8b5a-da22477f67b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:37:27.419911 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b2d65f-8bc4-46ee-8b5a-da22477f67b0 service cinder] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:37:27.428479 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1284/2590] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:37:27 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:37:30.712963 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4be66de-a5e8-4524-8758-3d25716db5df None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:37:30.713456 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4be66de-a5e8-4524-8758-3d25716db5df None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:37:30.713561 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4be66de-a5e8-4524-8758-3d25716db5df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:37:30.732209 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-d4be66de-a5e8-4524-8758-3d25716db5df None None] MFA Rules not processed for user `b9d05f3782d24127aa613c8d7ac8041b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:37:30.733396 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-d4be66de-a5e8-4524-8758-3d25716db5df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:37:30.787660 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1307/2591] 10.222.0.27 () {58 vars in 967 bytes} [Fri Sep 9 16:37:30 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:37:30.800139 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b2d65f-8bc4-46ee-8b5a-da22477f67b0 service cinder] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:37:30.801529 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-05b2d65f-8bc4-46ee-8b5a-da22477f67b0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:37:30.880265 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:37:30.880265 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b2d65f-8bc4-46ee-8b5a-da22477f67b0 service cinder] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:37:30.888701 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da51b9e0-3032-490c-8152-74a64ee7727e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2350bbc4a194c2dab2e3be830fd0eba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:37:30.889307 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da51b9e0-3032-490c-8152-74a64ee7727e service swift] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:37:30.889581 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da51b9e0-3032-490c-8152-74a64ee7727e service swift] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:37:30.889846 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da51b9e0-3032-490c-8152-74a64ee7727e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:37:30.899836 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da51b9e0-3032-490c-8152-74a64ee7727e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:37:30.900197 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da51b9e0-3032-490c-8152-74a64ee7727e service swift] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:37:30.908356 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1285/2592] 10.222.0.27 () {60 vars in 1384 bytes} [Fri Sep 9 16:37:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 09 16:37:36.609933 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4be66de-a5e8-4524-8758-3d25716db5df None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:37:36.612021 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-d4be66de-a5e8-4524-8758-3d25716db5df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:37:36.711865 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4be66de-a5e8-4524-8758-3d25716db5df None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:37:36.720020 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca883174-ded8-483f-be91-18b241ffcfec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a332b9b4980646a3b14633293f77b505', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:37:36.720661 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca883174-ded8-483f-be91-18b241ffcfec service nova] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:37:36.720939 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca883174-ded8-483f-be91-18b241ffcfec service nova] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:37:36.721223 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca883174-ded8-483f-be91-18b241ffcfec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:37:36.724036 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-ca883174-ded8-483f-be91-18b241ffcfec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:37:36.744485 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca883174-ded8-483f-be91-18b241ffcfec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:37:36.746659 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca883174-ded8-483f-be91-18b241ffcfec service nova] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:37:36.763930 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1308/2593] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:37:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:37:38.969589 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da51b9e0-3032-490c-8152-74a64ee7727e service swift] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:37:39.029583 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da51b9e0-3032-490c-8152-74a64ee7727e service swift] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:37:39.034040 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf22040-8871-400c-909c-5d822a4a61f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:37:39.034677 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf22040-8871-400c-909c-5d822a4a61f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:37:39.034951 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf22040-8871-400c-909c-5d822a4a61f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:37:39.035216 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf22040-8871-400c-909c-5d822a4a61f3 admin admin] PATH_INFO: `/v3/users/e1673e2078ca403394621c7b031daefd` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:37:39.036300 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf22040-8871-400c-909c-5d822a4a61f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1673e2078ca403394621c7b031daefd)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:37:39.038193 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf22040-8871-400c-909c-5d822a4a61f3 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:37:39.082338 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-4bf22040-8871-400c-909c-5d822a4a61f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1673e2078ca403394621c7b031daefd'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:37:39.089401 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-4bf22040-8871-400c-909c-5d822a4a61f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1673e2078ca403394621c7b031daefd'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:37:39.090025 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-4bf22040-8871-400c-909c-5d822a4a61f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1673e2078ca403394621c7b031daefd'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:37:39.096691 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-4bf22040-8871-400c-909c-5d822a4a61f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1673e2078ca403394621c7b031daefd'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:37:39.109924 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-4bf22040-8871-400c-909c-5d822a4a61f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1673e2078ca403394621c7b031daefd'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:37:39.115696 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1286/2594] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 16:37:38 2022] DELETE /identity/v3/users/e1673e2078ca403394621c7b031daefd => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:37:39.120828 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8a8419-91d5-4df0-b425-d97cc4b78032 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:37:39.121314 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8a8419-91d5-4df0-b425-d97cc4b78032 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:37:39.121446 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8a8419-91d5-4df0-b425-d97cc4b78032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:37:39.140362 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-5e8a8419-91d5-4df0-b425-d97cc4b78032 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:37:39.141541 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-5e8a8419-91d5-4df0-b425-d97cc4b78032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:37:39.159028 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:37:39.198838 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1309/2595] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:37:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:37:39.208471 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf22040-8871-400c-909c-5d822a4a61f3 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:37:39.209847 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-4bf22040-8871-400c-909c-5d822a4a61f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:37:39.271459 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf22040-8871-400c-909c-5d822a4a61f3 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:37:39.274960 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685236dd-f162-4318-acb7-91fb8c64e76e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f44bfdd5214e8d84a2c0a5b1fd9b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:37:39.275570 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685236dd-f162-4318-acb7-91fb8c64e76e service neutron] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:37:39.275847 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685236dd-f162-4318-acb7-91fb8c64e76e service neutron] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:37:39.276118 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685236dd-f162-4318-acb7-91fb8c64e76e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:37:39.287313 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685236dd-f162-4318-acb7-91fb8c64e76e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:37:39.288836 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685236dd-f162-4318-acb7-91fb8c64e76e service neutron] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:37:39.299412 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1287/2596] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:37:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:37:39.581452 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8a8419-91d5-4df0-b425-d97cc4b78032 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:37:39.582886 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-5e8a8419-91d5-4df0-b425-d97cc4b78032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:37:39.594631 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8a8419-91d5-4df0-b425-d97cc4b78032 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:37:39.599397 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0b4dee-710f-455d-a645-7cce8537b225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:37:39.600023 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0b4dee-710f-455d-a645-7cce8537b225 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:37:39.600306 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0b4dee-710f-455d-a645-7cce8537b225 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:37:39.600572 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0b4dee-710f-455d-a645-7cce8537b225 admin admin] PATH_INFO: `/v3/projects/ec949b02ece54f6a94dd8e0d948b68c4` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:37:39.601681 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0b4dee-710f-455d-a645-7cce8537b225 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec949b02ece54f6a94dd8e0d948b68c4)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:37:39.604116 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0b4dee-710f-455d-a645-7cce8537b225 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:37:39.650880 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-3d0b4dee-710f-455d-a645-7cce8537b225 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec949b02ece54f6a94dd8e0d948b68c4', 'request_id': 'req-3d0b4dee-710f-455d-a645-7cce8537b225'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:37:39.656431 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-3d0b4dee-710f-455d-a645-7cce8537b225 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec949b02ece54f6a94dd8e0d948b68c4', 'request_id': 'req-3d0b4dee-710f-455d-a645-7cce8537b225'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:37:39.663983 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-3d0b4dee-710f-455d-a645-7cce8537b225 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec949b02ece54f6a94dd8e0d948b68c4', 'request_id': 'req-3d0b4dee-710f-455d-a645-7cce8537b225'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:37:39.675851 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-3d0b4dee-710f-455d-a645-7cce8537b225 admin admin] The token cache is being invalidate because project ec949b02ece54f6a94dd8e0d948b68c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81446) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 16:37:39.676132 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-3d0b4dee-710f-455d-a645-7cce8537b225 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:37:39.676750 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-3d0b4dee-710f-455d-a645-7cce8537b225 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:37:39.678197 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1310/2597] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 16:37:39 2022] DELETE /identity/v3/projects/ec949b02ece54f6a94dd8e0d948b68c4 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:37:39.683564 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909f0af7-6e49-4abc-826b-b5951dc4e72d None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:37:39.683844 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909f0af7-6e49-4abc-826b-b5951dc4e72d None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:37:39.684113 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909f0af7-6e49-4abc-826b-b5951dc4e72d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:37:39.703749 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-909f0af7-6e49-4abc-826b-b5951dc4e72d None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:37:39.704934 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-909f0af7-6e49-4abc-826b-b5951dc4e72d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:37:39.709970 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:37:39.764160 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1288/2598] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:37:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:37:39.771687 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d270d272-7849-4e13-a56b-61890cbcfa40 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:37:39.771973 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d270d272-7849-4e13-a56b-61890cbcfa40 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:37:39.772237 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d270d272-7849-4e13-a56b-61890cbcfa40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:37:39.792343 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-d270d272-7849-4e13-a56b-61890cbcfa40 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:37:39.793516 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-d270d272-7849-4e13-a56b-61890cbcfa40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:37:39.801095 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1311/2599] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:37:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:37:39.805086 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909f0af7-6e49-4abc-826b-b5951dc4e72d None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:37:39.814597 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909f0af7-6e49-4abc-826b-b5951dc4e72d None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:37:39.819088 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4836b1-52c5-4d51-9cfd-d741bc8f63af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:37:39.819670 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4836b1-52c5-4d51-9cfd-d741bc8f63af admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:37:39.819945 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4836b1-52c5-4d51-9cfd-d741bc8f63af admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:37:39.820212 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4836b1-52c5-4d51-9cfd-d741bc8f63af admin admin] PATH_INFO: `/v3/domains` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:37:39.820840 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4836b1-52c5-4d51-9cfd-d741bc8f63af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:37:39.821140 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4836b1-52c5-4d51-9cfd-d741bc8f63af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:37:39.823091 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4836b1-52c5-4d51-9cfd-d741bc8f63af admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:37:39.835587 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1289/2600] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Sep 9 16:37:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 16:37:39.840254 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d270d272-7849-4e13-a56b-61890cbcfa40 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:37:39.849132 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d270d272-7849-4e13-a56b-61890cbcfa40 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:37:39.854376 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ce56a1-ac4f-4fbb-a464-9e1ab760197b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:37:39.854989 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ce56a1-ac4f-4fbb-a464-9e1ab760197b admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:37:39.855271 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ce56a1-ac4f-4fbb-a464-9e1ab760197b admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:37:39.855534 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ce56a1-ac4f-4fbb-a464-9e1ab760197b admin admin] PATH_INFO: `/v3/projects` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:37:39.856308 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ce56a1-ac4f-4fbb-a464-9e1ab760197b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:37:39.858191 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ce56a1-ac4f-4fbb-a464-9e1ab760197b admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:37:39.884990 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1312/2601] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 16:37:39 2022] POST /identity/v3/projects => generated 373 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:37:39.889155 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4836b1-52c5-4d51-9cfd-d741bc8f63af admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:37:39.899057 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4836b1-52c5-4d51-9cfd-d741bc8f63af admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:37:39.954035 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d29eeea-fb39-48d4-9f2d-a24bc529acaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:37:39.954706 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d29eeea-fb39-48d4-9f2d-a24bc529acaa admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:37:39.955035 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d29eeea-fb39-48d4-9f2d-a24bc529acaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:37:39.955438 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d29eeea-fb39-48d4-9f2d-a24bc529acaa admin admin] PATH_INFO: `/v3/users` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:37:39.956246 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d29eeea-fb39-48d4-9f2d-a24bc529acaa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:37:39.958740 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d29eeea-fb39-48d4-9f2d-a24bc529acaa admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:37:39.980456 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1290/2602] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 16:37:39 2022] POST /identity/v3/users => generated 287 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:37:39.984566 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ce56a1-ac4f-4fbb-a464-9e1ab760197b admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:37:39.994821 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ce56a1-ac4f-4fbb-a464-9e1ab760197b admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:37:39.999334 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9709a1c-38b4-4ac9-9ce9-be7fd4e2e9eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:37:39.999946 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9709a1c-38b4-4ac9-9ce9-be7fd4e2e9eb admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:37:40.000219 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9709a1c-38b4-4ac9-9ce9-be7fd4e2e9eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:37:40.000482 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9709a1c-38b4-4ac9-9ce9-be7fd4e2e9eb admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:37:40.001106 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9709a1c-38b4-4ac9-9ce9-be7fd4e2e9eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:37:40.002743 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9709a1c-38b4-4ac9-9ce9-be7fd4e2e9eb admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:37:40.012462 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1313/2603] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:37:39 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:37:40.016448 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d29eeea-fb39-48d4-9f2d-a24bc529acaa admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:37:40.026944 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d29eeea-fb39-48d4-9f2d-a24bc529acaa admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:37:40.031635 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37c916a-829c-4a4e-8de4-72a62c91da69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:37:40.032216 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37c916a-829c-4a4e-8de4-72a62c91da69 admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:37:40.032502 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37c916a-829c-4a4e-8de4-72a62c91da69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:37:40.032774 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37c916a-829c-4a4e-8de4-72a62c91da69 admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:37:40.033401 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37c916a-829c-4a4e-8de4-72a62c91da69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:37:40.035060 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37c916a-829c-4a4e-8de4-72a62c91da69 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:37:40.046041 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1291/2604] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:37:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:37:40.050195 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9709a1c-38b4-4ac9-9ce9-be7fd4e2e9eb admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:37:40.059826 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9709a1c-38b4-4ac9-9ce9-be7fd4e2e9eb admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:37:40.064364 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609257c9-d431-43f4-a534-e5173d3a4719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:37:40.064986 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609257c9-d431-43f4-a534-e5173d3a4719 admin admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:37:40.065259 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609257c9-d431-43f4-a534-e5173d3a4719 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:37:40.065522 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609257c9-d431-43f4-a534-e5173d3a4719 admin admin] PATH_INFO: `/v3/projects/af4d15a07e394357acf154efe4942d7a/users/7c83b234e0704494b54835d2188881f5/roles/b38e84bf077846ee802e6bb1bad83522` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:37:40.080533 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609257c9-d431-43f4-a534-e5173d3a4719 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af4d15a07e394357acf154efe4942d7a, user_id=7c83b234e0704494b54835d2188881f5, role_id=b38e84bf077846ee802e6bb1bad83522)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:37:40.083209 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609257c9-d431-43f4-a534-e5173d3a4719 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:37:40.095956 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1314/2605] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 16:37:40 2022] PUT /identity/v3/projects/af4d15a07e394357acf154efe4942d7a/users/7c83b234e0704494b54835d2188881f5/roles/b38e84bf077846ee802e6bb1bad83522 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:37:40.105877 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adad9c9-8246-4997-ba18-8a32da6cf838 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:37:40.106197 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adad9c9-8246-4997-ba18-8a32da6cf838 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:37:40.106527 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adad9c9-8246-4997-ba18-8a32da6cf838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:37:40.133762 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-0adad9c9-8246-4997-ba18-8a32da6cf838 None None] MFA Rules not processed for user `7c83b234e0704494b54835d2188881f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:37:40.135511 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-0adad9c9-8246-4997-ba18-8a32da6cf838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:37:40.200547 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1292/2606] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:37:40 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:37:40.211962 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609257c9-d431-43f4-a534-e5173d3a4719 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:37:40.214208 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-609257c9-d431-43f4-a534-e5173d3a4719 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:37:40.260200 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:37:40.277602 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609257c9-d431-43f4-a534-e5173d3a4719 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:37:40.281207 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6c4de8-81fd-4e8a-ad8c-59b509b56ec0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8078e791ba68460f8b3aeafb4b79b73a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:37:40.281816 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6c4de8-81fd-4e8a-ad8c-59b509b56ec0 service cinder] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:37:40.282091 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6c4de8-81fd-4e8a-ad8c-59b509b56ec0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:37:40.282404 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6c4de8-81fd-4e8a-ad8c-59b509b56ec0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:37:40.291100 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6c4de8-81fd-4e8a-ad8c-59b509b56ec0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:37:40.292506 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6c4de8-81fd-4e8a-ad8c-59b509b56ec0 service cinder] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:37:40.301228 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1315/2607] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:37:40 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 16:37:40.325677 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adad9c9-8246-4997-ba18-8a32da6cf838 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:37:40.334524 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:37:40.387806 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adad9c9-8246-4997-ba18-8a32da6cf838 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:37:40.392233 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0990b43e-1df6-4f77-ad0f-1183d1672a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:37:40.392847 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0990b43e-1df6-4f77-ad0f-1183d1672a96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:37:40.393153 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0990b43e-1df6-4f77-ad0f-1183d1672a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:37:40.393422 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0990b43e-1df6-4f77-ad0f-1183d1672a96 admin admin] PATH_INFO: `/v3/users/7c83b234e0704494b54835d2188881f5` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:37:40.394669 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0990b43e-1df6-4f77-ad0f-1183d1672a96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c83b234e0704494b54835d2188881f5)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:37:40.396667 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0990b43e-1df6-4f77-ad0f-1183d1672a96 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:37:40.442496 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-0990b43e-1df6-4f77-ad0f-1183d1672a96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c83b234e0704494b54835d2188881f5'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:37:40.451667 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-0990b43e-1df6-4f77-ad0f-1183d1672a96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c83b234e0704494b54835d2188881f5'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:37:40.451667 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-0990b43e-1df6-4f77-ad0f-1183d1672a96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c83b234e0704494b54835d2188881f5'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:37:40.462100 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-0990b43e-1df6-4f77-ad0f-1183d1672a96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c83b234e0704494b54835d2188881f5'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:37:40.474659 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-0990b43e-1df6-4f77-ad0f-1183d1672a96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c83b234e0704494b54835d2188881f5'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:37:40.481364 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1293/2608] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 16:37:40 2022] DELETE /identity/v3/users/7c83b234e0704494b54835d2188881f5 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:37:40.485876 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2a2701-e309-4995-94c8-bfb626339ec2 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:37:40.486191 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2a2701-e309-4995-94c8-bfb626339ec2 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:37:40.486486 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2a2701-e309-4995-94c8-bfb626339ec2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:37:40.509273 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-7e2a2701-e309-4995-94c8-bfb626339ec2 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:37:40.510603 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-7e2a2701-e309-4995-94c8-bfb626339ec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:37:40.573427 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1316/2609] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:37:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 16:37:40.583658 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0990b43e-1df6-4f77-ad0f-1183d1672a96 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:37:40.585203 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-0990b43e-1df6-4f77-ad0f-1183d1672a96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:37:40.647737 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0990b43e-1df6-4f77-ad0f-1183d1672a96 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:37:40.652257 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3112ce37-1695-4445-9848-ae4cd7a7a411 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f44bfdd5214e8d84a2c0a5b1fd9b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:37:40.652916 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3112ce37-1695-4445-9848-ae4cd7a7a411 service neutron] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:37:40.653196 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3112ce37-1695-4445-9848-ae4cd7a7a411 service neutron] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:37:40.653464 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3112ce37-1695-4445-9848-ae4cd7a7a411 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:37:40.662823 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3112ce37-1695-4445-9848-ae4cd7a7a411 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:37:40.664327 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3112ce37-1695-4445-9848-ae4cd7a7a411 service neutron] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:37:40.675294 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1294/2610] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:37:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:37:40.953811 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2a2701-e309-4995-94c8-bfb626339ec2 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:37:40.955257 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-7e2a2701-e309-4995-94c8-bfb626339ec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:37:40.969062 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2a2701-e309-4995-94c8-bfb626339ec2 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:37:40.973641 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e158d9-572d-4a87-9144-46badde232dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:37:40.974229 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e158d9-572d-4a87-9144-46badde232dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:37:40.974496 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e158d9-572d-4a87-9144-46badde232dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:37:40.974761 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e158d9-572d-4a87-9144-46badde232dd admin admin] PATH_INFO: `/v3/projects/af4d15a07e394357acf154efe4942d7a` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:37:40.975994 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e158d9-572d-4a87-9144-46badde232dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=af4d15a07e394357acf154efe4942d7a)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:37:40.977956 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e158d9-572d-4a87-9144-46badde232dd admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:37:41.023813 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-10e158d9-572d-4a87-9144-46badde232dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af4d15a07e394357acf154efe4942d7a', 'request_id': 'req-10e158d9-572d-4a87-9144-46badde232dd'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:37:41.029908 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-10e158d9-572d-4a87-9144-46badde232dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af4d15a07e394357acf154efe4942d7a', 'request_id': 'req-10e158d9-572d-4a87-9144-46badde232dd'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:37:41.037808 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-10e158d9-572d-4a87-9144-46badde232dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af4d15a07e394357acf154efe4942d7a', 'request_id': 'req-10e158d9-572d-4a87-9144-46badde232dd'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:37:41.049204 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-10e158d9-572d-4a87-9144-46badde232dd admin admin] The token cache is being invalidate because project af4d15a07e394357acf154efe4942d7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81446) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 16:37:41.049494 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-10e158d9-572d-4a87-9144-46badde232dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:37:41.050115 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-10e158d9-572d-4a87-9144-46badde232dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:37:41.051614 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1317/2611] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 16:37:40 2022] DELETE /identity/v3/projects/af4d15a07e394357acf154efe4942d7a => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:37:41.056422 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67fc3a9-e3d3-40a6-80a2-7597436d1163 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:37:41.056897 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67fc3a9-e3d3-40a6-80a2-7597436d1163 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:37:41.057016 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67fc3a9-e3d3-40a6-80a2-7597436d1163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:37:41.077403 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-a67fc3a9-e3d3-40a6-80a2-7597436d1163 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:37:41.078641 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-a67fc3a9-e3d3-40a6-80a2-7597436d1163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:37:41.102331 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:37:41.138066 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1295/2612] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:37:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:37:41.146934 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d275795-a8e5-42c8-92e1-7de23b886b49 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:37:41.147224 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d275795-a8e5-42c8-92e1-7de23b886b49 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:37:41.147501 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d275795-a8e5-42c8-92e1-7de23b886b49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:37:41.170217 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-6d275795-a8e5-42c8-92e1-7de23b886b49 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:37:41.171463 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-6d275795-a8e5-42c8-92e1-7de23b886b49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:37:41.179391 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1318/2613] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:37:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:37:41.184204 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67fc3a9-e3d3-40a6-80a2-7597436d1163 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:37:41.193972 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67fc3a9-e3d3-40a6-80a2-7597436d1163 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:37:41.199535 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67bf7e2-d1c4-499e-ae4a-3c94406e7079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:37:41.200125 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67bf7e2-d1c4-499e-ae4a-3c94406e7079 admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:37:41.200397 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67bf7e2-d1c4-499e-ae4a-3c94406e7079 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:37:41.200663 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67bf7e2-d1c4-499e-ae4a-3c94406e7079 admin admin] PATH_INFO: `/v3/domains` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:37:41.201291 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67bf7e2-d1c4-499e-ae4a-3c94406e7079 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:37:41.201588 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67bf7e2-d1c4-499e-ae4a-3c94406e7079 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:37:41.203209 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67bf7e2-d1c4-499e-ae4a-3c94406e7079 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:37:41.214920 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1296/2614] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Sep 9 16:37:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:37:41.219237 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d275795-a8e5-42c8-92e1-7de23b886b49 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:37:41.228833 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d275795-a8e5-42c8-92e1-7de23b886b49 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:37:41.233425 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e456623c-3c13-4b88-8d80-6493f4e5b12e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:37:41.234016 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e456623c-3c13-4b88-8d80-6493f4e5b12e admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:37:41.234292 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e456623c-3c13-4b88-8d80-6493f4e5b12e admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:37:41.234592 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e456623c-3c13-4b88-8d80-6493f4e5b12e admin admin] PATH_INFO: `/v3/projects` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:37:41.235219 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e456623c-3c13-4b88-8d80-6493f4e5b12e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:37:41.237097 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e456623c-3c13-4b88-8d80-6493f4e5b12e admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:37:41.264518 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1319/2615] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 16:37:41 2022] POST /identity/v3/projects => generated 399 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 16:37:41.268769 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67bf7e2-d1c4-499e-ae4a-3c94406e7079 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:37:41.278907 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67bf7e2-d1c4-499e-ae4a-3c94406e7079 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:37:41.340115 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643360ab-dfb9-48c3-aefd-2b0d6f569ced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:37:41.340714 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643360ab-dfb9-48c3-aefd-2b0d6f569ced admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:37:41.340997 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643360ab-dfb9-48c3-aefd-2b0d6f569ced admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:37:41.341291 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643360ab-dfb9-48c3-aefd-2b0d6f569ced admin admin] PATH_INFO: `/v3/users` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:37:41.341902 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643360ab-dfb9-48c3-aefd-2b0d6f569ced admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:37:41.343863 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643360ab-dfb9-48c3-aefd-2b0d6f569ced admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:37:41.364875 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1297/2616] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 16:37:41 2022] POST /identity/v3/users => generated 300 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 16:37:41.369601 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e456623c-3c13-4b88-8d80-6493f4e5b12e admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:37:41.379708 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e456623c-3c13-4b88-8d80-6493f4e5b12e admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:37:41.384183 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec376bc-1038-4c1a-bd2b-5eed5ce51ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:37:41.385429 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec376bc-1038-4c1a-bd2b-5eed5ce51ee5 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:37:41.385703 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec376bc-1038-4c1a-bd2b-5eed5ce51ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:37:41.385965 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec376bc-1038-4c1a-bd2b-5eed5ce51ee5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:37:41.386653 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec376bc-1038-4c1a-bd2b-5eed5ce51ee5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:37:41.388238 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec376bc-1038-4c1a-bd2b-5eed5ce51ee5 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:37:41.397902 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1320/2617] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:37:41 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:37:41.401732 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643360ab-dfb9-48c3-aefd-2b0d6f569ced admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:37:41.411488 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643360ab-dfb9-48c3-aefd-2b0d6f569ced admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:37:41.416023 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529b18b4-1881-4ef8-93d7-8b75fd72d5ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:37:41.416599 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529b18b4-1881-4ef8-93d7-8b75fd72d5ea admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:37:41.416872 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529b18b4-1881-4ef8-93d7-8b75fd72d5ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:37:41.417138 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529b18b4-1881-4ef8-93d7-8b75fd72d5ea admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:37:41.417751 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529b18b4-1881-4ef8-93d7-8b75fd72d5ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:37:41.419363 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529b18b4-1881-4ef8-93d7-8b75fd72d5ea admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:37:41.429632 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1298/2618] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:37:41 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:37:41.434007 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec376bc-1038-4c1a-bd2b-5eed5ce51ee5 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:37:41.443544 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec376bc-1038-4c1a-bd2b-5eed5ce51ee5 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:37:41.448910 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e51a325-cca2-41dd-a063-8f8a32e92155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:37:41.449531 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e51a325-cca2-41dd-a063-8f8a32e92155 admin admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:37:41.449806 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e51a325-cca2-41dd-a063-8f8a32e92155 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:37:41.450083 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e51a325-cca2-41dd-a063-8f8a32e92155 admin admin] PATH_INFO: `/v3/projects/956cffb8ef834fa4b1bf6f09760d8717/users/0922d1d48fdd4a8b89cb93deddd0fc3f/roles/b38e84bf077846ee802e6bb1bad83522` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:37:41.464054 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e51a325-cca2-41dd-a063-8f8a32e92155 admin admin] RBAC: Authorizing `identity:create_grant(project_id=956cffb8ef834fa4b1bf6f09760d8717, user_id=0922d1d48fdd4a8b89cb93deddd0fc3f, role_id=b38e84bf077846ee802e6bb1bad83522)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:37:41.466671 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e51a325-cca2-41dd-a063-8f8a32e92155 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:37:41.479257 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1321/2619] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 16:37:41 2022] PUT /identity/v3/projects/956cffb8ef834fa4b1bf6f09760d8717/users/0922d1d48fdd4a8b89cb93deddd0fc3f/roles/b38e84bf077846ee802e6bb1bad83522 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:37:41.489262 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199dbeb8-9909-4af7-a0c1-3a6b501a77a8 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:37:41.489545 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199dbeb8-9909-4af7-a0c1-3a6b501a77a8 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:37:41.489814 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199dbeb8-9909-4af7-a0c1-3a6b501a77a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:37:41.519703 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-199dbeb8-9909-4af7-a0c1-3a6b501a77a8 None None] MFA Rules not processed for user `0922d1d48fdd4a8b89cb93deddd0fc3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:37:41.520927 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-199dbeb8-9909-4af7-a0c1-3a6b501a77a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:37:41.584449 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1299/2620] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:37:41 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:37:41.595614 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e51a325-cca2-41dd-a063-8f8a32e92155 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:37:41.597281 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-4e51a325-cca2-41dd-a063-8f8a32e92155 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:37:41.607819 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:37:41.662536 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e51a325-cca2-41dd-a063-8f8a32e92155 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:37:41.668292 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87d7240-bf1b-4ee2-befb-72f2b4074d94 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8078e791ba68460f8b3aeafb4b79b73a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:37:41.668891 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87d7240-bf1b-4ee2-befb-72f2b4074d94 service cinder] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:37:41.669164 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87d7240-bf1b-4ee2-befb-72f2b4074d94 service cinder] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:37:41.669428 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87d7240-bf1b-4ee2-befb-72f2b4074d94 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:37:41.678537 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87d7240-bf1b-4ee2-befb-72f2b4074d94 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:37:41.680083 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87d7240-bf1b-4ee2-befb-72f2b4074d94 service cinder] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:37:41.689518 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1322/2621] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:37:41 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:37:41.711951 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199dbeb8-9909-4af7-a0c1-3a6b501a77a8 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:37:41.713358 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-199dbeb8-9909-4af7-a0c1-3a6b501a77a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:37:41.741538 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:37:41.776599 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199dbeb8-9909-4af7-a0c1-3a6b501a77a8 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:37:41.780617 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740f8a95-5654-4e44-8f0c-79d08b45b839 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f44bfdd5214e8d84a2c0a5b1fd9b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:37:41.781399 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740f8a95-5654-4e44-8f0c-79d08b45b839 service neutron] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:37:41.781797 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740f8a95-5654-4e44-8f0c-79d08b45b839 service neutron] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:37:41.782119 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740f8a95-5654-4e44-8f0c-79d08b45b839 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:37:41.783999 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-740f8a95-5654-4e44-8f0c-79d08b45b839 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:37:41.849275 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740f8a95-5654-4e44-8f0c-79d08b45b839 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:37:41.850752 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740f8a95-5654-4e44-8f0c-79d08b45b839 service neutron] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:37:41.860930 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1300/2622] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:37:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:37:45.096931 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87d7240-bf1b-4ee2-befb-72f2b4074d94 service cinder] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:37:45.098658 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-c87d7240-bf1b-4ee2-befb-72f2b4074d94 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:37:45.125302 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87d7240-bf1b-4ee2-befb-72f2b4074d94 service cinder] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:37:45.134249 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77964a78-b027-4838-ac1e-012c90d849c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:37:45.135523 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77964a78-b027-4838-ac1e-012c90d849c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:37:45.135803 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77964a78-b027-4838-ac1e-012c90d849c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:37:45.136077 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77964a78-b027-4838-ac1e-012c90d849c1 admin admin] PATH_INFO: `/v3/users/8c3919b9f57e4604b89d3f6a2763b0b4` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:37:45.137361 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77964a78-b027-4838-ac1e-012c90d849c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c3919b9f57e4604b89d3f6a2763b0b4)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:37:45.139293 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77964a78-b027-4838-ac1e-012c90d849c1 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:37:45.185847 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-77964a78-b027-4838-ac1e-012c90d849c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c3919b9f57e4604b89d3f6a2763b0b4'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:37:45.192740 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-77964a78-b027-4838-ac1e-012c90d849c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c3919b9f57e4604b89d3f6a2763b0b4'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:37:45.205933 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-77964a78-b027-4838-ac1e-012c90d849c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c3919b9f57e4604b89d3f6a2763b0b4'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:37:45.213444 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-77964a78-b027-4838-ac1e-012c90d849c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c3919b9f57e4604b89d3f6a2763b0b4'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:37:45.214058 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-77964a78-b027-4838-ac1e-012c90d849c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c3919b9f57e4604b89d3f6a2763b0b4'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:37:45.219855 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1323/2623] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 16:37:45 2022] DELETE /identity/v3/users/8c3919b9f57e4604b89d3f6a2763b0b4 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:37:45.389954 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740f8a95-5654-4e44-8f0c-79d08b45b839 service neutron] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:37:45.400175 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740f8a95-5654-4e44-8f0c-79d08b45b839 service neutron] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:37:45.458611 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797826a8-ac14-4dfe-937b-59f0b14ec928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:37:45.459274 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797826a8-ac14-4dfe-937b-59f0b14ec928 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:37:45.459555 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797826a8-ac14-4dfe-937b-59f0b14ec928 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:37:45.459827 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797826a8-ac14-4dfe-937b-59f0b14ec928 admin admin] PATH_INFO: `/v3/projects/3a0f1f8ef18546cc958d4ce96d7a0cc2` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:37:45.460937 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797826a8-ac14-4dfe-937b-59f0b14ec928 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a0f1f8ef18546cc958d4ce96d7a0cc2)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:37:45.462972 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797826a8-ac14-4dfe-937b-59f0b14ec928 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:37:45.510673 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-797826a8-ac14-4dfe-937b-59f0b14ec928 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a0f1f8ef18546cc958d4ce96d7a0cc2', 'request_id': 'req-797826a8-ac14-4dfe-937b-59f0b14ec928'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:37:45.516794 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-797826a8-ac14-4dfe-937b-59f0b14ec928 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a0f1f8ef18546cc958d4ce96d7a0cc2', 'request_id': 'req-797826a8-ac14-4dfe-937b-59f0b14ec928'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:37:45.523865 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-797826a8-ac14-4dfe-937b-59f0b14ec928 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a0f1f8ef18546cc958d4ce96d7a0cc2', 'request_id': 'req-797826a8-ac14-4dfe-937b-59f0b14ec928'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:37:45.533775 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-797826a8-ac14-4dfe-937b-59f0b14ec928 admin admin] The token cache is being invalidate because project 3a0f1f8ef18546cc958d4ce96d7a0cc2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81445) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 16:37:45.534054 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-797826a8-ac14-4dfe-937b-59f0b14ec928 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:37:45.534687 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-797826a8-ac14-4dfe-937b-59f0b14ec928 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:37:45.536146 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1301/2624] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 16:37:45 2022] DELETE /identity/v3/projects/3a0f1f8ef18546cc958d4ce96d7a0cc2 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:37:45.541891 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbd2aa0-d0ba-4f33-8b19-f009bf6df293 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:37:45.542174 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbd2aa0-d0ba-4f33-8b19-f009bf6df293 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:37:45.542478 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbd2aa0-d0ba-4f33-8b19-f009bf6df293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:37:45.562647 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-fdbd2aa0-d0ba-4f33-8b19-f009bf6df293 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:37:45.563867 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-fdbd2aa0-d0ba-4f33-8b19-f009bf6df293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:37:45.625675 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1324/2625] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:37:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:37:45.633587 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a254a714-11c8-4465-a308-780d48cd5c50 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:37:45.633959 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a254a714-11c8-4465-a308-780d48cd5c50 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:37:45.634284 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a254a714-11c8-4465-a308-780d48cd5c50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:37:45.643245 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:37:45.655540 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-a254a714-11c8-4465-a308-780d48cd5c50 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:37:45.657255 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-a254a714-11c8-4465-a308-780d48cd5c50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:37:45.667076 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1302/2626] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:37:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 16:37:45.671608 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbd2aa0-d0ba-4f33-8b19-f009bf6df293 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:37:45.683234 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbd2aa0-d0ba-4f33-8b19-f009bf6df293 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:37:45.687857 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb821318-779a-4f19-ae6a-9002150fbdb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:37:45.688456 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb821318-779a-4f19-ae6a-9002150fbdb7 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:37:45.688734 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb821318-779a-4f19-ae6a-9002150fbdb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:37:45.688998 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb821318-779a-4f19-ae6a-9002150fbdb7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:37:45.689629 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb821318-779a-4f19-ae6a-9002150fbdb7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:37:45.689923 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb821318-779a-4f19-ae6a-9002150fbdb7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:37:45.691544 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb821318-779a-4f19-ae6a-9002150fbdb7 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:37:45.703486 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1325/2627] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Sep 9 16:37:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:37:45.708439 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a254a714-11c8-4465-a308-780d48cd5c50 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:37:45.718252 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a254a714-11c8-4465-a308-780d48cd5c50 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:37:45.722881 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855c0bd0-f89a-43b3-b721-2551f5b9058e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:37:45.723469 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855c0bd0-f89a-43b3-b721-2551f5b9058e admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:37:45.723743 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855c0bd0-f89a-43b3-b721-2551f5b9058e admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:37:45.724010 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855c0bd0-f89a-43b3-b721-2551f5b9058e admin admin] PATH_INFO: `/v3/projects` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:37:45.724622 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855c0bd0-f89a-43b3-b721-2551f5b9058e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:37:45.726543 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855c0bd0-f89a-43b3-b721-2551f5b9058e admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:37:45.755113 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1303/2628] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 16:37:45 2022] POST /identity/v3/projects => generated 383 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:37:45.759263 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb821318-779a-4f19-ae6a-9002150fbdb7 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:37:45.769205 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb821318-779a-4f19-ae6a-9002150fbdb7 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:37:45.774083 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:37:45.828967 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e063ecf6-f1bc-43fd-86b2-5ed8d3f6502e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:37:45.829488 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e063ecf6-f1bc-43fd-86b2-5ed8d3f6502e admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:37:45.829764 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e063ecf6-f1bc-43fd-86b2-5ed8d3f6502e admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:37:45.830031 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e063ecf6-f1bc-43fd-86b2-5ed8d3f6502e admin admin] PATH_INFO: `/v3/users` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:37:45.830704 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e063ecf6-f1bc-43fd-86b2-5ed8d3f6502e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:37:45.832596 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e063ecf6-f1bc-43fd-86b2-5ed8d3f6502e admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:37:45.852448 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1326/2629] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 16:37:45 2022] POST /identity/v3/users => generated 292 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:37:45.857201 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855c0bd0-f89a-43b3-b721-2551f5b9058e admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:37:45.867532 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855c0bd0-f89a-43b3-b721-2551f5b9058e admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:37:45.872369 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d913dca7-6cc5-4cc3-983a-25a1f4807ef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:37:45.872956 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d913dca7-6cc5-4cc3-983a-25a1f4807ef5 admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:37:45.873235 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d913dca7-6cc5-4cc3-983a-25a1f4807ef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:37:45.873508 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d913dca7-6cc5-4cc3-983a-25a1f4807ef5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:37:45.874133 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d913dca7-6cc5-4cc3-983a-25a1f4807ef5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:37:45.875769 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d913dca7-6cc5-4cc3-983a-25a1f4807ef5 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:37:45.885555 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1304/2630] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:37:45 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:37:45.889332 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e063ecf6-f1bc-43fd-86b2-5ed8d3f6502e admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:37:45.899184 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e063ecf6-f1bc-43fd-86b2-5ed8d3f6502e admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:37:45.904268 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ab7090-b15b-4d8c-a6c3-e175aafed4cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:37:45.904840 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ab7090-b15b-4d8c-a6c3-e175aafed4cb admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:37:45.905116 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ab7090-b15b-4d8c-a6c3-e175aafed4cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:37:45.905380 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ab7090-b15b-4d8c-a6c3-e175aafed4cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:37:45.905998 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ab7090-b15b-4d8c-a6c3-e175aafed4cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:37:45.907604 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ab7090-b15b-4d8c-a6c3-e175aafed4cb admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:37:45.918045 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1327/2631] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:37:45 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:37:45.922038 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d913dca7-6cc5-4cc3-983a-25a1f4807ef5 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:37:45.932385 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d913dca7-6cc5-4cc3-983a-25a1f4807ef5 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:37:45.937010 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f7c6c5-f43f-4d7e-92f4-70ed23072e1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:37:45.937640 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f7c6c5-f43f-4d7e-92f4-70ed23072e1d admin admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:37:45.937918 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f7c6c5-f43f-4d7e-92f4-70ed23072e1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:37:45.938195 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f7c6c5-f43f-4d7e-92f4-70ed23072e1d admin admin] PATH_INFO: `/v3/projects/5eada64591d64ee7b8a22e019c8c2b3b/users/b7e3d508dfaf46199f03f09acd9e7a8e/roles/b38e84bf077846ee802e6bb1bad83522` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:37:45.953432 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f7c6c5-f43f-4d7e-92f4-70ed23072e1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5eada64591d64ee7b8a22e019c8c2b3b, user_id=b7e3d508dfaf46199f03f09acd9e7a8e, role_id=b38e84bf077846ee802e6bb1bad83522)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:37:45.956114 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f7c6c5-f43f-4d7e-92f4-70ed23072e1d admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:37:45.968527 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1305/2632] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 16:37:45 2022] PUT /identity/v3/projects/5eada64591d64ee7b8a22e019c8c2b3b/users/b7e3d508dfaf46199f03f09acd9e7a8e/roles/b38e84bf077846ee802e6bb1bad83522 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:37:45.979730 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085e303d-e8d4-46d2-b476-9a7efd6d1fac None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:37:45.980015 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085e303d-e8d4-46d2-b476-9a7efd6d1fac None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:37:45.980287 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085e303d-e8d4-46d2-b476-9a7efd6d1fac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:37:46.007815 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-085e303d-e8d4-46d2-b476-9a7efd6d1fac None None] MFA Rules not processed for user `b7e3d508dfaf46199f03f09acd9e7a8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:37:46.009012 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-085e303d-e8d4-46d2-b476-9a7efd6d1fac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:37:46.071654 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1328/2633] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:37:45 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:37:46.083546 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f7c6c5-f43f-4d7e-92f4-70ed23072e1d admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:37:46.085168 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-49f7c6c5-f43f-4d7e-92f4-70ed23072e1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:37:46.159945 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f7c6c5-f43f-4d7e-92f4-70ed23072e1d admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:37:46.166570 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9ffee8-1412-4e50-838e-fd18f2a2c342 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a332b9b4980646a3b14633293f77b505', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:37:46.167175 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9ffee8-1412-4e50-838e-fd18f2a2c342 service nova] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:37:46.167456 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9ffee8-1412-4e50-838e-fd18f2a2c342 service nova] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:37:46.167726 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9ffee8-1412-4e50-838e-fd18f2a2c342 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:37:46.176090 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9ffee8-1412-4e50-838e-fd18f2a2c342 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:37:46.177681 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9ffee8-1412-4e50-838e-fd18f2a2c342 service nova] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:37:46.187787 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1306/2634] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:37:46 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:37:46.717698 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085e303d-e8d4-46d2-b476-9a7efd6d1fac None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:37:46.719097 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-085e303d-e8d4-46d2-b476-9a7efd6d1fac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:37:46.782478 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085e303d-e8d4-46d2-b476-9a7efd6d1fac None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:37:46.787087 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a579e9-1b6a-4e37-b181-320257ab8fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:37:46.787704 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a579e9-1b6a-4e37-b181-320257ab8fbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:37:46.787980 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a579e9-1b6a-4e37-b181-320257ab8fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:37:46.788248 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a579e9-1b6a-4e37-b181-320257ab8fbf admin admin] PATH_INFO: `/v3/users/0922d1d48fdd4a8b89cb93deddd0fc3f` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:37:46.789381 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a579e9-1b6a-4e37-b181-320257ab8fbf admin admin] RBAC: Authorizing `identity:delete_user(user_id=0922d1d48fdd4a8b89cb93deddd0fc3f)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:37:46.791321 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a579e9-1b6a-4e37-b181-320257ab8fbf admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:37:46.811880 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:37:46.838578 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-c7a579e9-1b6a-4e37-b181-320257ab8fbf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0922d1d48fdd4a8b89cb93deddd0fc3f'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:37:46.847681 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-c7a579e9-1b6a-4e37-b181-320257ab8fbf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0922d1d48fdd4a8b89cb93deddd0fc3f'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:37:46.859827 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-c7a579e9-1b6a-4e37-b181-320257ab8fbf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0922d1d48fdd4a8b89cb93deddd0fc3f'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:37:46.866906 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-c7a579e9-1b6a-4e37-b181-320257ab8fbf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0922d1d48fdd4a8b89cb93deddd0fc3f'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:37:46.867508 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-c7a579e9-1b6a-4e37-b181-320257ab8fbf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0922d1d48fdd4a8b89cb93deddd0fc3f'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:37:46.875170 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1329/2635] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 16:37:46 2022] DELETE /identity/v3/users/0922d1d48fdd4a8b89cb93deddd0fc3f => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:37:46.880070 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb467832-d0ee-4d56-8401-3f7ae43d3f48 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:37:46.880528 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb467832-d0ee-4d56-8401-3f7ae43d3f48 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:37:46.880623 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb467832-d0ee-4d56-8401-3f7ae43d3f48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:37:46.899676 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-cb467832-d0ee-4d56-8401-3f7ae43d3f48 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:37:46.901483 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-cb467832-d0ee-4d56-8401-3f7ae43d3f48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:37:46.962193 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1307/2636] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:37:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:37:46.973136 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a579e9-1b6a-4e37-b181-320257ab8fbf admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:37:46.974541 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-c7a579e9-1b6a-4e37-b181-320257ab8fbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:37:47.030561 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a579e9-1b6a-4e37-b181-320257ab8fbf admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:37:47.035492 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0bb033-77b4-4148-8ab1-484aa20ec933 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f44bfdd5214e8d84a2c0a5b1fd9b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:37:47.036200 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0bb033-77b4-4148-8ab1-484aa20ec933 service neutron] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:37:47.036485 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0bb033-77b4-4148-8ab1-484aa20ec933 service neutron] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:37:47.036754 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0bb033-77b4-4148-8ab1-484aa20ec933 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:37:47.045999 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0bb033-77b4-4148-8ab1-484aa20ec933 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:37:47.047455 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0bb033-77b4-4148-8ab1-484aa20ec933 service neutron] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:37:47.056789 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1330/2637] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:37:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:37:47.334754 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb467832-d0ee-4d56-8401-3f7ae43d3f48 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:37:47.336312 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-cb467832-d0ee-4d56-8401-3f7ae43d3f48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:37:47.348542 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb467832-d0ee-4d56-8401-3f7ae43d3f48 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:37:47.353096 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dab3bf-0403-482b-acf3-016f29a27e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:37:47.353708 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dab3bf-0403-482b-acf3-016f29a27e40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:37:47.353982 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dab3bf-0403-482b-acf3-016f29a27e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:37:47.354253 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dab3bf-0403-482b-acf3-016f29a27e40 admin admin] PATH_INFO: `/v3/projects/956cffb8ef834fa4b1bf6f09760d8717` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:37:47.355397 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dab3bf-0403-482b-acf3-016f29a27e40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=956cffb8ef834fa4b1bf6f09760d8717)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:37:47.357297 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dab3bf-0403-482b-acf3-016f29a27e40 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:37:47.380847 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:37:47.405038 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-b5dab3bf-0403-482b-acf3-016f29a27e40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '956cffb8ef834fa4b1bf6f09760d8717', 'request_id': 'req-b5dab3bf-0403-482b-acf3-016f29a27e40'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:37:47.411167 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-b5dab3bf-0403-482b-acf3-016f29a27e40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '956cffb8ef834fa4b1bf6f09760d8717', 'request_id': 'req-b5dab3bf-0403-482b-acf3-016f29a27e40'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:37:47.419774 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-b5dab3bf-0403-482b-acf3-016f29a27e40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '956cffb8ef834fa4b1bf6f09760d8717', 'request_id': 'req-b5dab3bf-0403-482b-acf3-016f29a27e40'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:37:47.430245 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-b5dab3bf-0403-482b-acf3-016f29a27e40 admin admin] The token cache is being invalidate because project 956cffb8ef834fa4b1bf6f09760d8717 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81445) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 16:37:47.430550 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-b5dab3bf-0403-482b-acf3-016f29a27e40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:37:47.431195 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-b5dab3bf-0403-482b-acf3-016f29a27e40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:37:47.432627 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1308/2638] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 16:37:47 2022] DELETE /identity/v3/projects/956cffb8ef834fa4b1bf6f09760d8717 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:37:51.368453 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0bb033-77b4-4148-8ab1-484aa20ec933 service neutron] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:37:51.368880 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-0c0bb033-77b4-4148-8ab1-484aa20ec933 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:37:51.381269 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0bb033-77b4-4148-8ab1-484aa20ec933 service neutron] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:37:51.436719 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d795673f-ded1-41ad-b2cd-5fd0391f811d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:37:51.437328 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d795673f-ded1-41ad-b2cd-5fd0391f811d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:37:51.437601 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d795673f-ded1-41ad-b2cd-5fd0391f811d admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:37:51.437869 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d795673f-ded1-41ad-b2cd-5fd0391f811d admin admin] PATH_INFO: `/v3/users/b7e3d508dfaf46199f03f09acd9e7a8e` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:37:51.438987 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d795673f-ded1-41ad-b2cd-5fd0391f811d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7e3d508dfaf46199f03f09acd9e7a8e)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:37:51.440865 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d795673f-ded1-41ad-b2cd-5fd0391f811d admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:37:51.481851 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:37:51.487491 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-d795673f-ded1-41ad-b2cd-5fd0391f811d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7e3d508dfaf46199f03f09acd9e7a8e'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:37:51.495304 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-d795673f-ded1-41ad-b2cd-5fd0391f811d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7e3d508dfaf46199f03f09acd9e7a8e'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:37:51.506959 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-d795673f-ded1-41ad-b2cd-5fd0391f811d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7e3d508dfaf46199f03f09acd9e7a8e'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:37:51.514451 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-d795673f-ded1-41ad-b2cd-5fd0391f811d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7e3d508dfaf46199f03f09acd9e7a8e'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:37:51.515066 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-d795673f-ded1-41ad-b2cd-5fd0391f811d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7e3d508dfaf46199f03f09acd9e7a8e'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:37:51.520936 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1331/2639] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 16:37:51 2022] DELETE /identity/v3/users/b7e3d508dfaf46199f03f09acd9e7a8e => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:37:51.525993 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e64538-ba8d-4a03-9c8f-590df2189683 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:37:51.526462 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e64538-ba8d-4a03-9c8f-590df2189683 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:37:51.526555 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e64538-ba8d-4a03-9c8f-590df2189683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:37:51.545689 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-a6e64538-ba8d-4a03-9c8f-590df2189683 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:37:51.546904 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-a6e64538-ba8d-4a03-9c8f-590df2189683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:37:51.603153 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1309/2640] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:37:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:37:51.612750 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d795673f-ded1-41ad-b2cd-5fd0391f811d admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:37:51.614163 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-d795673f-ded1-41ad-b2cd-5fd0391f811d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:37:51.670058 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d795673f-ded1-41ad-b2cd-5fd0391f811d admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:37:51.673668 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319dba0b-2b54-4d0a-b2aa-18ad9747717e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f44bfdd5214e8d84a2c0a5b1fd9b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:37:51.674254 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319dba0b-2b54-4d0a-b2aa-18ad9747717e service neutron] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:37:51.674558 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319dba0b-2b54-4d0a-b2aa-18ad9747717e service neutron] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:37:51.674827 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319dba0b-2b54-4d0a-b2aa-18ad9747717e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:37:51.684081 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319dba0b-2b54-4d0a-b2aa-18ad9747717e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:37:51.685489 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319dba0b-2b54-4d0a-b2aa-18ad9747717e service neutron] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:37:51.695066 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1332/2641] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:37:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:37:51.953275 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e64538-ba8d-4a03-9c8f-590df2189683 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:37:51.954775 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-a6e64538-ba8d-4a03-9c8f-590df2189683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:37:51.967462 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e64538-ba8d-4a03-9c8f-590df2189683 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:37:51.972314 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76b16ac-1540-4cdb-ad4f-eaa1bcfb51a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:37:51.972946 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76b16ac-1540-4cdb-ad4f-eaa1bcfb51a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:37:51.973225 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76b16ac-1540-4cdb-ad4f-eaa1bcfb51a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:37:51.973494 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76b16ac-1540-4cdb-ad4f-eaa1bcfb51a2 admin admin] PATH_INFO: `/v3/projects/5eada64591d64ee7b8a22e019c8c2b3b` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:37:51.974715 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76b16ac-1540-4cdb-ad4f-eaa1bcfb51a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5eada64591d64ee7b8a22e019c8c2b3b)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:37:51.976609 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76b16ac-1540-4cdb-ad4f-eaa1bcfb51a2 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:37:52.022518 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-c76b16ac-1540-4cdb-ad4f-eaa1bcfb51a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5eada64591d64ee7b8a22e019c8c2b3b', 'request_id': 'req-c76b16ac-1540-4cdb-ad4f-eaa1bcfb51a2'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:37:52.029311 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-c76b16ac-1540-4cdb-ad4f-eaa1bcfb51a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5eada64591d64ee7b8a22e019c8c2b3b', 'request_id': 'req-c76b16ac-1540-4cdb-ad4f-eaa1bcfb51a2'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:37:52.036489 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-c76b16ac-1540-4cdb-ad4f-eaa1bcfb51a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5eada64591d64ee7b8a22e019c8c2b3b', 'request_id': 'req-c76b16ac-1540-4cdb-ad4f-eaa1bcfb51a2'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:37:52.047617 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-c76b16ac-1540-4cdb-ad4f-eaa1bcfb51a2 admin admin] The token cache is being invalidate because project 5eada64591d64ee7b8a22e019c8c2b3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81445) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 16:37:52.047905 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-c76b16ac-1540-4cdb-ad4f-eaa1bcfb51a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:37:52.048539 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-c76b16ac-1540-4cdb-ad4f-eaa1bcfb51a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:37:52.050049 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1310/2642] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 16:37:51 2022] DELETE /identity/v3/projects/5eada64591d64ee7b8a22e019c8c2b3b => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:37:52.055012 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd82a59e-f187-43da-bd15-851c98da2820 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:37:52.055387 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd82a59e-f187-43da-bd15-851c98da2820 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:37:52.055657 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd82a59e-f187-43da-bd15-851c98da2820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:37:52.074979 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-fd82a59e-f187-43da-bd15-851c98da2820 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:37:52.076163 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-fd82a59e-f187-43da-bd15-851c98da2820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:37:52.133864 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1333/2643] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:37:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:37:52.142104 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a174b5-0887-4240-aa0c-aaa9ada7324c None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:37:52.142429 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a174b5-0887-4240-aa0c-aaa9ada7324c None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:37:52.142723 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a174b5-0887-4240-aa0c-aaa9ada7324c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:37:52.162680 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-c5a174b5-0887-4240-aa0c-aaa9ada7324c None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:37:52.163887 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-c5a174b5-0887-4240-aa0c-aaa9ada7324c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:37:52.171746 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1311/2644] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:37:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:37:52.175963 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd82a59e-f187-43da-bd15-851c98da2820 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:37:52.185500 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd82a59e-f187-43da-bd15-851c98da2820 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:37:52.189943 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3734a2-8993-4b55-9790-a6ee292186e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:37:52.190553 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3734a2-8993-4b55-9790-a6ee292186e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:37:52.190825 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3734a2-8993-4b55-9790-a6ee292186e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:37:52.191092 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3734a2-8993-4b55-9790-a6ee292186e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:37:52.191715 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3734a2-8993-4b55-9790-a6ee292186e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:37:52.192010 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3734a2-8993-4b55-9790-a6ee292186e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:37:52.193587 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3734a2-8993-4b55-9790-a6ee292186e4 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:37:52.205276 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1334/2645] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Sep 9 16:37:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 16:37:52.209397 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a174b5-0887-4240-aa0c-aaa9ada7324c None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:37:52.219400 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a174b5-0887-4240-aa0c-aaa9ada7324c None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:37:52.224660 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98f6fde-84b1-4c82-9285-551c7a3c6f36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:37:52.225253 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98f6fde-84b1-4c82-9285-551c7a3c6f36 admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:37:52.225532 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98f6fde-84b1-4c82-9285-551c7a3c6f36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:37:52.225824 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98f6fde-84b1-4c82-9285-551c7a3c6f36 admin admin] PATH_INFO: `/v3/projects` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:37:52.226480 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98f6fde-84b1-4c82-9285-551c7a3c6f36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:37:52.229330 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98f6fde-84b1-4c82-9285-551c7a3c6f36 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:37:52.255899 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1312/2646] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 16:37:52 2022] POST /identity/v3/projects => generated 403 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:37:52.260742 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3734a2-8993-4b55-9790-a6ee292186e4 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:37:52.270900 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3734a2-8993-4b55-9790-a6ee292186e4 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:37:52.318151 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:37:52.331771 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef69b93-adce-41c7-bf4e-529c824161f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:37:52.332398 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef69b93-adce-41c7-bf4e-529c824161f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:37:52.332675 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef69b93-adce-41c7-bf4e-529c824161f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:37:52.332943 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef69b93-adce-41c7-bf4e-529c824161f8 admin admin] PATH_INFO: `/v3/users` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:37:52.333569 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef69b93-adce-41c7-bf4e-529c824161f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:37:52.335505 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef69b93-adce-41c7-bf4e-529c824161f8 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:37:52.356274 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1335/2647] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 16:37:52 2022] POST /identity/v3/users => generated 302 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:37:52.360427 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98f6fde-84b1-4c82-9285-551c7a3c6f36 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:37:52.366873 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:37:52.370872 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98f6fde-84b1-4c82-9285-551c7a3c6f36 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:37:52.376604 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaec430-e037-4187-b279-e4b5d28edc6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:37:52.377383 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaec430-e037-4187-b279-e4b5d28edc6d admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:37:52.377874 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaec430-e037-4187-b279-e4b5d28edc6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:37:52.378395 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaec430-e037-4187-b279-e4b5d28edc6d admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:37:52.379016 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceaec430-e037-4187-b279-e4b5d28edc6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:37:52.380613 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceaec430-e037-4187-b279-e4b5d28edc6d admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:37:52.390919 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1313/2648] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:37:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 16:37:52.394889 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef69b93-adce-41c7-bf4e-529c824161f8 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:37:52.405114 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef69b93-adce-41c7-bf4e-529c824161f8 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:37:52.409920 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311eb81b-d901-4f43-a545-fc1ed4e4d71b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:37:52.410539 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311eb81b-d901-4f43-a545-fc1ed4e4d71b admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:37:52.410819 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311eb81b-d901-4f43-a545-fc1ed4e4d71b admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:37:52.411088 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311eb81b-d901-4f43-a545-fc1ed4e4d71b admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:37:52.411711 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311eb81b-d901-4f43-a545-fc1ed4e4d71b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:37:52.413313 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311eb81b-d901-4f43-a545-fc1ed4e4d71b admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:37:52.423678 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1336/2649] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:37:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 16:37:52.427501 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaec430-e037-4187-b279-e4b5d28edc6d admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:37:52.437676 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaec430-e037-4187-b279-e4b5d28edc6d admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:37:52.442271 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f60f346-f9a3-4345-a38e-70a0ee502ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:37:52.442935 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f60f346-f9a3-4345-a38e-70a0ee502ee8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:37:52.443211 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f60f346-f9a3-4345-a38e-70a0ee502ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:37:52.443479 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f60f346-f9a3-4345-a38e-70a0ee502ee8 admin admin] PATH_INFO: `/v3/projects/8e7811879e10406a97b297bc2bb86d00/users/39514e34d4d04ac9bfab15950eda0347/roles/b38e84bf077846ee802e6bb1bad83522` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:37:52.458177 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f60f346-f9a3-4345-a38e-70a0ee502ee8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e7811879e10406a97b297bc2bb86d00, user_id=39514e34d4d04ac9bfab15950eda0347, role_id=b38e84bf077846ee802e6bb1bad83522)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:37:52.460827 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f60f346-f9a3-4345-a38e-70a0ee502ee8 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:37:52.473941 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1314/2650] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 16:37:52 2022] PUT /identity/v3/projects/8e7811879e10406a97b297bc2bb86d00/users/39514e34d4d04ac9bfab15950eda0347/roles/b38e84bf077846ee802e6bb1bad83522 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 16:37:52.478860 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb785df-7ef6-4c5a-8472-ae4ed34fffbc None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:37:52.479148 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb785df-7ef6-4c5a-8472-ae4ed34fffbc None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:37:52.479479 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb785df-7ef6-4c5a-8472-ae4ed34fffbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:37:52.498532 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-deb785df-7ef6-4c5a-8472-ae4ed34fffbc None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:37:52.499726 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-deb785df-7ef6-4c5a-8472-ae4ed34fffbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:37:52.557538 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1337/2651] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:37:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:37:52.566908 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f60f346-f9a3-4345-a38e-70a0ee502ee8 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:37:52.568567 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-8f60f346-f9a3-4345-a38e-70a0ee502ee8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:37:52.625901 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f60f346-f9a3-4345-a38e-70a0ee502ee8 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:37:52.629507 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffeab0e-37ec-45ca-a752-2fdc7dcd697d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f44bfdd5214e8d84a2c0a5b1fd9b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:37:52.630093 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffeab0e-37ec-45ca-a752-2fdc7dcd697d service neutron] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:37:52.630400 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffeab0e-37ec-45ca-a752-2fdc7dcd697d service neutron] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:37:52.630667 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffeab0e-37ec-45ca-a752-2fdc7dcd697d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:37:52.640003 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffeab0e-37ec-45ca-a752-2fdc7dcd697d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:37:52.641428 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffeab0e-37ec-45ca-a752-2fdc7dcd697d service neutron] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:37:52.650655 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1315/2652] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:37:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:37:53.248796 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf03967f-db0f-4e3c-a527-63dca8e38ae6 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:37:53.249081 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf03967f-db0f-4e3c-a527-63dca8e38ae6 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:37:53.249353 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf03967f-db0f-4e3c-a527-63dca8e38ae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:37:53.277564 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-bf03967f-db0f-4e3c-a527-63dca8e38ae6 None None] MFA Rules not processed for user `39514e34d4d04ac9bfab15950eda0347`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:37:53.278847 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-bf03967f-db0f-4e3c-a527-63dca8e38ae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:37:53.344561 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1338/2653] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:37:53 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:37:53.349775 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffeab0e-37ec-45ca-a752-2fdc7dcd697d service neutron] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:37:53.359223 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffeab0e-37ec-45ca-a752-2fdc7dcd697d service neutron] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:37:53.363878 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0719994-8276-44db-8490-bb60b5250757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:37:53.364534 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0719994-8276-44db-8490-bb60b5250757 admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:37:53.364878 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0719994-8276-44db-8490-bb60b5250757 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:37:53.365211 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0719994-8276-44db-8490-bb60b5250757 admin admin] PATH_INFO: `/v3/projects` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:37:53.365918 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0719994-8276-44db-8490-bb60b5250757 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:37:53.367900 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0719994-8276-44db-8490-bb60b5250757 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:37:53.398427 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1316/2654] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 16:37:53 2022] POST /identity/v3/projects => generated 405 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:37:53.399983 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf03967f-db0f-4e3c-a527-63dca8e38ae6 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:37:53.410883 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf03967f-db0f-4e3c-a527-63dca8e38ae6 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:37:53.461252 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:37:53.468331 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d048ad5d-0a83-4f13-8114-427a3306301e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:37:53.468927 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d048ad5d-0a83-4f13-8114-427a3306301e admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:37:53.469200 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d048ad5d-0a83-4f13-8114-427a3306301e admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:37:53.469465 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d048ad5d-0a83-4f13-8114-427a3306301e admin admin] PATH_INFO: `/v3/users` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:37:53.470091 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d048ad5d-0a83-4f13-8114-427a3306301e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:37:53.472010 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d048ad5d-0a83-4f13-8114-427a3306301e admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:37:53.491969 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1339/2655] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 16:37:53 2022] POST /identity/v3/users => generated 309 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 16:37:53.496622 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0719994-8276-44db-8490-bb60b5250757 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:37:53.507069 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0719994-8276-44db-8490-bb60b5250757 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:37:53.512299 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6479ae42-be96-403f-a03f-3ad0bafbbb28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:37:53.512893 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6479ae42-be96-403f-a03f-3ad0bafbbb28 admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:37:53.513167 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6479ae42-be96-403f-a03f-3ad0bafbbb28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:37:53.513436 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6479ae42-be96-403f-a03f-3ad0bafbbb28 admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:37:53.514065 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6479ae42-be96-403f-a03f-3ad0bafbbb28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:37:53.515691 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6479ae42-be96-403f-a03f-3ad0bafbbb28 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:37:53.526197 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1317/2656] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:37:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:37:53.530259 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d048ad5d-0a83-4f13-8114-427a3306301e admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:37:53.540232 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d048ad5d-0a83-4f13-8114-427a3306301e admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:37:53.544836 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b166f5-418c-4165-a381-722d147d63cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:37:53.545468 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b166f5-418c-4165-a381-722d147d63cb admin admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:37:53.545745 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b166f5-418c-4165-a381-722d147d63cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:37:53.546015 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b166f5-418c-4165-a381-722d147d63cb admin admin] PATH_INFO: `/v3/projects/ffd25ed32be141ecaca93eea9b67c39a/users/44fd991dd9454fb19dcd1167def61288/roles/0a36d1be416f4089be19be979943b731` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:37:53.560835 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b166f5-418c-4165-a381-722d147d63cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffd25ed32be141ecaca93eea9b67c39a, user_id=44fd991dd9454fb19dcd1167def61288, role_id=0a36d1be416f4089be19be979943b731)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:37:53.563495 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b166f5-418c-4165-a381-722d147d63cb admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:37:53.576555 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1340/2657] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 16:37:53 2022] PUT /identity/v3/projects/ffd25ed32be141ecaca93eea9b67c39a/users/44fd991dd9454fb19dcd1167def61288/roles/0a36d1be416f4089be19be979943b731 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 16:37:53.580454 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6479ae42-be96-403f-a03f-3ad0bafbbb28 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:37:53.595099 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6479ae42-be96-403f-a03f-3ad0bafbbb28 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:37:53.650828 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d02a026-6a42-4375-900e-2924f9db684e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:37:53.651353 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d02a026-6a42-4375-900e-2924f9db684e admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:37:53.651630 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d02a026-6a42-4375-900e-2924f9db684e admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:37:53.651901 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d02a026-6a42-4375-900e-2924f9db684e admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:37:53.652523 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d02a026-6a42-4375-900e-2924f9db684e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:37:53.654183 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d02a026-6a42-4375-900e-2924f9db684e admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:37:53.663612 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1318/2658] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:37:53 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:37:53.668226 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b166f5-418c-4165-a381-722d147d63cb admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:37:53.678535 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b166f5-418c-4165-a381-722d147d63cb admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:37:53.683938 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b04e9f0-e2e5-43ae-8d5d-83c953f19f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:37:53.684600 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b04e9f0-e2e5-43ae-8d5d-83c953f19f73 admin admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:37:53.684871 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b04e9f0-e2e5-43ae-8d5d-83c953f19f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:37:53.685137 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b04e9f0-e2e5-43ae-8d5d-83c953f19f73 admin admin] PATH_INFO: `/v3/projects/ffd25ed32be141ecaca93eea9b67c39a/users/44fd991dd9454fb19dcd1167def61288/roles/0a36d1be416f4089be19be979943b731` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:37:53.687118 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b04e9f0-e2e5-43ae-8d5d-83c953f19f73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffd25ed32be141ecaca93eea9b67c39a, user_id=44fd991dd9454fb19dcd1167def61288, role_id=0a36d1be416f4089be19be979943b731)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:37:53.689840 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b04e9f0-e2e5-43ae-8d5d-83c953f19f73 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:37:53.700043 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1341/2659] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 16:37:53 2022] PUT /identity/v3/projects/ffd25ed32be141ecaca93eea9b67c39a/users/44fd991dd9454fb19dcd1167def61288/roles/0a36d1be416f4089be19be979943b731 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:37:54.327968 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630c72ae-eed4-4856-9756-173f6e8df634 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:37:54.328257 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630c72ae-eed4-4856-9756-173f6e8df634 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:37:54.328527 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630c72ae-eed4-4856-9756-173f6e8df634 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:37:54.358706 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-630c72ae-eed4-4856-9756-173f6e8df634 None None] MFA Rules not processed for user `44fd991dd9454fb19dcd1167def61288`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:37:54.359924 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-630c72ae-eed4-4856-9756-173f6e8df634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:37:54.383616 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:37:54.429056 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1319/2660] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:37:54 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:37:55.412745 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b04e9f0-e2e5-43ae-8d5d-83c953f19f73 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:37:55.415069 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-2b04e9f0-e2e5-43ae-8d5d-83c953f19f73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:37:55.478569 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630c72ae-eed4-4856-9756-173f6e8df634 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:37:55.501969 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b04e9f0-e2e5-43ae-8d5d-83c953f19f73 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:37:55.507880 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba7872b-b91b-4b20-8f79-578513e6c642 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d73df92393c43b2b5ccc32a2d43d952', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:37:55.508483 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba7872b-b91b-4b20-8f79-578513e6c642 service placement] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:37:55.508761 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba7872b-b91b-4b20-8f79-578513e6c642 service placement] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:37:55.509028 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba7872b-b91b-4b20-8f79-578513e6c642 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:37:55.511390 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-dba7872b-b91b-4b20-8f79-578513e6c642 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:37:55.525074 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba7872b-b91b-4b20-8f79-578513e6c642 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:37:55.526911 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba7872b-b91b-4b20-8f79-578513e6c642 service placement] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:37:55.537509 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1342/2661] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:37:55 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:37:55.557523 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630c72ae-eed4-4856-9756-173f6e8df634 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:37:55.562102 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbc99fc-0f7e-4fe1-a906-82b520d72ad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:37:55.562868 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbc99fc-0f7e-4fe1-a906-82b520d72ad9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:37:55.563216 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbc99fc-0f7e-4fe1-a906-82b520d72ad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:37:55.563491 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbc99fc-0f7e-4fe1-a906-82b520d72ad9 admin admin] PATH_INFO: `/v3/users/39514e34d4d04ac9bfab15950eda0347` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:37:55.564627 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbc99fc-0f7e-4fe1-a906-82b520d72ad9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=39514e34d4d04ac9bfab15950eda0347)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:37:55.566698 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbc99fc-0f7e-4fe1-a906-82b520d72ad9 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:37:55.636114 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-edbc99fc-0f7e-4fe1-a906-82b520d72ad9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39514e34d4d04ac9bfab15950eda0347'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:37:55.643446 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-edbc99fc-0f7e-4fe1-a906-82b520d72ad9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39514e34d4d04ac9bfab15950eda0347'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:37:55.644213 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-edbc99fc-0f7e-4fe1-a906-82b520d72ad9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39514e34d4d04ac9bfab15950eda0347'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:37:55.653421 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-edbc99fc-0f7e-4fe1-a906-82b520d72ad9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39514e34d4d04ac9bfab15950eda0347'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:37:55.665516 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-edbc99fc-0f7e-4fe1-a906-82b520d72ad9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39514e34d4d04ac9bfab15950eda0347'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:37:55.671754 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1320/2662] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 16:37:55 2022] DELETE /identity/v3/users/39514e34d4d04ac9bfab15950eda0347 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 16:37:55.847646 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba7872b-b91b-4b20-8f79-578513e6c642 service placement] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:37:55.859160 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba7872b-b91b-4b20-8f79-578513e6c642 service placement] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:37:55.918602 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bf44b1-f4e5-4b91-84f2-8a3cc3c7673e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:37:55.919281 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bf44b1-f4e5-4b91-84f2-8a3cc3c7673e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:37:55.919727 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bf44b1-f4e5-4b91-84f2-8a3cc3c7673e admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:37:55.920182 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bf44b1-f4e5-4b91-84f2-8a3cc3c7673e admin admin] PATH_INFO: `/v3/projects/8e7811879e10406a97b297bc2bb86d00` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:37:55.922279 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bf44b1-f4e5-4b91-84f2-8a3cc3c7673e admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e7811879e10406a97b297bc2bb86d00)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:37:55.925746 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bf44b1-f4e5-4b91-84f2-8a3cc3c7673e admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:37:55.971424 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:37:55.980569 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-84bf44b1-f4e5-4b91-84f2-8a3cc3c7673e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e7811879e10406a97b297bc2bb86d00', 'request_id': 'req-84bf44b1-f4e5-4b91-84f2-8a3cc3c7673e'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:37:55.986583 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-84bf44b1-f4e5-4b91-84f2-8a3cc3c7673e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e7811879e10406a97b297bc2bb86d00', 'request_id': 'req-84bf44b1-f4e5-4b91-84f2-8a3cc3c7673e'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:37:55.994982 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-84bf44b1-f4e5-4b91-84f2-8a3cc3c7673e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e7811879e10406a97b297bc2bb86d00', 'request_id': 'req-84bf44b1-f4e5-4b91-84f2-8a3cc3c7673e'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:37:56.019895 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-84bf44b1-f4e5-4b91-84f2-8a3cc3c7673e admin admin] The token cache is being invalidate because project 8e7811879e10406a97b297bc2bb86d00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81446) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 16:37:56.020191 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-84bf44b1-f4e5-4b91-84f2-8a3cc3c7673e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:37:56.020962 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-84bf44b1-f4e5-4b91-84f2-8a3cc3c7673e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:37:56.022520 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1343/2663] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 16:37:55 2022] DELETE /identity/v3/projects/8e7811879e10406a97b297bc2bb86d00 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:37:56.027167 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbc99fc-0f7e-4fe1-a906-82b520d72ad9 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:37:56.029451 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-edbc99fc-0f7e-4fe1-a906-82b520d72ad9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:37:56.044987 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbc99fc-0f7e-4fe1-a906-82b520d72ad9 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:37:56.084377 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:37:56.104762 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828b41f9-4e87-4f9b-a78c-49a015e22cfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:37:56.105514 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828b41f9-4e87-4f9b-a78c-49a015e22cfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:37:56.105798 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828b41f9-4e87-4f9b-a78c-49a015e22cfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:37:56.106070 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828b41f9-4e87-4f9b-a78c-49a015e22cfc admin admin] PATH_INFO: `/v3/users/44fd991dd9454fb19dcd1167def61288` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:37:56.107221 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828b41f9-4e87-4f9b-a78c-49a015e22cfc admin admin] RBAC: Authorizing `identity:delete_user(user_id=44fd991dd9454fb19dcd1167def61288)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:37:56.109134 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828b41f9-4e87-4f9b-a78c-49a015e22cfc admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:37:56.153488 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-828b41f9-4e87-4f9b-a78c-49a015e22cfc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44fd991dd9454fb19dcd1167def61288'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:37:56.161842 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-828b41f9-4e87-4f9b-a78c-49a015e22cfc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44fd991dd9454fb19dcd1167def61288'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:37:56.162647 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-828b41f9-4e87-4f9b-a78c-49a015e22cfc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44fd991dd9454fb19dcd1167def61288'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:37:56.170988 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-828b41f9-4e87-4f9b-a78c-49a015e22cfc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44fd991dd9454fb19dcd1167def61288'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:37:56.183240 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-828b41f9-4e87-4f9b-a78c-49a015e22cfc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44fd991dd9454fb19dcd1167def61288'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:37:56.189340 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1321/2664] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 16:37:56 2022] DELETE /identity/v3/users/44fd991dd9454fb19dcd1167def61288 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:37:56.363389 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bf44b1-f4e5-4b91-84f2-8a3cc3c7673e admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:37:56.364840 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-84bf44b1-f4e5-4b91-84f2-8a3cc3c7673e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:37:56.382155 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bf44b1-f4e5-4b91-84f2-8a3cc3c7673e admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:37:56.441414 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4e0527-2e7e-42a6-a583-1eefe34a1500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:37:56.442064 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4e0527-2e7e-42a6-a583-1eefe34a1500 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:37:56.442220 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4e0527-2e7e-42a6-a583-1eefe34a1500 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:37:56.442513 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4e0527-2e7e-42a6-a583-1eefe34a1500 admin admin] PATH_INFO: `/v3/projects/ffd25ed32be141ecaca93eea9b67c39a` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:37:56.443610 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4e0527-2e7e-42a6-a583-1eefe34a1500 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ffd25ed32be141ecaca93eea9b67c39a)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:37:56.445483 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4e0527-2e7e-42a6-a583-1eefe34a1500 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:37:56.492589 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-8a4e0527-2e7e-42a6-a583-1eefe34a1500 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffd25ed32be141ecaca93eea9b67c39a', 'request_id': 'req-8a4e0527-2e7e-42a6-a583-1eefe34a1500'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:37:56.498292 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-8a4e0527-2e7e-42a6-a583-1eefe34a1500 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffd25ed32be141ecaca93eea9b67c39a', 'request_id': 'req-8a4e0527-2e7e-42a6-a583-1eefe34a1500'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:37:56.505552 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-8a4e0527-2e7e-42a6-a583-1eefe34a1500 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffd25ed32be141ecaca93eea9b67c39a', 'request_id': 'req-8a4e0527-2e7e-42a6-a583-1eefe34a1500'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:37:56.516199 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-8a4e0527-2e7e-42a6-a583-1eefe34a1500 admin admin] The token cache is being invalidate because project ffd25ed32be141ecaca93eea9b67c39a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81446) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 16:37:56.516477 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-8a4e0527-2e7e-42a6-a583-1eefe34a1500 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:37:56.517102 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-8a4e0527-2e7e-42a6-a583-1eefe34a1500 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:37:56.518593 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1344/2665] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 16:37:56 2022] DELETE /identity/v3/projects/ffd25ed32be141ecaca93eea9b67c39a => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:37:56.523561 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1352b12d-3e6e-408c-8c32-78d9fbc0a3ec None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:37:56.524028 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1352b12d-3e6e-408c-8c32-78d9fbc0a3ec None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:37:56.524134 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1352b12d-3e6e-408c-8c32-78d9fbc0a3ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:37:56.544270 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-1352b12d-3e6e-408c-8c32-78d9fbc0a3ec None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:37:56.545451 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-1352b12d-3e6e-408c-8c32-78d9fbc0a3ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:37:56.602550 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1322/2666] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:37:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 16:37:56.610259 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b96154-0f3c-4bb3-92b3-120c72884141 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:37:56.610574 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b96154-0f3c-4bb3-92b3-120c72884141 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:37:56.610853 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b96154-0f3c-4bb3-92b3-120c72884141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:37:56.630105 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-e5b96154-0f3c-4bb3-92b3-120c72884141 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:37:56.631309 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-e5b96154-0f3c-4bb3-92b3-120c72884141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:37:56.639519 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1345/2667] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:37:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:37:56.643575 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1352b12d-3e6e-408c-8c32-78d9fbc0a3ec None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:37:56.653919 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1352b12d-3e6e-408c-8c32-78d9fbc0a3ec None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:37:56.658736 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3a79e1-ca04-422b-831a-73a098857e4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:37:56.659312 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3a79e1-ca04-422b-831a-73a098857e4e admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:37:56.659593 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3a79e1-ca04-422b-831a-73a098857e4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:37:56.659866 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3a79e1-ca04-422b-831a-73a098857e4e admin admin] PATH_INFO: `/v3/domains` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:37:56.660520 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3a79e1-ca04-422b-831a-73a098857e4e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:37:56.660802 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3a79e1-ca04-422b-831a-73a098857e4e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:37:56.662510 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3a79e1-ca04-422b-831a-73a098857e4e admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:37:56.673957 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1323/2668] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Sep 9 16:37:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:37:56.678209 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b96154-0f3c-4bb3-92b3-120c72884141 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:37:56.687237 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b96154-0f3c-4bb3-92b3-120c72884141 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:37:56.691845 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e79561-44a4-4d60-8afa-33abe7be9b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:37:56.692367 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e79561-44a4-4d60-8afa-33abe7be9b4e admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:37:56.692643 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e79561-44a4-4d60-8afa-33abe7be9b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:37:56.692905 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e79561-44a4-4d60-8afa-33abe7be9b4e admin admin] PATH_INFO: `/v3/projects` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:37:56.693520 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e79561-44a4-4d60-8afa-33abe7be9b4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:37:56.695422 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e79561-44a4-4d60-8afa-33abe7be9b4e admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:37:56.726179 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1346/2669] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 16:37:56 2022] POST /identity/v3/projects => generated 381 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 16:37:56.730332 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3a79e1-ca04-422b-831a-73a098857e4e admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:37:56.743577 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3a79e1-ca04-422b-831a-73a098857e4e admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:37:56.791731 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:37:56.806641 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9137f314-7eaa-46f9-94d2-441c11737f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:37:56.807274 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9137f314-7eaa-46f9-94d2-441c11737f2f admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:37:56.807554 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9137f314-7eaa-46f9-94d2-441c11737f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:37:56.807826 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9137f314-7eaa-46f9-94d2-441c11737f2f admin admin] PATH_INFO: `/v3/users` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:37:56.808445 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9137f314-7eaa-46f9-94d2-441c11737f2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:37:56.810412 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9137f314-7eaa-46f9-94d2-441c11737f2f admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:37:56.831617 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1324/2670] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 16:37:56 2022] POST /identity/v3/users => generated 291 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:37:56.835912 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e79561-44a4-4d60-8afa-33abe7be9b4e admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:37:56.846703 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e79561-44a4-4d60-8afa-33abe7be9b4e admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:37:56.851186 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424171eb-dd49-4c6d-877b-8cb8f92e0b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:37:56.851764 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424171eb-dd49-4c6d-877b-8cb8f92e0b4e admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:37:56.852039 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424171eb-dd49-4c6d-877b-8cb8f92e0b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:37:56.852306 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424171eb-dd49-4c6d-877b-8cb8f92e0b4e admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:37:56.852951 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424171eb-dd49-4c6d-877b-8cb8f92e0b4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:37:56.854616 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424171eb-dd49-4c6d-877b-8cb8f92e0b4e admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:37:56.864236 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1347/2671] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:37:56 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:37:56.868009 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9137f314-7eaa-46f9-94d2-441c11737f2f admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:37:56.877769 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9137f314-7eaa-46f9-94d2-441c11737f2f admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:37:56.882391 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208e62cf-699a-4193-8aa6-235d9442811d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:37:56.882971 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208e62cf-699a-4193-8aa6-235d9442811d admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:37:56.883246 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208e62cf-699a-4193-8aa6-235d9442811d admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:37:56.883515 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208e62cf-699a-4193-8aa6-235d9442811d admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:37:56.884695 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208e62cf-699a-4193-8aa6-235d9442811d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:37:56.886294 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208e62cf-699a-4193-8aa6-235d9442811d admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:37:56.897866 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1325/2672] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:37:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:37:56.902870 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424171eb-dd49-4c6d-877b-8cb8f92e0b4e admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:37:56.915938 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424171eb-dd49-4c6d-877b-8cb8f92e0b4e admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:37:56.922190 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9930c6-1a8c-414e-b65c-ad2f10d0c076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:37:56.923251 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9930c6-1a8c-414e-b65c-ad2f10d0c076 admin admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:37:56.923696 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9930c6-1a8c-414e-b65c-ad2f10d0c076 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:37:56.923971 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9930c6-1a8c-414e-b65c-ad2f10d0c076 admin admin] PATH_INFO: `/v3/projects/a3caa3b5e8ed44619ff7732c453af39a/users/821cebaae09f42eb818916e85e387f77/roles/b38e84bf077846ee802e6bb1bad83522` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:37:56.939141 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9930c6-1a8c-414e-b65c-ad2f10d0c076 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3caa3b5e8ed44619ff7732c453af39a, user_id=821cebaae09f42eb818916e85e387f77, role_id=b38e84bf077846ee802e6bb1bad83522)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:37:56.941779 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9930c6-1a8c-414e-b65c-ad2f10d0c076 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:37:56.944823 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:37:56.956835 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1348/2673] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 16:37:56 2022] PUT /identity/v3/projects/a3caa3b5e8ed44619ff7732c453af39a/users/821cebaae09f42eb818916e85e387f77/roles/b38e84bf077846ee802e6bb1bad83522 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:37:56.967081 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cae995-1de5-4e67-bb1a-43bbf21c1d4e None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:37:56.967366 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cae995-1de5-4e67-bb1a-43bbf21c1d4e None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:37:56.967671 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cae995-1de5-4e67-bb1a-43bbf21c1d4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:37:56.995023 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-18cae995-1de5-4e67-bb1a-43bbf21c1d4e None None] MFA Rules not processed for user `821cebaae09f42eb818916e85e387f77`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:37:56.996239 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-18cae995-1de5-4e67-bb1a-43bbf21c1d4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:37:57.057687 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1326/2674] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:37:56 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:37:57.062104 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9930c6-1a8c-414e-b65c-ad2f10d0c076 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:37:57.139926 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9930c6-1a8c-414e-b65c-ad2f10d0c076 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:37:57.146660 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92603e4-6526-4cdf-8e72-03e7f6b70aaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:37:57.147530 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92603e4-6526-4cdf-8e72-03e7f6b70aaa admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:37:57.147947 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92603e4-6526-4cdf-8e72-03e7f6b70aaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:37:57.148353 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92603e4-6526-4cdf-8e72-03e7f6b70aaa admin admin] PATH_INFO: `/v3/projects` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:37:57.149313 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92603e4-6526-4cdf-8e72-03e7f6b70aaa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:37:57.152428 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92603e4-6526-4cdf-8e72-03e7f6b70aaa admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:37:57.185130 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1349/2675] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 16:37:57 2022] POST /identity/v3/projects => generated 379 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 16:37:57.189309 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cae995-1de5-4e67-bb1a-43bbf21c1d4e None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:37:57.200719 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cae995-1de5-4e67-bb1a-43bbf21c1d4e None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:37:57.254092 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa78ded0-ed9f-4318-9195-ac0ab0b270f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:37:57.254717 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa78ded0-ed9f-4318-9195-ac0ab0b270f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:37:57.254992 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa78ded0-ed9f-4318-9195-ac0ab0b270f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:37:57.255261 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa78ded0-ed9f-4318-9195-ac0ab0b270f1 admin admin] PATH_INFO: `/v3/users` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:37:57.255865 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa78ded0-ed9f-4318-9195-ac0ab0b270f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:37:57.257761 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa78ded0-ed9f-4318-9195-ac0ab0b270f1 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:37:57.280015 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1327/2676] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 16:37:57 2022] POST /identity/v3/users => generated 296 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:37:57.284087 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92603e4-6526-4cdf-8e72-03e7f6b70aaa admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:37:57.300436 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92603e4-6526-4cdf-8e72-03e7f6b70aaa admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:37:57.305089 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc516a68-6797-44d0-83f9-9b9d5356bd86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:37:57.305686 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc516a68-6797-44d0-83f9-9b9d5356bd86 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:37:57.306502 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc516a68-6797-44d0-83f9-9b9d5356bd86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:37:57.306746 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc516a68-6797-44d0-83f9-9b9d5356bd86 admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:37:57.307380 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc516a68-6797-44d0-83f9-9b9d5356bd86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:37:57.308980 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc516a68-6797-44d0-83f9-9b9d5356bd86 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:37:57.319501 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1350/2677] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:37:57 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 16:37:57.324327 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa78ded0-ed9f-4318-9195-ac0ab0b270f1 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:37:57.334437 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa78ded0-ed9f-4318-9195-ac0ab0b270f1 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:37:57.339057 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a47552f-ccaf-4aee-bd81-5879881b21e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:37:57.339690 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a47552f-ccaf-4aee-bd81-5879881b21e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:37:57.339963 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a47552f-ccaf-4aee-bd81-5879881b21e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:37:57.340234 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a47552f-ccaf-4aee-bd81-5879881b21e5 admin admin] PATH_INFO: `/v3/projects/c89273c9f27a464285473df9df8f25d2/users/40f81edf02354e19985008f7b2263fca/roles/0a36d1be416f4089be19be979943b731` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:37:57.354924 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a47552f-ccaf-4aee-bd81-5879881b21e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c89273c9f27a464285473df9df8f25d2, user_id=40f81edf02354e19985008f7b2263fca, role_id=0a36d1be416f4089be19be979943b731)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:37:57.357530 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a47552f-ccaf-4aee-bd81-5879881b21e5 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:37:57.371194 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1328/2678] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 16:37:57 2022] PUT /identity/v3/projects/c89273c9f27a464285473df9df8f25d2/users/40f81edf02354e19985008f7b2263fca/roles/0a36d1be416f4089be19be979943b731 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:37:57.375107 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc516a68-6797-44d0-83f9-9b9d5356bd86 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:37:57.387129 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc516a68-6797-44d0-83f9-9b9d5356bd86 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:37:57.442846 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e8db23-16b9-40dc-8b21-30664df8c903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:37:57.443479 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e8db23-16b9-40dc-8b21-30664df8c903 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:37:57.443717 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e8db23-16b9-40dc-8b21-30664df8c903 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:37:57.443989 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e8db23-16b9-40dc-8b21-30664df8c903 admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:37:57.444643 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e8db23-16b9-40dc-8b21-30664df8c903 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:37:57.446239 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e8db23-16b9-40dc-8b21-30664df8c903 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:37:57.456134 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1351/2679] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:37:57 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:37:57.460205 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a47552f-ccaf-4aee-bd81-5879881b21e5 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:37:57.470280 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a47552f-ccaf-4aee-bd81-5879881b21e5 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:37:57.474844 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8dac74-eef8-4687-b834-2072285e26d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:37:57.475486 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8dac74-eef8-4687-b834-2072285e26d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:37:57.475762 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8dac74-eef8-4687-b834-2072285e26d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:37:57.476031 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8dac74-eef8-4687-b834-2072285e26d4 admin admin] PATH_INFO: `/v3/projects/c89273c9f27a464285473df9df8f25d2/users/40f81edf02354e19985008f7b2263fca/roles/0a36d1be416f4089be19be979943b731` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:37:57.478442 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8dac74-eef8-4687-b834-2072285e26d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c89273c9f27a464285473df9df8f25d2, user_id=40f81edf02354e19985008f7b2263fca, role_id=0a36d1be416f4089be19be979943b731)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:37:57.481047 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8dac74-eef8-4687-b834-2072285e26d4 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:37:57.491525 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1329/2680] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 16:37:57 2022] PUT /identity/v3/projects/c89273c9f27a464285473df9df8f25d2/users/40f81edf02354e19985008f7b2263fca/roles/0a36d1be416f4089be19be979943b731 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:37:57.503719 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd59b868-b763-4efc-a3f5-b8baf6843f51 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:37:57.504000 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd59b868-b763-4efc-a3f5-b8baf6843f51 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:37:57.504268 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd59b868-b763-4efc-a3f5-b8baf6843f51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:37:57.532658 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-dd59b868-b763-4efc-a3f5-b8baf6843f51 None None] MFA Rules not processed for user `40f81edf02354e19985008f7b2263fca`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:37:57.533849 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-dd59b868-b763-4efc-a3f5-b8baf6843f51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:37:57.583902 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:37:57.602411 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1352/2681] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:37:57 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:37:57.614740 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8dac74-eef8-4687-b834-2072285e26d4 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:37:57.616493 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-1e8dac74-eef8-4687-b834-2072285e26d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:37:57.626391 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:37:57.674610 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8dac74-eef8-4687-b834-2072285e26d4 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:37:57.678228 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998bd1d1-16cc-4d8c-9d8e-2e9ab07a706b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8078e791ba68460f8b3aeafb4b79b73a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:37:57.678849 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998bd1d1-16cc-4d8c-9d8e-2e9ab07a706b service cinder] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:37:57.679124 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998bd1d1-16cc-4d8c-9d8e-2e9ab07a706b service cinder] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:37:57.679391 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998bd1d1-16cc-4d8c-9d8e-2e9ab07a706b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:37:57.688614 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998bd1d1-16cc-4d8c-9d8e-2e9ab07a706b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:37:57.690095 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998bd1d1-16cc-4d8c-9d8e-2e9ab07a706b service cinder] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:37:57.699847 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1330/2682] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:37:57 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:37:58.003919 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd59b868-b763-4efc-a3f5-b8baf6843f51 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:37:58.013605 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd59b868-b763-4efc-a3f5-b8baf6843f51 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:37:58.018404 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf9eccd-cce1-426a-a2ed-c114747df7aa tempest-VolumeQuotaClassesTest-234992883 tempest-VolumeQuotaClassesTest-234992883-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40f81edf02354e19985008f7b2263fca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c89273c9f27a464285473df9df8f25d2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:37:58.019001 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf9eccd-cce1-426a-a2ed-c114747df7aa tempest-VolumeQuotaClassesTest-234992883 tempest-VolumeQuotaClassesTest-234992883-project-admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:37:58.019284 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf9eccd-cce1-426a-a2ed-c114747df7aa tempest-VolumeQuotaClassesTest-234992883 tempest-VolumeQuotaClassesTest-234992883-project-admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:37:58.019554 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf9eccd-cce1-426a-a2ed-c114747df7aa tempest-VolumeQuotaClassesTest-234992883 tempest-VolumeQuotaClassesTest-234992883-project-admin] PATH_INFO: `/v3/domains` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:37:58.020190 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf9eccd-cce1-426a-a2ed-c114747df7aa tempest-VolumeQuotaClassesTest-234992883 tempest-VolumeQuotaClassesTest-234992883-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:37:58.020488 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf9eccd-cce1-426a-a2ed-c114747df7aa tempest-VolumeQuotaClassesTest-234992883 tempest-VolumeQuotaClassesTest-234992883-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:37:58.022076 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf9eccd-cce1-426a-a2ed-c114747df7aa tempest-VolumeQuotaClassesTest-234992883 tempest-VolumeQuotaClassesTest-234992883-project-admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:37:58.033957 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1353/2683] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Sep 9 16:37:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:37:58.037906 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998bd1d1-16cc-4d8c-9d8e-2e9ab07a706b service cinder] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:37:58.047551 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998bd1d1-16cc-4d8c-9d8e-2e9ab07a706b service cinder] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:37:58.052023 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8d7c6d-1a30-4990-8095-32d090ddaef1 tempest-VolumeQuotaClassesTest-234992883 tempest-VolumeQuotaClassesTest-234992883-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40f81edf02354e19985008f7b2263fca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c89273c9f27a464285473df9df8f25d2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:37:58.052602 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8d7c6d-1a30-4990-8095-32d090ddaef1 tempest-VolumeQuotaClassesTest-234992883 tempest-VolumeQuotaClassesTest-234992883-project-admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:37:58.052883 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8d7c6d-1a30-4990-8095-32d090ddaef1 tempest-VolumeQuotaClassesTest-234992883 tempest-VolumeQuotaClassesTest-234992883-project-admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:37:58.053152 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8d7c6d-1a30-4990-8095-32d090ddaef1 tempest-VolumeQuotaClassesTest-234992883 tempest-VolumeQuotaClassesTest-234992883-project-admin] PATH_INFO: `/v3/projects` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:37:58.053763 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8d7c6d-1a30-4990-8095-32d090ddaef1 tempest-VolumeQuotaClassesTest-234992883 tempest-VolumeQuotaClassesTest-234992883-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:37:58.055675 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8d7c6d-1a30-4990-8095-32d090ddaef1 tempest-VolumeQuotaClassesTest-234992883 tempest-VolumeQuotaClassesTest-234992883-project-admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:37:58.081618 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1331/2684] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 16:37:58 2022] POST /identity/v3/projects => generated 354 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:37:58.085548 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf9eccd-cce1-426a-a2ed-c114747df7aa tempest-VolumeQuotaClassesTest-234992883 tempest-VolumeQuotaClassesTest-234992883-project-admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:37:58.096172 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf9eccd-cce1-426a-a2ed-c114747df7aa tempest-VolumeQuotaClassesTest-234992883 tempest-VolumeQuotaClassesTest-234992883-project-admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:37:58.151632 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57af64f2-723c-436a-991a-d2009960b377 tempest-VolumeQuotaClassesTest-234992883 tempest-VolumeQuotaClassesTest-234992883-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40f81edf02354e19985008f7b2263fca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c89273c9f27a464285473df9df8f25d2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:37:58.152234 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57af64f2-723c-436a-991a-d2009960b377 tempest-VolumeQuotaClassesTest-234992883 tempest-VolumeQuotaClassesTest-234992883-project-admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:37:58.152512 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57af64f2-723c-436a-991a-d2009960b377 tempest-VolumeQuotaClassesTest-234992883 tempest-VolumeQuotaClassesTest-234992883-project-admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:37:58.152786 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57af64f2-723c-436a-991a-d2009960b377 tempest-VolumeQuotaClassesTest-234992883 tempest-VolumeQuotaClassesTest-234992883-project-admin] PATH_INFO: `/v3/domains` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:37:58.153416 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57af64f2-723c-436a-991a-d2009960b377 tempest-VolumeQuotaClassesTest-234992883 tempest-VolumeQuotaClassesTest-234992883-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:37:58.153743 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57af64f2-723c-436a-991a-d2009960b377 tempest-VolumeQuotaClassesTest-234992883 tempest-VolumeQuotaClassesTest-234992883-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:37:58.155505 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57af64f2-723c-436a-991a-d2009960b377 tempest-VolumeQuotaClassesTest-234992883 tempest-VolumeQuotaClassesTest-234992883-project-admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:37:58.167067 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1354/2685] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Sep 9 16:37:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:37:58.203473 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8d7c6d-1a30-4990-8095-32d090ddaef1 tempest-VolumeQuotaClassesTest-234992883 tempest-VolumeQuotaClassesTest-234992883-project-admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:37:58.214275 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8d7c6d-1a30-4990-8095-32d090ddaef1 tempest-VolumeQuotaClassesTest-234992883 tempest-VolumeQuotaClassesTest-234992883-project-admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:37:58.218780 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bff8ce-b694-4324-8bb6-e257ec0d12b2 tempest-VolumeQuotaClassesTest-234992883 tempest-VolumeQuotaClassesTest-234992883-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40f81edf02354e19985008f7b2263fca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c89273c9f27a464285473df9df8f25d2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:37:58.219393 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bff8ce-b694-4324-8bb6-e257ec0d12b2 tempest-VolumeQuotaClassesTest-234992883 tempest-VolumeQuotaClassesTest-234992883-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:37:58.219675 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bff8ce-b694-4324-8bb6-e257ec0d12b2 tempest-VolumeQuotaClassesTest-234992883 tempest-VolumeQuotaClassesTest-234992883-project-admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:37:58.219946 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bff8ce-b694-4324-8bb6-e257ec0d12b2 tempest-VolumeQuotaClassesTest-234992883 tempest-VolumeQuotaClassesTest-234992883-project-admin] PATH_INFO: `/v3/projects/0bddf11600a049ce8802d23e7b4c3bd5` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:37:58.221084 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bff8ce-b694-4324-8bb6-e257ec0d12b2 tempest-VolumeQuotaClassesTest-234992883 tempest-VolumeQuotaClassesTest-234992883-project-admin] RBAC: Authorizing `identity:delete_project(project_id=0bddf11600a049ce8802d23e7b4c3bd5)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:37:58.223052 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bff8ce-b694-4324-8bb6-e257ec0d12b2 tempest-VolumeQuotaClassesTest-234992883 tempest-VolumeQuotaClassesTest-234992883-project-admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:37:58.267483 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-62bff8ce-b694-4324-8bb6-e257ec0d12b2 tempest-VolumeQuotaClassesTest-234992883 tempest-VolumeQuotaClassesTest-234992883-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0bddf11600a049ce8802d23e7b4c3bd5', 'request_id': 'req-62bff8ce-b694-4324-8bb6-e257ec0d12b2'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:37:58.273981 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-62bff8ce-b694-4324-8bb6-e257ec0d12b2 tempest-VolumeQuotaClassesTest-234992883 tempest-VolumeQuotaClassesTest-234992883-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0bddf11600a049ce8802d23e7b4c3bd5', 'request_id': 'req-62bff8ce-b694-4324-8bb6-e257ec0d12b2'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:37:58.282985 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-62bff8ce-b694-4324-8bb6-e257ec0d12b2 tempest-VolumeQuotaClassesTest-234992883 tempest-VolumeQuotaClassesTest-234992883-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0bddf11600a049ce8802d23e7b4c3bd5', 'request_id': 'req-62bff8ce-b694-4324-8bb6-e257ec0d12b2'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:37:58.293887 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-62bff8ce-b694-4324-8bb6-e257ec0d12b2 tempest-VolumeQuotaClassesTest-234992883 tempest-VolumeQuotaClassesTest-234992883-project-admin] The token cache is being invalidate because project 0bddf11600a049ce8802d23e7b4c3bd5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81445) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 16:37:58.294175 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-62bff8ce-b694-4324-8bb6-e257ec0d12b2 tempest-VolumeQuotaClassesTest-234992883 tempest-VolumeQuotaClassesTest-234992883-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:37:58.294844 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-62bff8ce-b694-4324-8bb6-e257ec0d12b2 tempest-VolumeQuotaClassesTest-234992883 tempest-VolumeQuotaClassesTest-234992883-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:37:58.296367 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1332/2686] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 16:37:58 2022] DELETE /identity/v3/projects/0bddf11600a049ce8802d23e7b4c3bd5 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:37:58.482851 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57af64f2-723c-436a-991a-d2009960b377 tempest-VolumeQuotaClassesTest-234992883 tempest-VolumeQuotaClassesTest-234992883-project-admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:37:58.484690 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-57af64f2-723c-436a-991a-d2009960b377 tempest-VolumeQuotaClassesTest-234992883 tempest-VolumeQuotaClassesTest-234992883-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:37:58.550525 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57af64f2-723c-436a-991a-d2009960b377 tempest-VolumeQuotaClassesTest-234992883 tempest-VolumeQuotaClassesTest-234992883-project-admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:37:58.604832 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7ff1c4-c81f-464e-8a21-9580addcb667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:37:58.605447 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7ff1c4-c81f-464e-8a21-9580addcb667 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:37:58.605726 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7ff1c4-c81f-464e-8a21-9580addcb667 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:37:58.605996 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7ff1c4-c81f-464e-8a21-9580addcb667 admin admin] PATH_INFO: `/v3/users/821cebaae09f42eb818916e85e387f77` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:37:58.607143 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7ff1c4-c81f-464e-8a21-9580addcb667 admin admin] RBAC: Authorizing `identity:delete_user(user_id=821cebaae09f42eb818916e85e387f77)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:37:58.609038 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7ff1c4-c81f-464e-8a21-9580addcb667 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:37:58.629866 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:37:58.654883 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-af7ff1c4-c81f-464e-8a21-9580addcb667 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '821cebaae09f42eb818916e85e387f77'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:37:58.661679 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-af7ff1c4-c81f-464e-8a21-9580addcb667 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '821cebaae09f42eb818916e85e387f77'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:37:58.673437 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-af7ff1c4-c81f-464e-8a21-9580addcb667 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '821cebaae09f42eb818916e85e387f77'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:37:58.680590 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-af7ff1c4-c81f-464e-8a21-9580addcb667 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '821cebaae09f42eb818916e85e387f77'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:37:58.681737 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-af7ff1c4-c81f-464e-8a21-9580addcb667 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '821cebaae09f42eb818916e85e387f77'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:37:58.687619 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1355/2687] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 16:37:58 2022] DELETE /identity/v3/users/821cebaae09f42eb818916e85e387f77 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:37:58.692122 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31a7e4c-083e-4a35-bcef-8e350151e06f None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:37:58.692630 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31a7e4c-083e-4a35-bcef-8e350151e06f None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:37:58.692734 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31a7e4c-083e-4a35-bcef-8e350151e06f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:37:58.712848 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-a31a7e4c-083e-4a35-bcef-8e350151e06f None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:37:58.714054 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-a31a7e4c-083e-4a35-bcef-8e350151e06f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:37:58.770711 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1333/2688] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:37:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:37:58.780205 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7ff1c4-c81f-464e-8a21-9580addcb667 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:37:58.781659 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-af7ff1c4-c81f-464e-8a21-9580addcb667 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:37:58.846783 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7ff1c4-c81f-464e-8a21-9580addcb667 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:37:58.850472 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52ea140-8d94-4ef5-abbb-db5637c873ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f44bfdd5214e8d84a2c0a5b1fd9b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:37:58.851069 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52ea140-8d94-4ef5-abbb-db5637c873ca service neutron] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:37:58.851348 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52ea140-8d94-4ef5-abbb-db5637c873ca service neutron] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:37:58.851621 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52ea140-8d94-4ef5-abbb-db5637c873ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:37:58.861037 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52ea140-8d94-4ef5-abbb-db5637c873ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:37:58.862494 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52ea140-8d94-4ef5-abbb-db5637c873ca service neutron] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:37:58.872483 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1356/2689] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:37:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:37:59.131385 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31a7e4c-083e-4a35-bcef-8e350151e06f None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:37:59.132797 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-a31a7e4c-083e-4a35-bcef-8e350151e06f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:37:59.155468 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31a7e4c-083e-4a35-bcef-8e350151e06f None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:37:59.162203 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885ee52b-ca25-47e5-a454-8fe1827c40d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:37:59.163015 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885ee52b-ca25-47e5-a454-8fe1827c40d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:37:59.163360 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885ee52b-ca25-47e5-a454-8fe1827c40d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:37:59.163699 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885ee52b-ca25-47e5-a454-8fe1827c40d1 admin admin] PATH_INFO: `/v3/projects/a3caa3b5e8ed44619ff7732c453af39a` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:37:59.164894 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885ee52b-ca25-47e5-a454-8fe1827c40d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3caa3b5e8ed44619ff7732c453af39a)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:37:59.167468 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885ee52b-ca25-47e5-a454-8fe1827c40d1 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:37:59.174497 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:37:59.227770 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-885ee52b-ca25-47e5-a454-8fe1827c40d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3caa3b5e8ed44619ff7732c453af39a', 'request_id': 'req-885ee52b-ca25-47e5-a454-8fe1827c40d1'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:37:59.234906 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-885ee52b-ca25-47e5-a454-8fe1827c40d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3caa3b5e8ed44619ff7732c453af39a', 'request_id': 'req-885ee52b-ca25-47e5-a454-8fe1827c40d1'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:37:59.243425 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-885ee52b-ca25-47e5-a454-8fe1827c40d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3caa3b5e8ed44619ff7732c453af39a', 'request_id': 'req-885ee52b-ca25-47e5-a454-8fe1827c40d1'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:37:59.254230 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-885ee52b-ca25-47e5-a454-8fe1827c40d1 admin admin] The token cache is being invalidate because project a3caa3b5e8ed44619ff7732c453af39a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81445) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 16:37:59.254555 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-885ee52b-ca25-47e5-a454-8fe1827c40d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:37:59.255193 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-885ee52b-ca25-47e5-a454-8fe1827c40d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:37:59.256669 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1334/2690] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 16:37:59 2022] DELETE /identity/v3/projects/a3caa3b5e8ed44619ff7732c453af39a => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:37:59.260664 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52ea140-8d94-4ef5-abbb-db5637c873ca service neutron] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:37:59.270063 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52ea140-8d94-4ef5-abbb-db5637c873ca service neutron] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:37:59.326253 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea77496-8e5c-4833-8c7a-622d4b6531ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:37:59.326901 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea77496-8e5c-4833-8c7a-622d4b6531ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:37:59.327163 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea77496-8e5c-4833-8c7a-622d4b6531ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:37:59.327427 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea77496-8e5c-4833-8c7a-622d4b6531ad admin admin] PATH_INFO: `/v3/users/40f81edf02354e19985008f7b2263fca` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:37:59.328514 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea77496-8e5c-4833-8c7a-622d4b6531ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=40f81edf02354e19985008f7b2263fca)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:37:59.330455 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea77496-8e5c-4833-8c7a-622d4b6531ad admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:37:59.373896 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:37:59.376443 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-8ea77496-8e5c-4833-8c7a-622d4b6531ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40f81edf02354e19985008f7b2263fca'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:37:59.385267 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-8ea77496-8e5c-4833-8c7a-622d4b6531ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40f81edf02354e19985008f7b2263fca'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:37:59.397189 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-8ea77496-8e5c-4833-8c7a-622d4b6531ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40f81edf02354e19985008f7b2263fca'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:37:59.405054 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-8ea77496-8e5c-4833-8c7a-622d4b6531ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40f81edf02354e19985008f7b2263fca'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:37:59.405734 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-8ea77496-8e5c-4833-8c7a-622d4b6531ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40f81edf02354e19985008f7b2263fca'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:37:59.411677 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1357/2691] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 16:37:59 2022] DELETE /identity/v3/users/40f81edf02354e19985008f7b2263fca => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:37:59.678617 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885ee52b-ca25-47e5-a454-8fe1827c40d1 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:37:59.680059 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-885ee52b-ca25-47e5-a454-8fe1827c40d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:37:59.693642 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885ee52b-ca25-47e5-a454-8fe1827c40d1 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:37:59.752485 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff076ac8-3240-425a-9b7e-655152f0729c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:37:59.753109 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff076ac8-3240-425a-9b7e-655152f0729c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:37:59.753381 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff076ac8-3240-425a-9b7e-655152f0729c admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:37:59.753646 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff076ac8-3240-425a-9b7e-655152f0729c admin admin] PATH_INFO: `/v3/projects/c89273c9f27a464285473df9df8f25d2` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:37:59.754763 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff076ac8-3240-425a-9b7e-655152f0729c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c89273c9f27a464285473df9df8f25d2)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:37:59.756718 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff076ac8-3240-425a-9b7e-655152f0729c admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:37:59.802223 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-ff076ac8-3240-425a-9b7e-655152f0729c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c89273c9f27a464285473df9df8f25d2', 'request_id': 'req-ff076ac8-3240-425a-9b7e-655152f0729c'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:37:59.808105 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-ff076ac8-3240-425a-9b7e-655152f0729c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c89273c9f27a464285473df9df8f25d2', 'request_id': 'req-ff076ac8-3240-425a-9b7e-655152f0729c'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:37:59.815051 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-ff076ac8-3240-425a-9b7e-655152f0729c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c89273c9f27a464285473df9df8f25d2', 'request_id': 'req-ff076ac8-3240-425a-9b7e-655152f0729c'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:37:59.826199 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-ff076ac8-3240-425a-9b7e-655152f0729c admin admin] The token cache is being invalidate because project c89273c9f27a464285473df9df8f25d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81445) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 16:37:59.826591 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-ff076ac8-3240-425a-9b7e-655152f0729c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:37:59.827423 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-ff076ac8-3240-425a-9b7e-655152f0729c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:37:59.828937 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1335/2692] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 16:37:59 2022] DELETE /identity/v3/projects/c89273c9f27a464285473df9df8f25d2 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:37:59.833845 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdd6bff-0ffa-44b0-99ab-871f1ca2a331 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:37:59.834337 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdd6bff-0ffa-44b0-99ab-871f1ca2a331 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:37:59.834458 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdd6bff-0ffa-44b0-99ab-871f1ca2a331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:37:59.854056 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-8fdd6bff-0ffa-44b0-99ab-871f1ca2a331 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:37:59.855271 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-8fdd6bff-0ffa-44b0-99ab-871f1ca2a331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:37:59.912798 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1358/2693] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:37:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:37:59.920765 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e233aca2-7227-46a8-968a-89b262e96831 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:37:59.921053 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e233aca2-7227-46a8-968a-89b262e96831 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:37:59.921327 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e233aca2-7227-46a8-968a-89b262e96831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:37:59.941220 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-e233aca2-7227-46a8-968a-89b262e96831 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:37:59.942442 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-e233aca2-7227-46a8-968a-89b262e96831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:37:59.951119 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1336/2694] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:37:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:37:59.955136 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdd6bff-0ffa-44b0-99ab-871f1ca2a331 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:37:59.964600 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdd6bff-0ffa-44b0-99ab-871f1ca2a331 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:37:59.969124 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd3c1b8-f15b-4c11-a543-b76c1bbd868e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:37:59.969701 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd3c1b8-f15b-4c11-a543-b76c1bbd868e admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:37:59.969975 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd3c1b8-f15b-4c11-a543-b76c1bbd868e admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:37:59.970243 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd3c1b8-f15b-4c11-a543-b76c1bbd868e admin admin] PATH_INFO: `/v3/domains` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:37:59.970902 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd3c1b8-f15b-4c11-a543-b76c1bbd868e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:37:59.971199 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd3c1b8-f15b-4c11-a543-b76c1bbd868e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:37:59.972777 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd3c1b8-f15b-4c11-a543-b76c1bbd868e admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:37:59.984217 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1359/2695] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Sep 9 16:37:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:37:59.989277 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e233aca2-7227-46a8-968a-89b262e96831 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:37:59.999056 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e233aca2-7227-46a8-968a-89b262e96831 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:38:00.003666 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a16ecb-e52e-4578-ba68-b3f85a931d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:38:00.004248 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a16ecb-e52e-4578-ba68-b3f85a931d3c admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:38:00.004526 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a16ecb-e52e-4578-ba68-b3f85a931d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:38:00.004795 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a16ecb-e52e-4578-ba68-b3f85a931d3c admin admin] PATH_INFO: `/v3/projects` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:38:00.005406 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a16ecb-e52e-4578-ba68-b3f85a931d3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:38:00.007328 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a16ecb-e52e-4578-ba68-b3f85a931d3c admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:38:00.023116 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:38:00.041024 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1337/2696] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 16:37:59 2022] POST /identity/v3/projects => generated 407 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 16:38:00.045208 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd3c1b8-f15b-4c11-a543-b76c1bbd868e admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:38:00.055418 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd3c1b8-f15b-4c11-a543-b76c1bbd868e admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:38:00.111337 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee693b0-fd39-4289-9764-e42d09c4b32a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:38:00.111925 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee693b0-fd39-4289-9764-e42d09c4b32a admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:38:00.112200 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee693b0-fd39-4289-9764-e42d09c4b32a admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:38:00.112466 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee693b0-fd39-4289-9764-e42d09c4b32a admin admin] PATH_INFO: `/v3/users` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:38:00.113070 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee693b0-fd39-4289-9764-e42d09c4b32a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:38:00.114981 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee693b0-fd39-4289-9764-e42d09c4b32a admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:38:00.135912 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1360/2697] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 16:38:00 2022] POST /identity/v3/users => generated 304 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 16:38:00.140567 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a16ecb-e52e-4578-ba68-b3f85a931d3c admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:38:00.150350 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a16ecb-e52e-4578-ba68-b3f85a931d3c admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:38:00.154897 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6116134-d973-4039-b84e-2cd0197da4ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:38:00.155479 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6116134-d973-4039-b84e-2cd0197da4ac admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:38:00.155756 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6116134-d973-4039-b84e-2cd0197da4ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:38:00.156024 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6116134-d973-4039-b84e-2cd0197da4ac admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:38:00.156647 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6116134-d973-4039-b84e-2cd0197da4ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:38:00.158231 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6116134-d973-4039-b84e-2cd0197da4ac admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:38:00.167872 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1338/2698] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:38:00 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:38:00.171673 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee693b0-fd39-4289-9764-e42d09c4b32a admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:38:00.182002 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee693b0-fd39-4289-9764-e42d09c4b32a admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:38:00.186654 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b794ce3-567b-4a12-9ce4-faac43b01ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:38:00.187232 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b794ce3-567b-4a12-9ce4-faac43b01ea4 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:38:00.187507 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b794ce3-567b-4a12-9ce4-faac43b01ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:38:00.187775 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b794ce3-567b-4a12-9ce4-faac43b01ea4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:38:00.188429 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b794ce3-567b-4a12-9ce4-faac43b01ea4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:38:00.189994 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b794ce3-567b-4a12-9ce4-faac43b01ea4 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:38:00.200951 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1361/2699] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:38:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:38:00.204955 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6116134-d973-4039-b84e-2cd0197da4ac admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:38:00.215492 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6116134-d973-4039-b84e-2cd0197da4ac admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:38:00.220100 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b6f251-c9e9-44b7-9f42-612c721daf7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:38:00.220739 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b6f251-c9e9-44b7-9f42-612c721daf7f admin admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:38:00.221018 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b6f251-c9e9-44b7-9f42-612c721daf7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:38:00.221293 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b6f251-c9e9-44b7-9f42-612c721daf7f admin admin] PATH_INFO: `/v3/projects/ccda4a77d3414a9fabbf5c0642def515/users/02f815af4dd9481abfb44a676a03b362/roles/b38e84bf077846ee802e6bb1bad83522` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:38:00.236125 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b6f251-c9e9-44b7-9f42-612c721daf7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccda4a77d3414a9fabbf5c0642def515, user_id=02f815af4dd9481abfb44a676a03b362, role_id=b38e84bf077846ee802e6bb1bad83522)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:38:00.238817 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b6f251-c9e9-44b7-9f42-612c721daf7f admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:38:00.252128 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1339/2700] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 16:38:00 2022] PUT /identity/v3/projects/ccda4a77d3414a9fabbf5c0642def515/users/02f815af4dd9481abfb44a676a03b362/roles/b38e84bf077846ee802e6bb1bad83522 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 16:38:00.263162 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2777c876-1680-4d88-b273-ad1bbb13867c None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:38:00.263449 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2777c876-1680-4d88-b273-ad1bbb13867c None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:38:00.263719 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2777c876-1680-4d88-b273-ad1bbb13867c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:38:00.292342 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-2777c876-1680-4d88-b273-ad1bbb13867c None None] MFA Rules not processed for user `02f815af4dd9481abfb44a676a03b362`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:38:00.293655 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-2777c876-1680-4d88-b273-ad1bbb13867c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:38:00.306690 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:38:00.358894 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1362/2701] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:38:00 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:38:00.363536 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b6f251-c9e9-44b7-9f42-612c721daf7f admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:38:00.423597 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b6f251-c9e9-44b7-9f42-612c721daf7f admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:38:00.428200 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a94653-d3eb-4e52-aaa5-b1ab71bcef7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:38:00.428793 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a94653-d3eb-4e52-aaa5-b1ab71bcef7f admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:38:00.429065 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a94653-d3eb-4e52-aaa5-b1ab71bcef7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:38:00.429330 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a94653-d3eb-4e52-aaa5-b1ab71bcef7f admin admin] PATH_INFO: `/v3/projects` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:38:00.429935 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a94653-d3eb-4e52-aaa5-b1ab71bcef7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:38:00.433319 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a94653-d3eb-4e52-aaa5-b1ab71bcef7f admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:38:00.462957 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1340/2702] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 16:38:00 2022] POST /identity/v3/projects => generated 407 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:38:00.464006 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2777c876-1680-4d88-b273-ad1bbb13867c None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:38:00.474863 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2777c876-1680-4d88-b273-ad1bbb13867c None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:38:00.530741 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e309a5-96bf-45c6-9f5f-91e2ef61d755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:38:00.531336 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e309a5-96bf-45c6-9f5f-91e2ef61d755 admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:38:00.531615 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e309a5-96bf-45c6-9f5f-91e2ef61d755 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:38:00.531885 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e309a5-96bf-45c6-9f5f-91e2ef61d755 admin admin] PATH_INFO: `/v3/users` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:38:00.532536 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e309a5-96bf-45c6-9f5f-91e2ef61d755 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:38:00.534449 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e309a5-96bf-45c6-9f5f-91e2ef61d755 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:38:00.555465 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1363/2703] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 16:38:00 2022] POST /identity/v3/users => generated 310 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 16:38:00.560236 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a94653-d3eb-4e52-aaa5-b1ab71bcef7f admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:38:00.570362 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a94653-d3eb-4e52-aaa5-b1ab71bcef7f admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:38:00.575660 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d62183-9beb-4f39-be40-53c791faf86b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:38:00.576251 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d62183-9beb-4f39-be40-53c791faf86b admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:38:00.576524 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d62183-9beb-4f39-be40-53c791faf86b admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:38:00.576790 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d62183-9beb-4f39-be40-53c791faf86b admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:38:00.577409 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d62183-9beb-4f39-be40-53c791faf86b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:38:00.579040 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d62183-9beb-4f39-be40-53c791faf86b admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:38:00.590032 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1341/2704] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:38:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:38:00.594039 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e309a5-96bf-45c6-9f5f-91e2ef61d755 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:38:00.604046 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e309a5-96bf-45c6-9f5f-91e2ef61d755 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:38:00.608611 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcffc36-a946-42df-a64b-4587b4694ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:38:00.609240 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcffc36-a946-42df-a64b-4587b4694ee8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:38:00.609518 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcffc36-a946-42df-a64b-4587b4694ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:38:00.609788 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcffc36-a946-42df-a64b-4587b4694ee8 admin admin] PATH_INFO: `/v3/projects/8e6e997340334a168ecaae791e129c24/users/1fad0c49ff374c428f0081907446f8dd/roles/0a36d1be416f4089be19be979943b731` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:38:00.624180 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcffc36-a946-42df-a64b-4587b4694ee8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e6e997340334a168ecaae791e129c24, user_id=1fad0c49ff374c428f0081907446f8dd, role_id=0a36d1be416f4089be19be979943b731)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:38:00.626819 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcffc36-a946-42df-a64b-4587b4694ee8 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:38:00.640815 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1364/2705] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 16:38:00 2022] PUT /identity/v3/projects/8e6e997340334a168ecaae791e129c24/users/1fad0c49ff374c428f0081907446f8dd/roles/0a36d1be416f4089be19be979943b731 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 16:38:00.644827 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d62183-9beb-4f39-be40-53c791faf86b admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:38:00.655294 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d62183-9beb-4f39-be40-53c791faf86b admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:38:00.709840 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14b6d66-05c9-4b98-86ab-97ea3a3bc8e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:38:00.710480 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14b6d66-05c9-4b98-86ab-97ea3a3bc8e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:38:00.710729 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14b6d66-05c9-4b98-86ab-97ea3a3bc8e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:38:00.711002 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14b6d66-05c9-4b98-86ab-97ea3a3bc8e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:38:00.711622 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14b6d66-05c9-4b98-86ab-97ea3a3bc8e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:38:00.713250 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14b6d66-05c9-4b98-86ab-97ea3a3bc8e2 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:38:00.722671 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1342/2706] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:38:00 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:38:00.726940 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcffc36-a946-42df-a64b-4587b4694ee8 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:38:00.736967 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcffc36-a946-42df-a64b-4587b4694ee8 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:38:00.741743 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bb6945-f426-4375-9d5b-cd1520ff2f82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:38:00.742452 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bb6945-f426-4375-9d5b-cd1520ff2f82 admin admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:38:00.742736 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bb6945-f426-4375-9d5b-cd1520ff2f82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:38:00.743006 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bb6945-f426-4375-9d5b-cd1520ff2f82 admin admin] PATH_INFO: `/v3/projects/8e6e997340334a168ecaae791e129c24/users/1fad0c49ff374c428f0081907446f8dd/roles/0a36d1be416f4089be19be979943b731` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:38:00.745421 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bb6945-f426-4375-9d5b-cd1520ff2f82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e6e997340334a168ecaae791e129c24, user_id=1fad0c49ff374c428f0081907446f8dd, role_id=0a36d1be416f4089be19be979943b731)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:38:00.748150 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bb6945-f426-4375-9d5b-cd1520ff2f82 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:38:00.758610 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1365/2707] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 16:38:00 2022] PUT /identity/v3/projects/8e6e997340334a168ecaae791e129c24/users/1fad0c49ff374c428f0081907446f8dd/roles/0a36d1be416f4089be19be979943b731 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 16:38:00.770686 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d604d1b8-8dcd-465f-9fa2-f03b6f82159c None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:38:00.770972 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d604d1b8-8dcd-465f-9fa2-f03b6f82159c None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:38:00.771242 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d604d1b8-8dcd-465f-9fa2-f03b6f82159c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:38:00.797990 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-d604d1b8-8dcd-465f-9fa2-f03b6f82159c None None] MFA Rules not processed for user `1fad0c49ff374c428f0081907446f8dd`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:38:00.799233 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-d604d1b8-8dcd-465f-9fa2-f03b6f82159c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:38:00.817548 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:38:00.866441 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1343/2708] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:38:00 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:38:00.878373 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bb6945-f426-4375-9d5b-cd1520ff2f82 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:38:00.880084 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-e7bb6945-f426-4375-9d5b-cd1520ff2f82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:38:00.937338 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bb6945-f426-4375-9d5b-cd1520ff2f82 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:38:00.941063 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac7fd3b-afc1-49ef-b7cd-3d6c645d7526 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8078e791ba68460f8b3aeafb4b79b73a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:38:00.941652 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac7fd3b-afc1-49ef-b7cd-3d6c645d7526 service cinder] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:38:00.941928 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac7fd3b-afc1-49ef-b7cd-3d6c645d7526 service cinder] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:38:00.942193 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac7fd3b-afc1-49ef-b7cd-3d6c645d7526 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:38:00.952026 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac7fd3b-afc1-49ef-b7cd-3d6c645d7526 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:38:00.953438 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac7fd3b-afc1-49ef-b7cd-3d6c645d7526 service cinder] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:38:00.962728 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1366/2709] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:38:00 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:38:01.111299 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d604d1b8-8dcd-465f-9fa2-f03b6f82159c None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:38:01.120899 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d604d1b8-8dcd-465f-9fa2-f03b6f82159c None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:38:01.124403 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721f5be0-a00f-488b-880e-cb8bb9ce3c94 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8078e791ba68460f8b3aeafb4b79b73a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:38:01.124989 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721f5be0-a00f-488b-880e-cb8bb9ce3c94 service cinder] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:38:01.125265 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721f5be0-a00f-488b-880e-cb8bb9ce3c94 service cinder] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:38:01.125533 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721f5be0-a00f-488b-880e-cb8bb9ce3c94 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:38:01.180260 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721f5be0-a00f-488b-880e-cb8bb9ce3c94 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:38:01.181704 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721f5be0-a00f-488b-880e-cb8bb9ce3c94 service cinder] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:38:01.190485 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1344/2710] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:38:01 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:38:06.456890 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac7fd3b-afc1-49ef-b7cd-3d6c645d7526 service cinder] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:38:06.469548 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:38:06.524392 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac7fd3b-afc1-49ef-b7cd-3d6c645d7526 service cinder] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:38:06.530701 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3683ba74-a002-4767-909d-3cfaac9e1273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:38:06.531342 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3683ba74-a002-4767-909d-3cfaac9e1273 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:38:06.531620 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3683ba74-a002-4767-909d-3cfaac9e1273 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:38:06.531887 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3683ba74-a002-4767-909d-3cfaac9e1273 admin admin] PATH_INFO: `/v3/users/02f815af4dd9481abfb44a676a03b362` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:38:06.533003 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3683ba74-a002-4767-909d-3cfaac9e1273 admin admin] RBAC: Authorizing `identity:delete_user(user_id=02f815af4dd9481abfb44a676a03b362)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:38:06.535619 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3683ba74-a002-4767-909d-3cfaac9e1273 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:38:06.583131 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-3683ba74-a002-4767-909d-3cfaac9e1273 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02f815af4dd9481abfb44a676a03b362'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:38:06.590210 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-3683ba74-a002-4767-909d-3cfaac9e1273 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02f815af4dd9481abfb44a676a03b362'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:38:06.603738 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-3683ba74-a002-4767-909d-3cfaac9e1273 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02f815af4dd9481abfb44a676a03b362'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:38:06.611688 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-3683ba74-a002-4767-909d-3cfaac9e1273 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02f815af4dd9481abfb44a676a03b362'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:38:06.612343 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-3683ba74-a002-4767-909d-3cfaac9e1273 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02f815af4dd9481abfb44a676a03b362'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:38:06.619327 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1367/2711] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 16:38:06 2022] DELETE /identity/v3/users/02f815af4dd9481abfb44a676a03b362 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:38:06.624129 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26312d95-6ebb-45a1-baeb-f6b37de86c0c None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:38:06.624604 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26312d95-6ebb-45a1-baeb-f6b37de86c0c None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:38:06.624686 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26312d95-6ebb-45a1-baeb-f6b37de86c0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:38:06.645003 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-26312d95-6ebb-45a1-baeb-f6b37de86c0c None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:38:06.646240 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-26312d95-6ebb-45a1-baeb-f6b37de86c0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:38:06.708057 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1345/2712] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:38:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:38:06.718826 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3683ba74-a002-4767-909d-3cfaac9e1273 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:38:06.720352 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-3683ba74-a002-4767-909d-3cfaac9e1273 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:38:06.781901 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3683ba74-a002-4767-909d-3cfaac9e1273 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:38:06.785501 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21a0dc2-bced-4b94-8eda-3d3ea2d80c8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f44bfdd5214e8d84a2c0a5b1fd9b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:38:06.786100 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21a0dc2-bced-4b94-8eda-3d3ea2d80c8d service neutron] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:38:06.786412 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21a0dc2-bced-4b94-8eda-3d3ea2d80c8d service neutron] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:38:06.786684 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21a0dc2-bced-4b94-8eda-3d3ea2d80c8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:38:06.796675 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21a0dc2-bced-4b94-8eda-3d3ea2d80c8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:38:06.798104 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21a0dc2-bced-4b94-8eda-3d3ea2d80c8d service neutron] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:38:06.807798 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1368/2713] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:38:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:38:07.079475 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26312d95-6ebb-45a1-baeb-f6b37de86c0c None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:38:07.080911 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-26312d95-6ebb-45a1-baeb-f6b37de86c0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:38:07.093803 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26312d95-6ebb-45a1-baeb-f6b37de86c0c None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:38:07.098681 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef21f5b-f3c0-4f9b-9712-7d58057e6ecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:38:07.099228 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef21f5b-f3c0-4f9b-9712-7d58057e6ecc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:38:07.099514 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef21f5b-f3c0-4f9b-9712-7d58057e6ecc admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:38:07.099862 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef21f5b-f3c0-4f9b-9712-7d58057e6ecc admin admin] PATH_INFO: `/v3/projects/ccda4a77d3414a9fabbf5c0642def515` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:38:07.101328 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef21f5b-f3c0-4f9b-9712-7d58057e6ecc admin admin] RBAC: Authorizing `identity:delete_project(project_id=ccda4a77d3414a9fabbf5c0642def515)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:38:07.102885 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef21f5b-f3c0-4f9b-9712-7d58057e6ecc admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:38:07.155876 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-aef21f5b-f3c0-4f9b-9712-7d58057e6ecc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ccda4a77d3414a9fabbf5c0642def515', 'request_id': 'req-aef21f5b-f3c0-4f9b-9712-7d58057e6ecc'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:38:07.157394 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:38:07.165463 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-aef21f5b-f3c0-4f9b-9712-7d58057e6ecc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ccda4a77d3414a9fabbf5c0642def515', 'request_id': 'req-aef21f5b-f3c0-4f9b-9712-7d58057e6ecc'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:38:07.172886 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-aef21f5b-f3c0-4f9b-9712-7d58057e6ecc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ccda4a77d3414a9fabbf5c0642def515', 'request_id': 'req-aef21f5b-f3c0-4f9b-9712-7d58057e6ecc'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:38:07.183935 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-aef21f5b-f3c0-4f9b-9712-7d58057e6ecc admin admin] The token cache is being invalidate because project ccda4a77d3414a9fabbf5c0642def515 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81445) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 16:38:07.184230 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-aef21f5b-f3c0-4f9b-9712-7d58057e6ecc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:38:07.184863 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-aef21f5b-f3c0-4f9b-9712-7d58057e6ecc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:38:07.186546 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1346/2714] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 16:38:07 2022] DELETE /identity/v3/projects/ccda4a77d3414a9fabbf5c0642def515 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 16:38:07.190415 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21a0dc2-bced-4b94-8eda-3d3ea2d80c8d service neutron] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:38:07.201299 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21a0dc2-bced-4b94-8eda-3d3ea2d80c8d service neutron] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:38:07.232088 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:38:07.264180 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b30666d-4768-4025-a4f4-916ebfcfa16a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:38:07.264931 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b30666d-4768-4025-a4f4-916ebfcfa16a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:38:07.265211 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b30666d-4768-4025-a4f4-916ebfcfa16a admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:38:07.265481 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b30666d-4768-4025-a4f4-916ebfcfa16a admin admin] PATH_INFO: `/v3/users/1fad0c49ff374c428f0081907446f8dd` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:38:07.266632 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b30666d-4768-4025-a4f4-916ebfcfa16a admin admin] RBAC: Authorizing `identity:delete_user(user_id=1fad0c49ff374c428f0081907446f8dd)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:38:07.268684 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b30666d-4768-4025-a4f4-916ebfcfa16a admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:38:07.325855 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-5b30666d-4768-4025-a4f4-916ebfcfa16a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1fad0c49ff374c428f0081907446f8dd'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:38:07.332842 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-5b30666d-4768-4025-a4f4-916ebfcfa16a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1fad0c49ff374c428f0081907446f8dd'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:38:07.347871 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-5b30666d-4768-4025-a4f4-916ebfcfa16a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1fad0c49ff374c428f0081907446f8dd'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:38:07.358005 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-5b30666d-4768-4025-a4f4-916ebfcfa16a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1fad0c49ff374c428f0081907446f8dd'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:38:07.359388 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-5b30666d-4768-4025-a4f4-916ebfcfa16a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1fad0c49ff374c428f0081907446f8dd'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:38:07.365616 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1369/2715] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 16:38:07 2022] DELETE /identity/v3/users/1fad0c49ff374c428f0081907446f8dd => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:38:07.638544 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef21f5b-f3c0-4f9b-9712-7d58057e6ecc admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:38:07.641844 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-aef21f5b-f3c0-4f9b-9712-7d58057e6ecc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:38:07.669364 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef21f5b-f3c0-4f9b-9712-7d58057e6ecc admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:38:07.731276 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437fd731-ff84-458e-bf76-10b861a36d7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:38:07.731914 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437fd731-ff84-458e-bf76-10b861a36d7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:38:07.732190 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437fd731-ff84-458e-bf76-10b861a36d7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:38:07.732460 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437fd731-ff84-458e-bf76-10b861a36d7e admin admin] PATH_INFO: `/v3/projects/8e6e997340334a168ecaae791e129c24` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:38:07.733615 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437fd731-ff84-458e-bf76-10b861a36d7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e6e997340334a168ecaae791e129c24)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:38:07.735600 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437fd731-ff84-458e-bf76-10b861a36d7e admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:38:07.784660 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-437fd731-ff84-458e-bf76-10b861a36d7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e6e997340334a168ecaae791e129c24', 'request_id': 'req-437fd731-ff84-458e-bf76-10b861a36d7e'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:38:07.791608 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-437fd731-ff84-458e-bf76-10b861a36d7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e6e997340334a168ecaae791e129c24', 'request_id': 'req-437fd731-ff84-458e-bf76-10b861a36d7e'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:38:07.801085 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-437fd731-ff84-458e-bf76-10b861a36d7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e6e997340334a168ecaae791e129c24', 'request_id': 'req-437fd731-ff84-458e-bf76-10b861a36d7e'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:38:07.813628 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-437fd731-ff84-458e-bf76-10b861a36d7e admin admin] The token cache is being invalidate because project 8e6e997340334a168ecaae791e129c24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81445) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 16:38:07.813925 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-437fd731-ff84-458e-bf76-10b861a36d7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:38:07.814609 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-437fd731-ff84-458e-bf76-10b861a36d7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:38:07.816363 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1347/2716] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 16:38:07 2022] DELETE /identity/v3/projects/8e6e997340334a168ecaae791e129c24 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:38:07.821046 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd621d7e-bf89-48f8-85c9-a5c2cb9f0ae0 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:38:07.822146 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd621d7e-bf89-48f8-85c9-a5c2cb9f0ae0 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:38:07.822146 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd621d7e-bf89-48f8-85c9-a5c2cb9f0ae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:38:07.845744 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-dd621d7e-bf89-48f8-85c9-a5c2cb9f0ae0 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:38:07.846992 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-dd621d7e-bf89-48f8-85c9-a5c2cb9f0ae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:38:07.908540 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1370/2717] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:38:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:38:07.916993 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab0b23d-d419-4e7d-837d-25881fce76db None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:38:07.917364 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab0b23d-d419-4e7d-837d-25881fce76db None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:38:07.917650 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab0b23d-d419-4e7d-837d-25881fce76db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:38:07.938324 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-0ab0b23d-d419-4e7d-837d-25881fce76db None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:38:07.939611 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-0ab0b23d-d419-4e7d-837d-25881fce76db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:38:07.948409 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1348/2718] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:38:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:38:07.952793 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd621d7e-bf89-48f8-85c9-a5c2cb9f0ae0 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:38:07.963518 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd621d7e-bf89-48f8-85c9-a5c2cb9f0ae0 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:38:07.968179 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e421f2bd-6095-4c1f-9480-9b9bd7909ba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:38:07.968779 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e421f2bd-6095-4c1f-9480-9b9bd7909ba0 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:38:07.969053 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e421f2bd-6095-4c1f-9480-9b9bd7909ba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:38:07.969320 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e421f2bd-6095-4c1f-9480-9b9bd7909ba0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:38:07.969955 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e421f2bd-6095-4c1f-9480-9b9bd7909ba0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:38:07.970251 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e421f2bd-6095-4c1f-9480-9b9bd7909ba0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:38:07.971912 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e421f2bd-6095-4c1f-9480-9b9bd7909ba0 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:38:07.987700 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1371/2719] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Sep 9 16:38:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:38:07.988869 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab0b23d-d419-4e7d-837d-25881fce76db None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:38:07.998895 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab0b23d-d419-4e7d-837d-25881fce76db None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:38:08.003653 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7146ac5-33dc-46e2-aec8-2f732ad4f6f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:38:08.004263 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7146ac5-33dc-46e2-aec8-2f732ad4f6f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:38:08.004536 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7146ac5-33dc-46e2-aec8-2f732ad4f6f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:38:08.004801 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7146ac5-33dc-46e2-aec8-2f732ad4f6f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:38:08.005473 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7146ac5-33dc-46e2-aec8-2f732ad4f6f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:38:08.007418 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7146ac5-33dc-46e2-aec8-2f732ad4f6f1 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:38:08.034512 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1349/2720] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 16:38:07 2022] POST /identity/v3/projects => generated 375 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 16:38:08.038836 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e421f2bd-6095-4c1f-9480-9b9bd7909ba0 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:38:08.050367 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e421f2bd-6095-4c1f-9480-9b9bd7909ba0 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:38:08.090500 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:38:08.112247 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4be69a-4201-4d91-b3a0-f18f6441d0e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:38:08.112986 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4be69a-4201-4d91-b3a0-f18f6441d0e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:38:08.113264 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4be69a-4201-4d91-b3a0-f18f6441d0e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:38:08.113533 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4be69a-4201-4d91-b3a0-f18f6441d0e6 admin admin] PATH_INFO: `/v3/users` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:38:08.114155 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4be69a-4201-4d91-b3a0-f18f6441d0e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:38:08.116098 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4be69a-4201-4d91-b3a0-f18f6441d0e6 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:38:08.138964 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1372/2721] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 16:38:08 2022] POST /identity/v3/users => generated 288 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:38:08.143373 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7146ac5-33dc-46e2-aec8-2f732ad4f6f1 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:38:08.153972 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7146ac5-33dc-46e2-aec8-2f732ad4f6f1 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:38:08.158633 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453bfd96-19cd-4141-8a16-1ff9e6bdb8e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:38:08.159233 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453bfd96-19cd-4141-8a16-1ff9e6bdb8e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:38:08.159513 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453bfd96-19cd-4141-8a16-1ff9e6bdb8e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:38:08.159779 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453bfd96-19cd-4141-8a16-1ff9e6bdb8e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:38:08.160464 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453bfd96-19cd-4141-8a16-1ff9e6bdb8e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:38:08.162078 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453bfd96-19cd-4141-8a16-1ff9e6bdb8e2 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:38:08.172769 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1350/2722] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:38:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 16:38:08.176639 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4be69a-4201-4d91-b3a0-f18f6441d0e6 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:38:08.187431 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4be69a-4201-4d91-b3a0-f18f6441d0e6 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:38:08.192064 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bf47ed-59d7-4459-aef7-f7ee782b2688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:38:08.192648 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bf47ed-59d7-4459-aef7-f7ee782b2688 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:38:08.192929 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bf47ed-59d7-4459-aef7-f7ee782b2688 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:38:08.193230 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bf47ed-59d7-4459-aef7-f7ee782b2688 admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:38:08.193858 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bf47ed-59d7-4459-aef7-f7ee782b2688 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:38:08.195470 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bf47ed-59d7-4459-aef7-f7ee782b2688 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:38:08.207133 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1373/2723] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:38:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 16:38:08.211274 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453bfd96-19cd-4141-8a16-1ff9e6bdb8e2 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:38:08.221904 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453bfd96-19cd-4141-8a16-1ff9e6bdb8e2 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:38:08.226791 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c98c88-48e3-483d-94d0-1fe8f114f695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:38:08.228413 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c98c88-48e3-483d-94d0-1fe8f114f695 admin admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:38:08.228704 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c98c88-48e3-483d-94d0-1fe8f114f695 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:38:08.228970 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c98c88-48e3-483d-94d0-1fe8f114f695 admin admin] PATH_INFO: `/v3/projects/c19b324a42a745ab94448507a199c12a/users/9400f363815540dc8f943d0a1b96386c/roles/b38e84bf077846ee802e6bb1bad83522` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:38:08.244157 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c98c88-48e3-483d-94d0-1fe8f114f695 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c19b324a42a745ab94448507a199c12a, user_id=9400f363815540dc8f943d0a1b96386c, role_id=b38e84bf077846ee802e6bb1bad83522)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:38:08.247162 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c98c88-48e3-483d-94d0-1fe8f114f695 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:38:08.260208 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1351/2724] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 16:38:08 2022] PUT /identity/v3/projects/c19b324a42a745ab94448507a199c12a/users/9400f363815540dc8f943d0a1b96386c/roles/b38e84bf077846ee802e6bb1bad83522 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:38:08.273261 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce2e97d-755a-424f-981c-a78a3321ae4e None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:38:08.273543 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce2e97d-755a-424f-981c-a78a3321ae4e None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:38:08.273811 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce2e97d-755a-424f-981c-a78a3321ae4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:38:08.304883 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-5ce2e97d-755a-424f-981c-a78a3321ae4e None None] MFA Rules not processed for user `9400f363815540dc8f943d0a1b96386c`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:38:08.306082 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-5ce2e97d-755a-424f-981c-a78a3321ae4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:38:08.369700 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1374/2725] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:38:08 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:38:08.374378 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c98c88-48e3-483d-94d0-1fe8f114f695 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:38:08.380097 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:38:08.438868 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c98c88-48e3-483d-94d0-1fe8f114f695 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:38:08.443462 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bf9ee5-5710-4475-b9be-5fd0fd4b42b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:38:08.444049 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bf9ee5-5710-4475-b9be-5fd0fd4b42b3 admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:38:08.444324 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bf9ee5-5710-4475-b9be-5fd0fd4b42b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:38:08.444590 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bf9ee5-5710-4475-b9be-5fd0fd4b42b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:38:08.445205 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bf9ee5-5710-4475-b9be-5fd0fd4b42b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:38:08.447136 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bf9ee5-5710-4475-b9be-5fd0fd4b42b3 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:38:08.472976 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1352/2726] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 16:38:08 2022] POST /identity/v3/projects => generated 375 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:38:08.477136 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce2e97d-755a-424f-981c-a78a3321ae4e None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:38:08.488350 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce2e97d-755a-424f-981c-a78a3321ae4e None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:38:08.543271 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae41fa8b-716b-47f5-a44e-50f6391d9dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:38:08.543923 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae41fa8b-716b-47f5-a44e-50f6391d9dac admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:38:08.544147 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae41fa8b-716b-47f5-a44e-50f6391d9dac admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:38:08.544417 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae41fa8b-716b-47f5-a44e-50f6391d9dac admin admin] PATH_INFO: `/v3/users` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:38:08.545046 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae41fa8b-716b-47f5-a44e-50f6391d9dac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:38:08.546984 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae41fa8b-716b-47f5-a44e-50f6391d9dac admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:38:08.567554 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1375/2727] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 16:38:08 2022] POST /identity/v3/users => generated 294 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:38:08.572533 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bf9ee5-5710-4475-b9be-5fd0fd4b42b3 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:38:08.582833 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bf9ee5-5710-4475-b9be-5fd0fd4b42b3 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:38:08.588089 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fc5682-f80f-41bb-9679-88a1ee0e0c81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:38:08.588706 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fc5682-f80f-41bb-9679-88a1ee0e0c81 admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:38:08.588981 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fc5682-f80f-41bb-9679-88a1ee0e0c81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:38:08.589248 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fc5682-f80f-41bb-9679-88a1ee0e0c81 admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:38:08.589875 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fc5682-f80f-41bb-9679-88a1ee0e0c81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:38:08.591500 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fc5682-f80f-41bb-9679-88a1ee0e0c81 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:38:08.601821 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1353/2728] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:38:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:38:08.605951 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae41fa8b-716b-47f5-a44e-50f6391d9dac admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:38:08.616213 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae41fa8b-716b-47f5-a44e-50f6391d9dac admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:38:08.620898 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e72cca3-ce41-4e99-b07b-a256459dc2f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:38:08.621534 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e72cca3-ce41-4e99-b07b-a256459dc2f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:38:08.621814 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e72cca3-ce41-4e99-b07b-a256459dc2f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:38:08.622087 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e72cca3-ce41-4e99-b07b-a256459dc2f9 admin admin] PATH_INFO: `/v3/projects/44a9c8d8f54644a28c41a854ecc12c91/users/9f9218aea10349978ecf6f72f42671e5/roles/0a36d1be416f4089be19be979943b731` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:38:08.637115 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e72cca3-ce41-4e99-b07b-a256459dc2f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44a9c8d8f54644a28c41a854ecc12c91, user_id=9f9218aea10349978ecf6f72f42671e5, role_id=0a36d1be416f4089be19be979943b731)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:38:08.639920 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e72cca3-ce41-4e99-b07b-a256459dc2f9 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:38:08.652846 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1376/2729] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 16:38:08 2022] PUT /identity/v3/projects/44a9c8d8f54644a28c41a854ecc12c91/users/9f9218aea10349978ecf6f72f42671e5/roles/0a36d1be416f4089be19be979943b731 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 16:38:08.656653 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fc5682-f80f-41bb-9679-88a1ee0e0c81 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:38:08.667225 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fc5682-f80f-41bb-9679-88a1ee0e0c81 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:38:08.722774 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115a3892-e332-4a7e-8001-3c32e2deceaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:38:08.723368 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115a3892-e332-4a7e-8001-3c32e2deceaa admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:38:08.723646 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115a3892-e332-4a7e-8001-3c32e2deceaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:38:08.723917 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115a3892-e332-4a7e-8001-3c32e2deceaa admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:38:08.724538 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115a3892-e332-4a7e-8001-3c32e2deceaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:38:08.726137 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115a3892-e332-4a7e-8001-3c32e2deceaa admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:38:08.736091 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1354/2730] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:38:08 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:38:08.740160 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e72cca3-ce41-4e99-b07b-a256459dc2f9 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:38:08.750942 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e72cca3-ce41-4e99-b07b-a256459dc2f9 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:38:08.755424 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aec4b1-b126-4894-af3d-5fcb4576b3b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:38:08.756058 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aec4b1-b126-4894-af3d-5fcb4576b3b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:38:08.756329 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aec4b1-b126-4894-af3d-5fcb4576b3b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:38:08.756594 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aec4b1-b126-4894-af3d-5fcb4576b3b1 admin admin] PATH_INFO: `/v3/projects/44a9c8d8f54644a28c41a854ecc12c91/users/9f9218aea10349978ecf6f72f42671e5/roles/0a36d1be416f4089be19be979943b731` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:38:08.758495 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9aec4b1-b126-4894-af3d-5fcb4576b3b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44a9c8d8f54644a28c41a854ecc12c91, user_id=9f9218aea10349978ecf6f72f42671e5, role_id=0a36d1be416f4089be19be979943b731)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:38:08.761109 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9aec4b1-b126-4894-af3d-5fcb4576b3b1 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:38:08.767156 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:38:08.772317 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1377/2731] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 16:38:08 2022] PUT /identity/v3/projects/44a9c8d8f54644a28c41a854ecc12c91/users/9f9218aea10349978ecf6f72f42671e5/roles/0a36d1be416f4089be19be979943b731 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:38:08.782398 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abe2f5a-eef9-4827-81cc-10ccb4fe0dc0 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:38:08.782687 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abe2f5a-eef9-4827-81cc-10ccb4fe0dc0 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:38:08.782961 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abe2f5a-eef9-4827-81cc-10ccb4fe0dc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:38:08.812110 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-8abe2f5a-eef9-4827-81cc-10ccb4fe0dc0 None None] MFA Rules not processed for user `9f9218aea10349978ecf6f72f42671e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:38:08.813230 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-8abe2f5a-eef9-4827-81cc-10ccb4fe0dc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:38:08.878891 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:38:08.882931 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1355/2732] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:38:08 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:38:08.893717 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aec4b1-b126-4894-af3d-5fcb4576b3b1 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:38:08.895457 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-b9aec4b1-b126-4894-af3d-5fcb4576b3b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:38:08.952918 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aec4b1-b126-4894-af3d-5fcb4576b3b1 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:38:08.956515 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d78dbe-f763-4589-ad90-8cc82fbde129 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8078e791ba68460f8b3aeafb4b79b73a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:38:08.957100 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d78dbe-f763-4589-ad90-8cc82fbde129 service cinder] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:38:08.957374 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d78dbe-f763-4589-ad90-8cc82fbde129 service cinder] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:38:08.957640 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d78dbe-f763-4589-ad90-8cc82fbde129 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:38:09.015256 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d78dbe-f763-4589-ad90-8cc82fbde129 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:38:09.016685 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d78dbe-f763-4589-ad90-8cc82fbde129 service cinder] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:38:09.025791 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1378/2733] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:38:08 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:38:10.518068 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abe2f5a-eef9-4827-81cc-10ccb4fe0dc0 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:38:10.519691 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-8abe2f5a-eef9-4827-81cc-10ccb4fe0dc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:38:10.579324 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abe2f5a-eef9-4827-81cc-10ccb4fe0dc0 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:38:10.582858 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7603cc80-6d85-4d2a-b3ba-ee9c0a4cb6b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f44bfdd5214e8d84a2c0a5b1fd9b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:38:10.583456 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7603cc80-6d85-4d2a-b3ba-ee9c0a4cb6b5 service neutron] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:38:10.583735 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7603cc80-6d85-4d2a-b3ba-ee9c0a4cb6b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:38:10.584005 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7603cc80-6d85-4d2a-b3ba-ee9c0a4cb6b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:38:10.585724 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-7603cc80-6d85-4d2a-b3ba-ee9c0a4cb6b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:38:10.652513 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7603cc80-6d85-4d2a-b3ba-ee9c0a4cb6b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:38:10.653946 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7603cc80-6d85-4d2a-b3ba-ee9c0a4cb6b5 service neutron] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:38:10.664480 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1356/2734] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:38:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:38:11.582850 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d78dbe-f763-4589-ad90-8cc82fbde129 service cinder] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:38:11.594175 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d78dbe-f763-4589-ad90-8cc82fbde129 service cinder] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:38:11.598926 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41346114-be46-4e1c-b8c6-45dc0d1ce0b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:38:11.599763 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41346114-be46-4e1c-b8c6-45dc0d1ce0b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:38:11.600206 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41346114-be46-4e1c-b8c6-45dc0d1ce0b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:38:11.600506 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41346114-be46-4e1c-b8c6-45dc0d1ce0b7 admin admin] PATH_INFO: `/v3/users/9400f363815540dc8f943d0a1b96386c` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:38:11.601625 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41346114-be46-4e1c-b8c6-45dc0d1ce0b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9400f363815540dc8f943d0a1b96386c)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:38:11.603620 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41346114-be46-4e1c-b8c6-45dc0d1ce0b7 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:38:11.654199 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-41346114-be46-4e1c-b8c6-45dc0d1ce0b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9400f363815540dc8f943d0a1b96386c'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:38:11.661387 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-41346114-be46-4e1c-b8c6-45dc0d1ce0b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9400f363815540dc8f943d0a1b96386c'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:38:11.673692 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-41346114-be46-4e1c-b8c6-45dc0d1ce0b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9400f363815540dc8f943d0a1b96386c'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:38:11.681392 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-41346114-be46-4e1c-b8c6-45dc0d1ce0b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9400f363815540dc8f943d0a1b96386c'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:38:11.682238 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-41346114-be46-4e1c-b8c6-45dc0d1ce0b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9400f363815540dc8f943d0a1b96386c'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:38:11.688409 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1379/2735] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 16:38:11 2022] DELETE /identity/v3/users/9400f363815540dc8f943d0a1b96386c => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:38:11.693428 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f793b5d7-b59c-49e5-b247-76dfbec1248a None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:38:11.693813 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f793b5d7-b59c-49e5-b247-76dfbec1248a None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:38:11.694116 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f793b5d7-b59c-49e5-b247-76dfbec1248a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:38:11.714147 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-f793b5d7-b59c-49e5-b247-76dfbec1248a None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:38:11.715383 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-f793b5d7-b59c-49e5-b247-76dfbec1248a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:38:11.781865 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1357/2736] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:38:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 16:38:11.796457 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41346114-be46-4e1c-b8c6-45dc0d1ce0b7 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:38:11.798038 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-41346114-be46-4e1c-b8c6-45dc0d1ce0b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:38:11.835869 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:38:11.871236 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41346114-be46-4e1c-b8c6-45dc0d1ce0b7 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:38:11.875159 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943ac245-6da1-4937-b04d-a004c9b00aca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f44bfdd5214e8d84a2c0a5b1fd9b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:38:11.875785 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943ac245-6da1-4937-b04d-a004c9b00aca service neutron] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:38:11.876220 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943ac245-6da1-4937-b04d-a004c9b00aca service neutron] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:38:11.876503 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943ac245-6da1-4937-b04d-a004c9b00aca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:38:11.887258 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943ac245-6da1-4937-b04d-a004c9b00aca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:38:11.888712 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943ac245-6da1-4937-b04d-a004c9b00aca service neutron] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:38:11.904020 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1380/2737] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:38:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:38:12.354742 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f793b5d7-b59c-49e5-b247-76dfbec1248a None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:38:12.356793 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-f793b5d7-b59c-49e5-b247-76dfbec1248a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:38:12.376895 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f793b5d7-b59c-49e5-b247-76dfbec1248a None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:38:12.382833 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ae870e-89c0-4fc8-8fcb-1515010fd750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:38:12.383503 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ae870e-89c0-4fc8-8fcb-1515010fd750 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:38:12.384162 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ae870e-89c0-4fc8-8fcb-1515010fd750 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:38:12.384162 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ae870e-89c0-4fc8-8fcb-1515010fd750 admin admin] PATH_INFO: `/v3/projects/c19b324a42a745ab94448507a199c12a` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:38:12.385405 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ae870e-89c0-4fc8-8fcb-1515010fd750 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c19b324a42a745ab94448507a199c12a)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:38:12.387212 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ae870e-89c0-4fc8-8fcb-1515010fd750 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:38:12.437786 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:38:12.440668 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-75ae870e-89c0-4fc8-8fcb-1515010fd750 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c19b324a42a745ab94448507a199c12a', 'request_id': 'req-75ae870e-89c0-4fc8-8fcb-1515010fd750'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:38:12.452105 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-75ae870e-89c0-4fc8-8fcb-1515010fd750 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c19b324a42a745ab94448507a199c12a', 'request_id': 'req-75ae870e-89c0-4fc8-8fcb-1515010fd750'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:38:12.460463 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-75ae870e-89c0-4fc8-8fcb-1515010fd750 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c19b324a42a745ab94448507a199c12a', 'request_id': 'req-75ae870e-89c0-4fc8-8fcb-1515010fd750'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:38:12.475009 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-75ae870e-89c0-4fc8-8fcb-1515010fd750 admin admin] The token cache is being invalidate because project c19b324a42a745ab94448507a199c12a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81445) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 16:38:12.475458 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-75ae870e-89c0-4fc8-8fcb-1515010fd750 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:38:12.476203 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-75ae870e-89c0-4fc8-8fcb-1515010fd750 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:38:12.481856 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1358/2738] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 16:38:12 2022] DELETE /identity/v3/projects/c19b324a42a745ab94448507a199c12a => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:38:12.483527 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943ac245-6da1-4937-b04d-a004c9b00aca service neutron] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:38:12.494704 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943ac245-6da1-4937-b04d-a004c9b00aca service neutron] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:38:12.561027 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ebad6e-2f03-4ec5-a596-95cbae144527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:38:12.561664 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ebad6e-2f03-4ec5-a596-95cbae144527 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:38:12.561950 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ebad6e-2f03-4ec5-a596-95cbae144527 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:38:12.562217 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ebad6e-2f03-4ec5-a596-95cbae144527 admin admin] PATH_INFO: `/v3/users/9f9218aea10349978ecf6f72f42671e5` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:38:12.563429 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ebad6e-2f03-4ec5-a596-95cbae144527 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f9218aea10349978ecf6f72f42671e5)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:38:12.565399 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ebad6e-2f03-4ec5-a596-95cbae144527 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:38:12.631217 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-81ebad6e-2f03-4ec5-a596-95cbae144527 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f9218aea10349978ecf6f72f42671e5'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:38:12.639341 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-81ebad6e-2f03-4ec5-a596-95cbae144527 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f9218aea10349978ecf6f72f42671e5'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:38:12.654234 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-81ebad6e-2f03-4ec5-a596-95cbae144527 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f9218aea10349978ecf6f72f42671e5'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:38:12.662785 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-81ebad6e-2f03-4ec5-a596-95cbae144527 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f9218aea10349978ecf6f72f42671e5'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:38:12.663445 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-81ebad6e-2f03-4ec5-a596-95cbae144527 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f9218aea10349978ecf6f72f42671e5'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:38:12.672041 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1381/2739] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 16:38:12 2022] DELETE /identity/v3/users/9f9218aea10349978ecf6f72f42671e5 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:38:12.969188 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ae870e-89c0-4fc8-8fcb-1515010fd750 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:38:12.970774 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-75ae870e-89c0-4fc8-8fcb-1515010fd750 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:38:12.996395 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ae870e-89c0-4fc8-8fcb-1515010fd750 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:38:13.056565 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e787082f-e4ed-4eae-9674-4132862dfddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:38:13.057202 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e787082f-e4ed-4eae-9674-4132862dfddc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:38:13.057476 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e787082f-e4ed-4eae-9674-4132862dfddc admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:38:13.057746 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e787082f-e4ed-4eae-9674-4132862dfddc admin admin] PATH_INFO: `/v3/projects/44a9c8d8f54644a28c41a854ecc12c91` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:38:13.058891 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e787082f-e4ed-4eae-9674-4132862dfddc admin admin] RBAC: Authorizing `identity:delete_project(project_id=44a9c8d8f54644a28c41a854ecc12c91)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:38:13.060814 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e787082f-e4ed-4eae-9674-4132862dfddc admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:38:13.106326 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-e787082f-e4ed-4eae-9674-4132862dfddc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44a9c8d8f54644a28c41a854ecc12c91', 'request_id': 'req-e787082f-e4ed-4eae-9674-4132862dfddc'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:38:13.112384 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-e787082f-e4ed-4eae-9674-4132862dfddc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44a9c8d8f54644a28c41a854ecc12c91', 'request_id': 'req-e787082f-e4ed-4eae-9674-4132862dfddc'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:38:13.120707 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-e787082f-e4ed-4eae-9674-4132862dfddc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44a9c8d8f54644a28c41a854ecc12c91', 'request_id': 'req-e787082f-e4ed-4eae-9674-4132862dfddc'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:38:13.132180 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-e787082f-e4ed-4eae-9674-4132862dfddc admin admin] The token cache is being invalidate because project 44a9c8d8f54644a28c41a854ecc12c91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81445) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 16:38:13.132511 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-e787082f-e4ed-4eae-9674-4132862dfddc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:38:13.134402 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-e787082f-e4ed-4eae-9674-4132862dfddc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:38:13.135950 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1359/2740] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 16:38:12 2022] DELETE /identity/v3/projects/44a9c8d8f54644a28c41a854ecc12c91 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:38:13.140847 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a141504-9896-4c7d-9ca1-3bd83a06cd4e None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:38:13.141206 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a141504-9896-4c7d-9ca1-3bd83a06cd4e None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:38:13.141622 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a141504-9896-4c7d-9ca1-3bd83a06cd4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:38:13.161866 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-4a141504-9896-4c7d-9ca1-3bd83a06cd4e None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:38:13.163095 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-4a141504-9896-4c7d-9ca1-3bd83a06cd4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:38:13.208589 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:38:13.226359 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1382/2741] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:38:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:38:13.234386 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c68197-394b-4eaf-aa3a-3aba2cc750dd None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:38:13.234684 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c68197-394b-4eaf-aa3a-3aba2cc750dd None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:38:13.234963 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c68197-394b-4eaf-aa3a-3aba2cc750dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:38:13.255965 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-41c68197-394b-4eaf-aa3a-3aba2cc750dd None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:38:13.257211 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-41c68197-394b-4eaf-aa3a-3aba2cc750dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:38:13.269924 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1360/2742] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:38:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:38:13.271195 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a141504-9896-4c7d-9ca1-3bd83a06cd4e None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:38:13.290710 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a141504-9896-4c7d-9ca1-3bd83a06cd4e None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:38:13.297516 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d583d42-d224-46e4-b00d-6f6739f9ab8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:38:13.297516 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d583d42-d224-46e4-b00d-6f6739f9ab8b admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:38:13.297773 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d583d42-d224-46e4-b00d-6f6739f9ab8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:38:13.298097 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d583d42-d224-46e4-b00d-6f6739f9ab8b admin admin] PATH_INFO: `/v3/domains` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:38:13.298803 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d583d42-d224-46e4-b00d-6f6739f9ab8b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:38:13.299531 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d583d42-d224-46e4-b00d-6f6739f9ab8b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:38:13.300719 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d583d42-d224-46e4-b00d-6f6739f9ab8b admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:38:13.315755 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1383/2743] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Sep 9 16:38:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 16:38:13.320319 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c68197-394b-4eaf-aa3a-3aba2cc750dd None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:38:13.331540 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c68197-394b-4eaf-aa3a-3aba2cc750dd None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:38:13.337902 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272aa73e-ed30-471a-b16c-e851a8d48200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:38:13.338730 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272aa73e-ed30-471a-b16c-e851a8d48200 admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:38:13.339155 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272aa73e-ed30-471a-b16c-e851a8d48200 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:38:13.339457 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272aa73e-ed30-471a-b16c-e851a8d48200 admin admin] PATH_INFO: `/v3/projects` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:38:13.340227 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272aa73e-ed30-471a-b16c-e851a8d48200 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:38:13.342339 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272aa73e-ed30-471a-b16c-e851a8d48200 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:38:13.371060 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1361/2744] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 16:38:13 2022] POST /identity/v3/projects => generated 373 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:38:13.375441 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d583d42-d224-46e4-b00d-6f6739f9ab8b admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:38:13.386115 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d583d42-d224-46e4-b00d-6f6739f9ab8b admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:38:13.445108 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e7e759-0501-4db3-8c1e-f1288210910e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:38:13.445712 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e7e759-0501-4db3-8c1e-f1288210910e admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:38:13.445986 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e7e759-0501-4db3-8c1e-f1288210910e admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:38:13.446251 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e7e759-0501-4db3-8c1e-f1288210910e admin admin] PATH_INFO: `/v3/users` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:38:13.447772 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e7e759-0501-4db3-8c1e-f1288210910e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:38:13.449659 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e7e759-0501-4db3-8c1e-f1288210910e admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:38:13.471718 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1384/2745] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 16:38:13 2022] POST /identity/v3/users => generated 287 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:38:13.475709 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272aa73e-ed30-471a-b16c-e851a8d48200 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:38:13.489811 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272aa73e-ed30-471a-b16c-e851a8d48200 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:38:13.495400 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa51dd67-3254-4603-af42-561559252dd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:38:13.496401 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa51dd67-3254-4603-af42-561559252dd7 admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:38:13.496401 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa51dd67-3254-4603-af42-561559252dd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:38:13.496742 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa51dd67-3254-4603-af42-561559252dd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:38:13.497439 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa51dd67-3254-4603-af42-561559252dd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:38:13.499136 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa51dd67-3254-4603-af42-561559252dd7 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:38:13.513545 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1362/2746] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:38:13 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 16:38:13.514870 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e7e759-0501-4db3-8c1e-f1288210910e admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:38:13.525523 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e7e759-0501-4db3-8c1e-f1288210910e admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:38:13.530477 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a800f3-fb39-4ddf-ac5e-2a4f1f45149d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:38:13.531183 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a800f3-fb39-4ddf-ac5e-2a4f1f45149d admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:38:13.531558 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a800f3-fb39-4ddf-ac5e-2a4f1f45149d admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:38:13.532950 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a800f3-fb39-4ddf-ac5e-2a4f1f45149d admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:38:13.532950 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a800f3-fb39-4ddf-ac5e-2a4f1f45149d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:38:13.535135 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a800f3-fb39-4ddf-ac5e-2a4f1f45149d admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:38:13.549728 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1385/2747] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:38:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:38:13.550970 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa51dd67-3254-4603-af42-561559252dd7 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:38:13.564517 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa51dd67-3254-4603-af42-561559252dd7 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:38:13.575704 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabb9111-c8c3-4f6a-9a1f-76085dc7b31d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:38:13.576371 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabb9111-c8c3-4f6a-9a1f-76085dc7b31d admin admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:38:13.576645 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabb9111-c8c3-4f6a-9a1f-76085dc7b31d admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:38:13.576914 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabb9111-c8c3-4f6a-9a1f-76085dc7b31d admin admin] PATH_INFO: `/v3/projects/5d76cf2ccfeb4a97ba4feeff06b1ce09/users/d0aab948f79542cd818063bba0099497/roles/b38e84bf077846ee802e6bb1bad83522` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:38:13.596291 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabb9111-c8c3-4f6a-9a1f-76085dc7b31d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d76cf2ccfeb4a97ba4feeff06b1ce09, user_id=d0aab948f79542cd818063bba0099497, role_id=b38e84bf077846ee802e6bb1bad83522)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:38:13.599443 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabb9111-c8c3-4f6a-9a1f-76085dc7b31d admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:38:13.612210 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:DELETE=11,keystone:SELECT=85,keystone:INSERT=4 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:38:13.619750 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1363/2748] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 16:38:13 2022] PUT /identity/v3/projects/5d76cf2ccfeb4a97ba4feeff06b1ce09/users/d0aab948f79542cd818063bba0099497/roles/b38e84bf077846ee802e6bb1bad83522 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:38:13.625364 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c24277a-205b-4e45-b75e-a2bce5117e39 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:38:13.625658 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c24277a-205b-4e45-b75e-a2bce5117e39 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:38:13.625907 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c24277a-205b-4e45-b75e-a2bce5117e39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:38:13.647160 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-2c24277a-205b-4e45-b75e-a2bce5117e39 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:38:13.648841 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-2c24277a-205b-4e45-b75e-a2bce5117e39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:38:13.735444 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1386/2749] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:38:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:38:13.742350 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabb9111-c8c3-4f6a-9a1f-76085dc7b31d admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:38:13.744676 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-aabb9111-c8c3-4f6a-9a1f-76085dc7b31d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:38:13.808856 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabb9111-c8c3-4f6a-9a1f-76085dc7b31d admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:38:13.813020 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5d57e9-59cc-489e-a19c-3b943ade7e4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f44bfdd5214e8d84a2c0a5b1fd9b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:38:13.813802 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5d57e9-59cc-489e-a19c-3b943ade7e4d service neutron] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:38:13.814181 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5d57e9-59cc-489e-a19c-3b943ade7e4d service neutron] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:38:13.814581 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5d57e9-59cc-489e-a19c-3b943ade7e4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:38:13.830407 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5d57e9-59cc-489e-a19c-3b943ade7e4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:38:13.832492 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5d57e9-59cc-489e-a19c-3b943ade7e4d service neutron] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:38:13.847962 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1364/2750] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:38:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:38:14.092158 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c24277a-205b-4e45-b75e-a2bce5117e39 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:38:14.093630 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-2c24277a-205b-4e45-b75e-a2bce5117e39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:38:14.109564 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c24277a-205b-4e45-b75e-a2bce5117e39 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:38:14.119174 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bdb185-89ee-494a-a184-b6c76b58607b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:38:14.119935 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bdb185-89ee-494a-a184-b6c76b58607b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:38:14.120321 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bdb185-89ee-494a-a184-b6c76b58607b admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:38:14.120688 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bdb185-89ee-494a-a184-b6c76b58607b admin admin] PATH_INFO: `/v3/users/7ea10dd1db74490687a8be5a6f5a6f8a` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:38:14.122132 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bdb185-89ee-494a-a184-b6c76b58607b admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ea10dd1db74490687a8be5a6f5a6f8a)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:38:14.127792 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bdb185-89ee-494a-a184-b6c76b58607b admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:38:14.189432 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-78bdb185-89ee-494a-a184-b6c76b58607b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ea10dd1db74490687a8be5a6f5a6f8a'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:38:14.191582 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:38:14.199098 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-78bdb185-89ee-494a-a184-b6c76b58607b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ea10dd1db74490687a8be5a6f5a6f8a'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:38:14.217939 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-78bdb185-89ee-494a-a184-b6c76b58607b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ea10dd1db74490687a8be5a6f5a6f8a'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:38:14.225473 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-78bdb185-89ee-494a-a184-b6c76b58607b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ea10dd1db74490687a8be5a6f5a6f8a'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:38:14.226213 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-78bdb185-89ee-494a-a184-b6c76b58607b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ea10dd1db74490687a8be5a6f5a6f8a'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:38:14.239187 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1387/2751] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 16:38:14 2022] DELETE /identity/v3/users/7ea10dd1db74490687a8be5a6f5a6f8a => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:38:14.466976 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5d57e9-59cc-489e-a19c-3b943ade7e4d service neutron] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:38:14.478557 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5d57e9-59cc-489e-a19c-3b943ade7e4d service neutron] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:38:14.547283 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15431dd-613c-404c-97be-33c4d3920bf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:38:14.548083 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15431dd-613c-404c-97be-33c4d3920bf5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:38:14.548363 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15431dd-613c-404c-97be-33c4d3920bf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:38:14.548634 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15431dd-613c-404c-97be-33c4d3920bf5 admin admin] PATH_INFO: `/v3/projects/cd7e1e9657704ce29893a94c0fe7bb7f` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:38:14.549752 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15431dd-613c-404c-97be-33c4d3920bf5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd7e1e9657704ce29893a94c0fe7bb7f)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:38:14.551708 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15431dd-613c-404c-97be-33c4d3920bf5 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:38:14.605880 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-d15431dd-613c-404c-97be-33c4d3920bf5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd7e1e9657704ce29893a94c0fe7bb7f', 'request_id': 'req-d15431dd-613c-404c-97be-33c4d3920bf5'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:38:14.615290 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-d15431dd-613c-404c-97be-33c4d3920bf5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd7e1e9657704ce29893a94c0fe7bb7f', 'request_id': 'req-d15431dd-613c-404c-97be-33c4d3920bf5'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:38:14.624997 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-d15431dd-613c-404c-97be-33c4d3920bf5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd7e1e9657704ce29893a94c0fe7bb7f', 'request_id': 'req-d15431dd-613c-404c-97be-33c4d3920bf5'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:38:14.641155 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0cf067-a408-4488-97ea-214a50579e9f None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:38:14.641451 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0cf067-a408-4488-97ea-214a50579e9f None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:38:14.641728 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0cf067-a408-4488-97ea-214a50579e9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:38:14.643996 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-d15431dd-613c-404c-97be-33c4d3920bf5 admin admin] The token cache is being invalidate because project cd7e1e9657704ce29893a94c0fe7bb7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81445) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 16:38:14.644369 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-d15431dd-613c-404c-97be-33c4d3920bf5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:38:14.645287 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-d15431dd-613c-404c-97be-33c4d3920bf5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:38:14.647790 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1365/2752] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 16:38:14 2022] DELETE /identity/v3/projects/cd7e1e9657704ce29893a94c0fe7bb7f => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:38:14.653253 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afccf54-5abb-45da-a56c-414af231869e None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:38:14.653669 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afccf54-5abb-45da-a56c-414af231869e None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:38:14.653864 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afccf54-5abb-45da-a56c-414af231869e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:38:14.676907 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-3a0cf067-a408-4488-97ea-214a50579e9f None None] MFA Rules not processed for user `d0aab948f79542cd818063bba0099497`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:38:14.678577 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-2afccf54-5abb-45da-a56c-414af231869e None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:38:14.679098 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-3a0cf067-a408-4488-97ea-214a50579e9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:38:14.679934 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-2afccf54-5abb-45da-a56c-414af231869e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:38:14.729252 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:38:14.766443 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1388/2753] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:38:14 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 16:38:14.775184 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1366/2754] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:38:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 16:38:14.779716 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0cf067-a408-4488-97ea-214a50579e9f None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:38:14.781144 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-3a0cf067-a408-4488-97ea-214a50579e9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:38:14.781768 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed623d3e-28ad-4179-b027-10cb1c0897fa None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:38:14.782089 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed623d3e-28ad-4179-b027-10cb1c0897fa None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:38:14.782398 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed623d3e-28ad-4179-b027-10cb1c0897fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:38:14.802467 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-ed623d3e-28ad-4179-b027-10cb1c0897fa None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:38:14.803682 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-ed623d3e-28ad-4179-b027-10cb1c0897fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:38:14.812858 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1367/2755] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:38:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:38:14.817120 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed623d3e-28ad-4179-b027-10cb1c0897fa None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:38:14.829363 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed623d3e-28ad-4179-b027-10cb1c0897fa None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:38:14.836169 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0835f87c-08b1-49d1-a055-44aeaffa60af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:38:14.836778 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0835f87c-08b1-49d1-a055-44aeaffa60af admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:38:14.837152 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0835f87c-08b1-49d1-a055-44aeaffa60af admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:38:14.837940 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0835f87c-08b1-49d1-a055-44aeaffa60af admin admin] PATH_INFO: `/v3/domains` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:38:14.838620 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0835f87c-08b1-49d1-a055-44aeaffa60af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:38:14.838922 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0835f87c-08b1-49d1-a055-44aeaffa60af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:38:14.840530 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0835f87c-08b1-49d1-a055-44aeaffa60af admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:38:14.847355 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0cf067-a408-4488-97ea-214a50579e9f None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:38:14.851014 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71a4694-d30f-46ce-a3a8-054a719a95f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8078e791ba68460f8b3aeafb4b79b73a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:38:14.851643 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71a4694-d30f-46ce-a3a8-054a719a95f4 service cinder] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:38:14.851922 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71a4694-d30f-46ce-a3a8-054a719a95f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:38:14.852194 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71a4694-d30f-46ce-a3a8-054a719a95f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:38:14.852316 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1368/2756] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Sep 9 16:38:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 16:38:14.856620 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0835f87c-08b1-49d1-a055-44aeaffa60af admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:38:14.862909 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71a4694-d30f-46ce-a3a8-054a719a95f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:38:14.864379 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71a4694-d30f-46ce-a3a8-054a719a95f4 service cinder] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:38:14.866519 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0835f87c-08b1-49d1-a055-44aeaffa60af admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:38:14.871196 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fc6196-ab53-4eff-8290-8dc47aa5c15e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:38:14.871798 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fc6196-ab53-4eff-8290-8dc47aa5c15e admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:38:14.872072 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fc6196-ab53-4eff-8290-8dc47aa5c15e admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:38:14.872336 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fc6196-ab53-4eff-8290-8dc47aa5c15e admin admin] PATH_INFO: `/v3/projects` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:38:14.872937 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fc6196-ab53-4eff-8290-8dc47aa5c15e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:38:14.873456 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1389/2757] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:38:14 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 16:38:14.874829 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fc6196-ab53-4eff-8290-8dc47aa5c15e admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:38:14.904310 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1369/2758] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 16:38:14 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 16:38:14.908691 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71a4694-d30f-46ce-a3a8-054a719a95f4 service cinder] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:38:14.920550 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71a4694-d30f-46ce-a3a8-054a719a95f4 service cinder] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:38:14.978963 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2613fb-b677-44eb-a4a2-89d5d7a4d0ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:38:14.979567 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2613fb-b677-44eb-a4a2-89d5d7a4d0ba admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:38:14.979849 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2613fb-b677-44eb-a4a2-89d5d7a4d0ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:38:14.980122 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2613fb-b677-44eb-a4a2-89d5d7a4d0ba admin admin] PATH_INFO: `/v3/users` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:38:14.980749 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2613fb-b677-44eb-a4a2-89d5d7a4d0ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:38:14.982679 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2613fb-b677-44eb-a4a2-89d5d7a4d0ba admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:38:14.990581 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:38:15.018399 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1390/2759] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 16:38:14 2022] POST /identity/v3/users => generated 293 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:38:15.019665 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fc6196-ab53-4eff-8290-8dc47aa5c15e admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:38:15.031865 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fc6196-ab53-4eff-8290-8dc47aa5c15e admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:38:15.038701 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1c8967-f195-4de0-9956-ec743e848c45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:38:15.039372 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1c8967-f195-4de0-9956-ec743e848c45 admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:38:15.039760 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1c8967-f195-4de0-9956-ec743e848c45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:38:15.040015 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1c8967-f195-4de0-9956-ec743e848c45 admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:38:15.041367 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1c8967-f195-4de0-9956-ec743e848c45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:38:15.043113 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1c8967-f195-4de0-9956-ec743e848c45 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:38:15.053617 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1370/2760] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:38:15 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:38:15.057548 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2613fb-b677-44eb-a4a2-89d5d7a4d0ba admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:38:15.068114 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2613fb-b677-44eb-a4a2-89d5d7a4d0ba admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:38:15.073006 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0454167-27b9-4fd6-89f3-cafa4959355d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:38:15.073628 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0454167-27b9-4fd6-89f3-cafa4959355d admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:38:15.073904 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0454167-27b9-4fd6-89f3-cafa4959355d admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:38:15.074177 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0454167-27b9-4fd6-89f3-cafa4959355d admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:38:15.074836 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0454167-27b9-4fd6-89f3-cafa4959355d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:38:15.076419 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0454167-27b9-4fd6-89f3-cafa4959355d admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:38:15.087684 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1391/2761] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:38:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:38:15.091818 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1c8967-f195-4de0-9956-ec743e848c45 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:38:15.102624 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1c8967-f195-4de0-9956-ec743e848c45 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:38:15.108364 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd32714-ce8d-4606-8d66-e02dabeabb79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:38:15.109015 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd32714-ce8d-4606-8d66-e02dabeabb79 admin admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:38:15.109296 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd32714-ce8d-4606-8d66-e02dabeabb79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:38:15.109565 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd32714-ce8d-4606-8d66-e02dabeabb79 admin admin] PATH_INFO: `/v3/projects/61d607ed80c542a6911bbd4ad0f5c91c/users/60af222382244caaab2175c83b78c47d/roles/b38e84bf077846ee802e6bb1bad83522` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:38:15.135966 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd32714-ce8d-4606-8d66-e02dabeabb79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61d607ed80c542a6911bbd4ad0f5c91c, user_id=60af222382244caaab2175c83b78c47d, role_id=b38e84bf077846ee802e6bb1bad83522)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:38:15.138988 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd32714-ce8d-4606-8d66-e02dabeabb79 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:38:15.155508 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1371/2762] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 16:38:15 2022] PUT /identity/v3/projects/61d607ed80c542a6911bbd4ad0f5c91c/users/60af222382244caaab2175c83b78c47d/roles/b38e84bf077846ee802e6bb1bad83522 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:38:15.160509 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc14799d-df55-4339-a999-7b20fb38c168 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:38:15.160828 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc14799d-df55-4339-a999-7b20fb38c168 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:38:15.161106 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc14799d-df55-4339-a999-7b20fb38c168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:38:15.182448 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-bc14799d-df55-4339-a999-7b20fb38c168 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:38:15.183678 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-bc14799d-df55-4339-a999-7b20fb38c168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:38:15.251352 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1392/2763] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:38:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 16:38:15.261831 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd32714-ce8d-4606-8d66-e02dabeabb79 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:38:15.263602 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-2bd32714-ce8d-4606-8d66-e02dabeabb79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:38:15.320523 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd32714-ce8d-4606-8d66-e02dabeabb79 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:38:15.325001 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6f508d-362e-4dbe-820f-bc4dfc83cb7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f44bfdd5214e8d84a2c0a5b1fd9b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:38:15.325620 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6f508d-362e-4dbe-820f-bc4dfc83cb7d service neutron] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:38:15.325915 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6f508d-362e-4dbe-820f-bc4dfc83cb7d service neutron] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:38:15.326183 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6f508d-362e-4dbe-820f-bc4dfc83cb7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:38:15.335084 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6f508d-362e-4dbe-820f-bc4dfc83cb7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:38:15.336503 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6f508d-362e-4dbe-820f-bc4dfc83cb7d service neutron] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:38:15.345755 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1372/2764] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:38:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:38:16.265217 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8034b7e0-8937-40dc-afed-1f1c6ee1ce80 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:38:16.266176 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8034b7e0-8937-40dc-afed-1f1c6ee1ce80 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:38:16.266737 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8034b7e0-8937-40dc-afed-1f1c6ee1ce80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:38:16.303581 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-8034b7e0-8937-40dc-afed-1f1c6ee1ce80 None None] MFA Rules not processed for user `d0aab948f79542cd818063bba0099497`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:38:16.305011 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-8034b7e0-8937-40dc-afed-1f1c6ee1ce80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:38:16.374150 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1393/2765] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:38:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:38:16.652537 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6f508d-362e-4dbe-820f-bc4dfc83cb7d service neutron] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:38:16.654060 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-ac6f508d-362e-4dbe-820f-bc4dfc83cb7d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:38:16.680619 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6f508d-362e-4dbe-820f-bc4dfc83cb7d service neutron] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:38:16.685304 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f5d4b4-d08f-4aef-9b84-3f249abb8526 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f44bfdd5214e8d84a2c0a5b1fd9b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:38:16.685914 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f5d4b4-d08f-4aef-9b84-3f249abb8526 service neutron] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:38:16.686386 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f5d4b4-d08f-4aef-9b84-3f249abb8526 service neutron] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:38:16.686668 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f5d4b4-d08f-4aef-9b84-3f249abb8526 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:38:16.688829 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-38f5d4b4-d08f-4aef-9b84-3f249abb8526 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:38:16.702623 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f5d4b4-d08f-4aef-9b84-3f249abb8526 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:38:16.704147 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f5d4b4-d08f-4aef-9b84-3f249abb8526 service neutron] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:38:16.718478 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1373/2766] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:38:16 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:38:20.510178 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c3a9b1-bf45-4696-8b97-85f63096f9e3 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:38:20.510722 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c3a9b1-bf45-4696-8b97-85f63096f9e3 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:38:20.511003 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c3a9b1-bf45-4696-8b97-85f63096f9e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:38:20.545600 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-46c3a9b1-bf45-4696-8b97-85f63096f9e3 None None] MFA Rules not processed for user `60af222382244caaab2175c83b78c47d`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:38:20.547425 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-46c3a9b1-bf45-4696-8b97-85f63096f9e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:38:20.633459 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:38:20.638572 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1394/2767] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:38:20 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:38:20.653617 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f5d4b4-d08f-4aef-9b84-3f249abb8526 service neutron] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:38:20.655141 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-38f5d4b4-d08f-4aef-9b84-3f249abb8526 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:38:20.700408 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:38:20.788697 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f5d4b4-d08f-4aef-9b84-3f249abb8526 service neutron] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:38:20.795886 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43eb9ad-12a8-452b-bd49-53224d98b387 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a332b9b4980646a3b14633293f77b505', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:38:20.796631 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43eb9ad-12a8-452b-bd49-53224d98b387 service nova] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:38:20.796987 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43eb9ad-12a8-452b-bd49-53224d98b387 service nova] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:38:20.797360 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43eb9ad-12a8-452b-bd49-53224d98b387 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:38:20.808326 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43eb9ad-12a8-452b-bd49-53224d98b387 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:38:20.810283 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43eb9ad-12a8-452b-bd49-53224d98b387 service nova] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:38:20.820645 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1374/2768] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:38:20 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:38:22.214052 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1dde41-3069-4290-a3d4-02b52e5eda92 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:38:22.216028 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1dde41-3069-4290-a3d4-02b52e5eda92 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:38:22.216558 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1dde41-3069-4290-a3d4-02b52e5eda92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:38:22.244396 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-6a1dde41-3069-4290-a3d4-02b52e5eda92 None None] MFA Rules not processed for user `60af222382244caaab2175c83b78c47d`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:38:22.246331 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-6a1dde41-3069-4290-a3d4-02b52e5eda92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:38:22.261580 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1395/2769] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:38:22 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:38:22.639594 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43eb9ad-12a8-452b-bd49-53224d98b387 service nova] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:38:22.663094 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43eb9ad-12a8-452b-bd49-53224d98b387 service nova] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:38:22.667303 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8545fdb-1f21-418e-8ed8-6b3c6d10f531 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f44bfdd5214e8d84a2c0a5b1fd9b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:38:22.667899 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8545fdb-1f21-418e-8ed8-6b3c6d10f531 service neutron] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:38:22.668178 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8545fdb-1f21-418e-8ed8-6b3c6d10f531 service neutron] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:38:22.668433 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8545fdb-1f21-418e-8ed8-6b3c6d10f531 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:38:22.670325 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-d8545fdb-1f21-418e-8ed8-6b3c6d10f531 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:38:22.711641 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8545fdb-1f21-418e-8ed8-6b3c6d10f531 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:38:22.713257 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8545fdb-1f21-418e-8ed8-6b3c6d10f531 service neutron] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:38:22.722471 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1375/2770] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:38:22 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:38:25.062060 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1dde41-3069-4290-a3d4-02b52e5eda92 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:38:25.063811 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-6a1dde41-3069-4290-a3d4-02b52e5eda92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:38:25.085310 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1dde41-3069-4290-a3d4-02b52e5eda92 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:38:25.092242 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720f53c0-5209-4841-b73c-38f985e94407 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a332b9b4980646a3b14633293f77b505', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:38:25.092942 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720f53c0-5209-4841-b73c-38f985e94407 service nova] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:38:25.093319 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720f53c0-5209-4841-b73c-38f985e94407 service nova] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:38:25.093649 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720f53c0-5209-4841-b73c-38f985e94407 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:38:25.095798 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-720f53c0-5209-4841-b73c-38f985e94407 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:38:25.110891 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720f53c0-5209-4841-b73c-38f985e94407 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:38:25.112768 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720f53c0-5209-4841-b73c-38f985e94407 service nova] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:38:25.125084 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1396/2771] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:38:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:38:30.123769 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a8c76b-03f5-46ed-ad62-f728334764ea None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:38:30.124291 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a8c76b-03f5-46ed-ad62-f728334764ea None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:38:30.124430 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a8c76b-03f5-46ed-ad62-f728334764ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:38:30.144373 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-50a8c76b-03f5-46ed-ad62-f728334764ea None None] MFA Rules not processed for user `d0aab948f79542cd818063bba0099497`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:38:30.145642 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-50a8c76b-03f5-46ed-ad62-f728334764ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:38:30.156474 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1376/2772] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:38:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:38:33.858952 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720f53c0-5209-4841-b73c-38f985e94407 service nova] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:38:33.873434 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720f53c0-5209-4841-b73c-38f985e94407 service nova] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:38:33.880789 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b0eef1-64d0-4ba0-92ad-e0195ccc9164 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a332b9b4980646a3b14633293f77b505', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:38:33.881434 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b0eef1-64d0-4ba0-92ad-e0195ccc9164 service nova] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:38:33.881774 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b0eef1-64d0-4ba0-92ad-e0195ccc9164 service nova] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:38:33.882047 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b0eef1-64d0-4ba0-92ad-e0195ccc9164 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:38:33.883958 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-90b0eef1-64d0-4ba0-92ad-e0195ccc9164 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:38:33.896528 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b0eef1-64d0-4ba0-92ad-e0195ccc9164 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:38:33.898122 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b0eef1-64d0-4ba0-92ad-e0195ccc9164 service nova] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:38:33.909543 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1397/2773] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:38:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:38:40.138977 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=47 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:38:43.905102 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=15 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:38:47.160123 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d48ba6-a8e0-454f-84de-12753f6aba12 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:38:47.160584 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d48ba6-a8e0-454f-84de-12753f6aba12 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:38:47.160584 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d48ba6-a8e0-454f-84de-12753f6aba12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:38:47.190821 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-86d48ba6-a8e0-454f-84de-12753f6aba12 None None] MFA Rules not processed for user `b9d05f3782d24127aa613c8d7ac8041b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:38:47.192049 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-86d48ba6-a8e0-454f-84de-12753f6aba12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:38:47.250932 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1377/2774] 10.222.0.27 () {58 vars in 1009 bytes} [Fri Sep 9 16:38:47 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:38:47.299550 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b0eef1-64d0-4ba0-92ad-e0195ccc9164 service nova] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:38:47.301011 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-90b0eef1-64d0-4ba0-92ad-e0195ccc9164 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:38:47.374413 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b0eef1-64d0-4ba0-92ad-e0195ccc9164 service nova] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:38:47.379405 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195cf463-5152-4eba-8e07-c0af91867cde service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2350bbc4a194c2dab2e3be830fd0eba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:38:47.380030 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195cf463-5152-4eba-8e07-c0af91867cde service swift] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:38:47.380335 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195cf463-5152-4eba-8e07-c0af91867cde service swift] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:38:47.380604 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195cf463-5152-4eba-8e07-c0af91867cde service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:38:47.388489 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195cf463-5152-4eba-8e07-c0af91867cde service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:38:47.390060 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195cf463-5152-4eba-8e07-c0af91867cde service swift] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:38:47.398007 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1398/2775] 10.222.0.27 () {60 vars in 1384 bytes} [Fri Sep 9 16:38:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 09 16:38:57.240230 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=29 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:38:57.394970 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=32 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:39:02.911281 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3509d485-e46e-4f2f-a2dc-a213505e15e1 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:39:02.911756 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3509d485-e46e-4f2f-a2dc-a213505e15e1 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:39:02.911866 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3509d485-e46e-4f2f-a2dc-a213505e15e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:39:02.931556 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-3509d485-e46e-4f2f-a2dc-a213505e15e1 None None] MFA Rules not processed for user `b9d05f3782d24127aa613c8d7ac8041b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:39:02.932729 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-3509d485-e46e-4f2f-a2dc-a213505e15e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:39:02.939612 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1378/2776] 10.222.0.27 () {58 vars in 967 bytes} [Fri Sep 9 16:39:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:39:02.952127 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195cf463-5152-4eba-8e07-c0af91867cde service swift] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:39:02.963095 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195cf463-5152-4eba-8e07-c0af91867cde service swift] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:39:02.968256 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613c19c3-494d-4536-8234-486360a3b7bf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2350bbc4a194c2dab2e3be830fd0eba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:39:02.968852 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613c19c3-494d-4536-8234-486360a3b7bf service swift] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:39:02.969130 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613c19c3-494d-4536-8234-486360a3b7bf service swift] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:39:02.969404 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613c19c3-494d-4536-8234-486360a3b7bf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:39:02.978116 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613c19c3-494d-4536-8234-486360a3b7bf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:39:02.979720 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613c19c3-494d-4536-8234-486360a3b7bf service swift] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:39:02.987592 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1399/2777] 10.222.0.27 () {60 vars in 1384 bytes} [Fri Sep 9 16:39:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 09 16:39:04.886554 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3509d485-e46e-4f2f-a2dc-a213505e15e1 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:39:04.887998 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-3509d485-e46e-4f2f-a2dc-a213505e15e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:39:04.934603 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3509d485-e46e-4f2f-a2dc-a213505e15e1 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:39:04.939264 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89df1e5b-e901-4656-8921-576eecd89bb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:39:04.939890 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89df1e5b-e901-4656-8921-576eecd89bb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:39:04.940172 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89df1e5b-e901-4656-8921-576eecd89bb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:39:04.940445 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89df1e5b-e901-4656-8921-576eecd89bb6 admin admin] PATH_INFO: `/v3/users/d0aab948f79542cd818063bba0099497` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:39:04.941567 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89df1e5b-e901-4656-8921-576eecd89bb6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0aab948f79542cd818063bba0099497)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:39:04.943523 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89df1e5b-e901-4656-8921-576eecd89bb6 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:39:04.989940 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-89df1e5b-e901-4656-8921-576eecd89bb6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0aab948f79542cd818063bba0099497'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:39:04.997761 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-89df1e5b-e901-4656-8921-576eecd89bb6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0aab948f79542cd818063bba0099497'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:39:04.998414 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-89df1e5b-e901-4656-8921-576eecd89bb6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0aab948f79542cd818063bba0099497'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:39:05.005187 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-89df1e5b-e901-4656-8921-576eecd89bb6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0aab948f79542cd818063bba0099497'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:39:05.016796 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-89df1e5b-e901-4656-8921-576eecd89bb6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0aab948f79542cd818063bba0099497'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:39:05.022751 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1379/2778] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 16:39:04 2022] DELETE /identity/v3/users/d0aab948f79542cd818063bba0099497 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:39:05.192005 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613c19c3-494d-4536-8234-486360a3b7bf service swift] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:39:05.204831 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613c19c3-494d-4536-8234-486360a3b7bf service swift] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:39:05.260714 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23a3f53-221a-46a0-951b-b779cea5de05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:39:05.261329 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23a3f53-221a-46a0-951b-b779cea5de05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:39:05.261602 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23a3f53-221a-46a0-951b-b779cea5de05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:39:05.261866 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23a3f53-221a-46a0-951b-b779cea5de05 admin admin] PATH_INFO: `/v3/projects/5d76cf2ccfeb4a97ba4feeff06b1ce09` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:39:05.263148 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23a3f53-221a-46a0-951b-b779cea5de05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d76cf2ccfeb4a97ba4feeff06b1ce09)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:39:05.265024 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23a3f53-221a-46a0-951b-b779cea5de05 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:39:05.312674 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-e23a3f53-221a-46a0-951b-b779cea5de05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d76cf2ccfeb4a97ba4feeff06b1ce09', 'request_id': 'req-e23a3f53-221a-46a0-951b-b779cea5de05'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:39:05.318224 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-e23a3f53-221a-46a0-951b-b779cea5de05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d76cf2ccfeb4a97ba4feeff06b1ce09', 'request_id': 'req-e23a3f53-221a-46a0-951b-b779cea5de05'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:39:05.325285 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-e23a3f53-221a-46a0-951b-b779cea5de05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d76cf2ccfeb4a97ba4feeff06b1ce09', 'request_id': 'req-e23a3f53-221a-46a0-951b-b779cea5de05'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:39:05.336037 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-e23a3f53-221a-46a0-951b-b779cea5de05 admin admin] The token cache is being invalidate because project 5d76cf2ccfeb4a97ba4feeff06b1ce09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81446) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 16:39:05.336830 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-e23a3f53-221a-46a0-951b-b779cea5de05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:39:05.337457 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-e23a3f53-221a-46a0-951b-b779cea5de05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:39:05.339048 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1400/2779] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 16:39:05 2022] DELETE /identity/v3/projects/5d76cf2ccfeb4a97ba4feeff06b1ce09 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:39:05.344071 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53f8555-90a8-4068-a412-41bd62382a16 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:39:05.344391 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53f8555-90a8-4068-a412-41bd62382a16 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:39:05.344667 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53f8555-90a8-4068-a412-41bd62382a16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:39:05.402188 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-c53f8555-90a8-4068-a412-41bd62382a16 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:39:05.403554 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-c53f8555-90a8-4068-a412-41bd62382a16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:39:05.462709 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1380/2780] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:39:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:39:05.470453 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96077f9-b5e6-4a6c-a273-055772131ec6 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:39:05.470733 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96077f9-b5e6-4a6c-a273-055772131ec6 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:39:05.471002 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96077f9-b5e6-4a6c-a273-055772131ec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:39:05.490824 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-d96077f9-b5e6-4a6c-a273-055772131ec6 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:39:05.492010 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-d96077f9-b5e6-4a6c-a273-055772131ec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:39:05.499765 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1401/2781] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:39:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 16:39:05.503999 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53f8555-90a8-4068-a412-41bd62382a16 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:39:05.513604 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53f8555-90a8-4068-a412-41bd62382a16 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:39:05.518120 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4820891-4cc7-41df-9f42-4c80b6509ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:39:05.518766 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4820891-4cc7-41df-9f42-4c80b6509ef8 admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:39:05.519044 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4820891-4cc7-41df-9f42-4c80b6509ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:39:05.519313 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4820891-4cc7-41df-9f42-4c80b6509ef8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:39:05.519943 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4820891-4cc7-41df-9f42-4c80b6509ef8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:39:05.520266 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4820891-4cc7-41df-9f42-4c80b6509ef8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:39:05.521911 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4820891-4cc7-41df-9f42-4c80b6509ef8 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:39:05.523393 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:39:05.535596 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1381/2782] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Sep 9 16:39:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:39:05.540244 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96077f9-b5e6-4a6c-a273-055772131ec6 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:39:05.549234 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96077f9-b5e6-4a6c-a273-055772131ec6 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:39:05.553793 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2467abc-845b-4fc9-ad2e-8ddc24bf580e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:39:05.554408 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2467abc-845b-4fc9-ad2e-8ddc24bf580e admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:39:05.554685 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2467abc-845b-4fc9-ad2e-8ddc24bf580e admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:39:05.554948 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2467abc-845b-4fc9-ad2e-8ddc24bf580e admin admin] PATH_INFO: `/v3/projects` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:39:05.555563 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2467abc-845b-4fc9-ad2e-8ddc24bf580e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:39:05.557451 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2467abc-845b-4fc9-ad2e-8ddc24bf580e admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:39:05.593371 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1402/2783] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 16:39:05 2022] POST /identity/v3/projects => generated 363 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:39:05.597412 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4820891-4cc7-41df-9f42-4c80b6509ef8 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:39:05.607325 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4820891-4cc7-41df-9f42-4c80b6509ef8 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:39:05.661511 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2fb394-8714-41d0-b52c-904df7699937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:39:05.662098 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2fb394-8714-41d0-b52c-904df7699937 admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:39:05.662408 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2fb394-8714-41d0-b52c-904df7699937 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:39:05.662680 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2fb394-8714-41d0-b52c-904df7699937 admin admin] PATH_INFO: `/v3/users` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:39:05.663294 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2fb394-8714-41d0-b52c-904df7699937 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:39:05.665219 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2fb394-8714-41d0-b52c-904df7699937 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:39:05.685983 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1382/2784] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 16:39:05 2022] POST /identity/v3/users => generated 282 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:39:05.690020 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2467abc-845b-4fc9-ad2e-8ddc24bf580e admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:39:05.700910 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2467abc-845b-4fc9-ad2e-8ddc24bf580e admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:39:05.706007 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e54142-2f17-44c2-878d-6eb371e4dc35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:39:05.706626 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e54142-2f17-44c2-878d-6eb371e4dc35 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:39:05.707021 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e54142-2f17-44c2-878d-6eb371e4dc35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:39:05.707421 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e54142-2f17-44c2-878d-6eb371e4dc35 admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:39:05.708144 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e54142-2f17-44c2-878d-6eb371e4dc35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:39:05.709722 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e54142-2f17-44c2-878d-6eb371e4dc35 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:39:05.720087 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1403/2785] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:39:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:39:05.723908 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2fb394-8714-41d0-b52c-904df7699937 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:39:05.733546 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2fb394-8714-41d0-b52c-904df7699937 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:39:05.738063 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec567f26-b325-405c-8980-59ed310e1621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:39:05.738678 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec567f26-b325-405c-8980-59ed310e1621 admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:39:05.738951 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec567f26-b325-405c-8980-59ed310e1621 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:39:05.739217 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec567f26-b325-405c-8980-59ed310e1621 admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:39:05.739830 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec567f26-b325-405c-8980-59ed310e1621 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:39:05.741401 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec567f26-b325-405c-8980-59ed310e1621 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:39:05.752084 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1383/2786] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:39:05 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:39:05.756370 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e54142-2f17-44c2-878d-6eb371e4dc35 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:39:05.766928 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e54142-2f17-44c2-878d-6eb371e4dc35 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:39:05.771482 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02890bcf-7895-4030-b460-3524790aeff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:39:05.772120 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02890bcf-7895-4030-b460-3524790aeff0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:39:05.772397 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02890bcf-7895-4030-b460-3524790aeff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:39:05.772670 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02890bcf-7895-4030-b460-3524790aeff0 admin admin] PATH_INFO: `/v3/projects/911fc820aa6a447096c30a48ba009ee7/users/446f2ae4adec4b51b3b759c48a98929f/roles/b38e84bf077846ee802e6bb1bad83522` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:39:05.788149 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02890bcf-7895-4030-b460-3524790aeff0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=911fc820aa6a447096c30a48ba009ee7, user_id=446f2ae4adec4b51b3b759c48a98929f, role_id=b38e84bf077846ee802e6bb1bad83522)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:39:05.790798 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02890bcf-7895-4030-b460-3524790aeff0 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:39:05.803112 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1404/2787] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 16:39:05 2022] PUT /identity/v3/projects/911fc820aa6a447096c30a48ba009ee7/users/446f2ae4adec4b51b3b759c48a98929f/roles/b38e84bf077846ee802e6bb1bad83522 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:39:05.812896 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0febcff1-257d-437c-afe1-9a3aa64d0e07 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:39:05.813184 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0febcff1-257d-437c-afe1-9a3aa64d0e07 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:39:05.813477 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0febcff1-257d-437c-afe1-9a3aa64d0e07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:39:05.841922 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-0febcff1-257d-437c-afe1-9a3aa64d0e07 None None] MFA Rules not processed for user `446f2ae4adec4b51b3b759c48a98929f`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:39:05.843197 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-0febcff1-257d-437c-afe1-9a3aa64d0e07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:39:05.905040 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1384/2788] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:39:05 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:39:05.916100 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02890bcf-7895-4030-b460-3524790aeff0 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:39:05.917830 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-02890bcf-7895-4030-b460-3524790aeff0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:39:05.922573 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:39:05.996883 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02890bcf-7895-4030-b460-3524790aeff0 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:39:06.000581 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afda7d8-a3b0-4b22-ad40-82e9c6ffc742 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8078e791ba68460f8b3aeafb4b79b73a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:39:06.001171 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afda7d8-a3b0-4b22-ad40-82e9c6ffc742 service cinder] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:39:06.001449 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afda7d8-a3b0-4b22-ad40-82e9c6ffc742 service cinder] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:39:06.001715 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afda7d8-a3b0-4b22-ad40-82e9c6ffc742 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:39:06.010474 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afda7d8-a3b0-4b22-ad40-82e9c6ffc742 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:39:06.011883 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afda7d8-a3b0-4b22-ad40-82e9c6ffc742 service cinder] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:39:06.020577 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1405/2789] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:39:05 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:39:14.143023 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e242993-1e24-4ef5-a7c2-01b87aaf4db2 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:39:14.143508 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e242993-1e24-4ef5-a7c2-01b87aaf4db2 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:39:14.143608 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e242993-1e24-4ef5-a7c2-01b87aaf4db2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:39:14.163018 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-6e242993-1e24-4ef5-a7c2-01b87aaf4db2 None None] MFA Rules not processed for user `60af222382244caaab2175c83b78c47d`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:39:14.164222 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-6e242993-1e24-4ef5-a7c2-01b87aaf4db2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:39:14.229646 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1385/2790] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:39:14 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:39:16.016603 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=33 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:39:24.222938 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=94,keystone:INSERT=3 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:39:35.944456 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afda7d8-a3b0-4b22-ad40-82e9c6ffc742 service cinder] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:39:36.009486 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afda7d8-a3b0-4b22-ad40-82e9c6ffc742 service cinder] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:39:36.013962 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c62f42-ae87-46b0-acf9-14fb0464d539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:39:36.014601 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c62f42-ae87-46b0-acf9-14fb0464d539 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:39:36.014875 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c62f42-ae87-46b0-acf9-14fb0464d539 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:39:36.015139 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c62f42-ae87-46b0-acf9-14fb0464d539 admin admin] PATH_INFO: `/v3/users/446f2ae4adec4b51b3b759c48a98929f` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:39:36.016291 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c62f42-ae87-46b0-acf9-14fb0464d539 admin admin] RBAC: Authorizing `identity:delete_user(user_id=446f2ae4adec4b51b3b759c48a98929f)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:39:36.018127 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c62f42-ae87-46b0-acf9-14fb0464d539 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:39:36.062718 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-70c62f42-ae87-46b0-acf9-14fb0464d539 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '446f2ae4adec4b51b3b759c48a98929f'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:39:36.069473 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-70c62f42-ae87-46b0-acf9-14fb0464d539 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '446f2ae4adec4b51b3b759c48a98929f'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:39:36.081877 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-70c62f42-ae87-46b0-acf9-14fb0464d539 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '446f2ae4adec4b51b3b759c48a98929f'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:39:36.088411 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-70c62f42-ae87-46b0-acf9-14fb0464d539 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '446f2ae4adec4b51b3b759c48a98929f'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:39:36.089003 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-70c62f42-ae87-46b0-acf9-14fb0464d539 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '446f2ae4adec4b51b3b759c48a98929f'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:39:36.094843 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1406/2791] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 16:39:35 2022] DELETE /identity/v3/users/446f2ae4adec4b51b3b759c48a98929f => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:39:36.099285 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a6071e-30be-4f0c-8d96-75044301de5b None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:39:36.099840 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a6071e-30be-4f0c-8d96-75044301de5b None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:39:36.099840 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a6071e-30be-4f0c-8d96-75044301de5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:39:36.239194 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-38a6071e-30be-4f0c-8d96-75044301de5b None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:39:36.240420 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-38a6071e-30be-4f0c-8d96-75044301de5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:39:36.298659 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1386/2792] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:39:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:39:36.308838 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c62f42-ae87-46b0-acf9-14fb0464d539 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:39:36.310215 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-70c62f42-ae87-46b0-acf9-14fb0464d539 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:39:36.366141 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c62f42-ae87-46b0-acf9-14fb0464d539 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:39:36.370288 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d86f720-d9d2-414e-b1b1-55ab7b1b9ef8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f44bfdd5214e8d84a2c0a5b1fd9b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:39:36.370893 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d86f720-d9d2-414e-b1b1-55ab7b1b9ef8 service neutron] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:39:36.371164 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d86f720-d9d2-414e-b1b1-55ab7b1b9ef8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:39:36.371429 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d86f720-d9d2-414e-b1b1-55ab7b1b9ef8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:39:36.380221 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d86f720-d9d2-414e-b1b1-55ab7b1b9ef8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:39:36.381627 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d86f720-d9d2-414e-b1b1-55ab7b1b9ef8 service neutron] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:39:36.390893 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1407/2793] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:39:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:39:36.651593 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a6071e-30be-4f0c-8d96-75044301de5b None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:39:36.653066 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-38a6071e-30be-4f0c-8d96-75044301de5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:39:36.665827 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a6071e-30be-4f0c-8d96-75044301de5b None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:39:36.670611 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2da9dc-966b-4b59-a5cb-956c30dfd056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:39:36.671264 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2da9dc-966b-4b59-a5cb-956c30dfd056 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:39:36.671584 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2da9dc-966b-4b59-a5cb-956c30dfd056 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:39:36.671852 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2da9dc-966b-4b59-a5cb-956c30dfd056 admin admin] PATH_INFO: `/v3/projects/911fc820aa6a447096c30a48ba009ee7` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:39:36.672943 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2da9dc-966b-4b59-a5cb-956c30dfd056 admin admin] RBAC: Authorizing `identity:delete_project(project_id=911fc820aa6a447096c30a48ba009ee7)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:39:36.674985 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2da9dc-966b-4b59-a5cb-956c30dfd056 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:39:36.721159 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-ea2da9dc-966b-4b59-a5cb-956c30dfd056 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '911fc820aa6a447096c30a48ba009ee7', 'request_id': 'req-ea2da9dc-966b-4b59-a5cb-956c30dfd056'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:39:36.727752 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-ea2da9dc-966b-4b59-a5cb-956c30dfd056 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '911fc820aa6a447096c30a48ba009ee7', 'request_id': 'req-ea2da9dc-966b-4b59-a5cb-956c30dfd056'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:39:36.734763 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-ea2da9dc-966b-4b59-a5cb-956c30dfd056 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '911fc820aa6a447096c30a48ba009ee7', 'request_id': 'req-ea2da9dc-966b-4b59-a5cb-956c30dfd056'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:39:36.744834 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-ea2da9dc-966b-4b59-a5cb-956c30dfd056 admin admin] The token cache is being invalidate because project 911fc820aa6a447096c30a48ba009ee7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81445) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 16:39:36.745119 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-ea2da9dc-966b-4b59-a5cb-956c30dfd056 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:39:36.745720 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-ea2da9dc-966b-4b59-a5cb-956c30dfd056 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:39:36.747213 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1387/2794] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 16:39:36 2022] DELETE /identity/v3/projects/911fc820aa6a447096c30a48ba009ee7 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:39:36.752093 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c83c7b4-18cb-4cc7-8c6b-598b2e490852 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:39:36.752376 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c83c7b4-18cb-4cc7-8c6b-598b2e490852 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:39:36.752673 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c83c7b4-18cb-4cc7-8c6b-598b2e490852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:39:36.771867 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-9c83c7b4-18cb-4cc7-8c6b-598b2e490852 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:39:36.773042 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-9c83c7b4-18cb-4cc7-8c6b-598b2e490852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:39:36.790510 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:39:36.834566 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1408/2795] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:39:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:39:36.842916 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f36a4c-8d59-46a4-b279-71dad65ceb96 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:39:36.843194 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f36a4c-8d59-46a4-b279-71dad65ceb96 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:39:36.843459 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f36a4c-8d59-46a4-b279-71dad65ceb96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:39:36.862877 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-30f36a4c-8d59-46a4-b279-71dad65ceb96 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:39:36.864051 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-30f36a4c-8d59-46a4-b279-71dad65ceb96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:39:36.871611 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1388/2796] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:39:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:39:36.875725 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c83c7b4-18cb-4cc7-8c6b-598b2e490852 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:39:36.885315 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c83c7b4-18cb-4cc7-8c6b-598b2e490852 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:39:36.889826 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9490f1e-90ff-4534-9555-7536e226729c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:39:36.890421 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9490f1e-90ff-4534-9555-7536e226729c admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:39:36.890700 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9490f1e-90ff-4534-9555-7536e226729c admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:39:36.890968 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9490f1e-90ff-4534-9555-7536e226729c admin admin] PATH_INFO: `/v3/domains` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:39:36.891591 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9490f1e-90ff-4534-9555-7536e226729c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:39:36.891889 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9490f1e-90ff-4534-9555-7536e226729c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:39:36.893464 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9490f1e-90ff-4534-9555-7536e226729c admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:39:36.905282 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1409/2797] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Sep 9 16:39:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 16:39:36.909441 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f36a4c-8d59-46a4-b279-71dad65ceb96 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:39:36.919190 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f36a4c-8d59-46a4-b279-71dad65ceb96 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:39:36.923767 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ff7302-8403-4f5b-96cc-7d5c50a29446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:39:36.924351 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ff7302-8403-4f5b-96cc-7d5c50a29446 admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:39:36.924623 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ff7302-8403-4f5b-96cc-7d5c50a29446 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:39:36.924890 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ff7302-8403-4f5b-96cc-7d5c50a29446 admin admin] PATH_INFO: `/v3/projects` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:39:36.925516 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ff7302-8403-4f5b-96cc-7d5c50a29446 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:39:36.927445 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ff7302-8403-4f5b-96cc-7d5c50a29446 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:39:36.953497 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1389/2798] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 16:39:36 2022] POST /identity/v3/projects => generated 371 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:39:36.957626 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9490f1e-90ff-4534-9555-7536e226729c admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:39:36.967967 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9490f1e-90ff-4534-9555-7536e226729c admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:39:37.024441 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309e82c1-4622-4818-b07a-850e4d2faf67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:39:37.025042 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309e82c1-4622-4818-b07a-850e4d2faf67 admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:39:37.025319 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309e82c1-4622-4818-b07a-850e4d2faf67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:39:37.025589 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309e82c1-4622-4818-b07a-850e4d2faf67 admin admin] PATH_INFO: `/v3/users` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:39:37.026215 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309e82c1-4622-4818-b07a-850e4d2faf67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:39:37.028249 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309e82c1-4622-4818-b07a-850e4d2faf67 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:39:37.048748 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1410/2799] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 16:39:36 2022] POST /identity/v3/users => generated 286 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:39:37.052774 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ff7302-8403-4f5b-96cc-7d5c50a29446 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:39:37.063477 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ff7302-8403-4f5b-96cc-7d5c50a29446 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:39:37.068034 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ce01ab-22dd-453f-aa65-3689842c766d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:39:37.068618 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ce01ab-22dd-453f-aa65-3689842c766d admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:39:37.068895 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ce01ab-22dd-453f-aa65-3689842c766d admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:39:37.069163 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ce01ab-22dd-453f-aa65-3689842c766d admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:39:37.069786 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ce01ab-22dd-453f-aa65-3689842c766d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:39:37.072089 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ce01ab-22dd-453f-aa65-3689842c766d admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:39:37.082169 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1390/2800] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:39:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:39:37.086020 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309e82c1-4622-4818-b07a-850e4d2faf67 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:39:37.095806 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309e82c1-4622-4818-b07a-850e4d2faf67 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:39:37.100386 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb9bc5b-8728-435d-9d25-0310fdfba15e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:39:37.100960 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb9bc5b-8728-435d-9d25-0310fdfba15e admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:39:37.101239 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb9bc5b-8728-435d-9d25-0310fdfba15e admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:39:37.102046 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb9bc5b-8728-435d-9d25-0310fdfba15e admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:39:37.102715 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb9bc5b-8728-435d-9d25-0310fdfba15e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:39:37.104295 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb9bc5b-8728-435d-9d25-0310fdfba15e admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:39:37.115696 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1411/2801] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:39:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:39:37.120390 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ce01ab-22dd-453f-aa65-3689842c766d admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:39:37.129991 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ce01ab-22dd-453f-aa65-3689842c766d admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:39:37.134804 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f95454b-002a-4317-8d68-878b59970286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:39:37.135432 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f95454b-002a-4317-8d68-878b59970286 admin admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:39:37.135927 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f95454b-002a-4317-8d68-878b59970286 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:39:37.136416 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f95454b-002a-4317-8d68-878b59970286 admin admin] PATH_INFO: `/v3/projects/8f7f3e4298e84ca9bceefc4321e50a7a/users/cf8b3812127a46c7a341f51ebf9b18d9/roles/b38e84bf077846ee802e6bb1bad83522` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:39:37.150392 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f95454b-002a-4317-8d68-878b59970286 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f7f3e4298e84ca9bceefc4321e50a7a, user_id=cf8b3812127a46c7a341f51ebf9b18d9, role_id=b38e84bf077846ee802e6bb1bad83522)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:39:37.152975 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f95454b-002a-4317-8d68-878b59970286 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:39:37.166106 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1391/2802] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 16:39:37 2022] PUT /identity/v3/projects/8f7f3e4298e84ca9bceefc4321e50a7a/users/cf8b3812127a46c7a341f51ebf9b18d9/roles/b38e84bf077846ee802e6bb1bad83522 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:39:37.171079 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba0aafc-a30a-4e2f-a093-7e1a28bb7dc6 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:39:37.171442 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba0aafc-a30a-4e2f-a093-7e1a28bb7dc6 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:39:37.171790 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba0aafc-a30a-4e2f-a093-7e1a28bb7dc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:39:37.191354 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-7ba0aafc-a30a-4e2f-a093-7e1a28bb7dc6 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:39:37.192545 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-7ba0aafc-a30a-4e2f-a093-7e1a28bb7dc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:39:37.251323 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1412/2803] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:39:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:39:37.261044 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f95454b-002a-4317-8d68-878b59970286 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:39:37.262764 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-9f95454b-002a-4317-8d68-878b59970286 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:39:37.284406 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:39:37.321113 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f95454b-002a-4317-8d68-878b59970286 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:39:37.324827 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bc0233-3de6-4c06-bf92-e2a0d5f7ad9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f44bfdd5214e8d84a2c0a5b1fd9b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:39:37.325413 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bc0233-3de6-4c06-bf92-e2a0d5f7ad9b service neutron] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:39:37.325686 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bc0233-3de6-4c06-bf92-e2a0d5f7ad9b service neutron] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:39:37.325950 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bc0233-3de6-4c06-bf92-e2a0d5f7ad9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:39:37.334710 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bc0233-3de6-4c06-bf92-e2a0d5f7ad9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:39:37.336169 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bc0233-3de6-4c06-bf92-e2a0d5f7ad9b service neutron] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:39:37.346743 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1392/2804] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:39:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:39:41.187795 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e0d17a-4f96-42d6-b160-50d4a46b068e None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:39:41.188296 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e0d17a-4f96-42d6-b160-50d4a46b068e None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:39:41.188403 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e0d17a-4f96-42d6-b160-50d4a46b068e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:39:41.216674 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-61e0d17a-4f96-42d6-b160-50d4a46b068e None None] MFA Rules not processed for user `cf8b3812127a46c7a341f51ebf9b18d9`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:39:41.217878 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-61e0d17a-4f96-42d6-b160-50d4a46b068e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:39:41.235890 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:39:41.306826 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1413/2805] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:39:41 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:39:41.309404 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bc0233-3de6-4c06-bf92-e2a0d5f7ad9b service neutron] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:39:41.319340 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bc0233-3de6-4c06-bf92-e2a0d5f7ad9b service neutron] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:39:41.324200 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395cd350-39e2-4a90-bd1e-8bcef86753fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:39:41.325064 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395cd350-39e2-4a90-bd1e-8bcef86753fc admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:39:41.325339 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395cd350-39e2-4a90-bd1e-8bcef86753fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:39:41.325605 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395cd350-39e2-4a90-bd1e-8bcef86753fc admin admin] PATH_INFO: `/v3/projects` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:39:41.326228 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395cd350-39e2-4a90-bd1e-8bcef86753fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:39:41.328158 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395cd350-39e2-4a90-bd1e-8bcef86753fc admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:39:41.356646 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1393/2806] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 16:39:41 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:39:41.360634 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e0d17a-4f96-42d6-b160-50d4a46b068e None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:39:41.372892 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e0d17a-4f96-42d6-b160-50d4a46b068e None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:39:41.430429 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c11f020-d789-43f9-b098-28062e9d4436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:39:41.431044 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c11f020-d789-43f9-b098-28062e9d4436 admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:39:41.431318 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c11f020-d789-43f9-b098-28062e9d4436 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:39:41.432080 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c11f020-d789-43f9-b098-28062e9d4436 admin admin] PATH_INFO: `/v3/users` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:39:41.432212 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c11f020-d789-43f9-b098-28062e9d4436 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:39:41.434272 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c11f020-d789-43f9-b098-28062e9d4436 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:39:41.476517 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1414/2807] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 16:39:41 2022] POST /identity/v3/users => generated 293 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 16:39:41.480930 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395cd350-39e2-4a90-bd1e-8bcef86753fc admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:39:41.495257 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395cd350-39e2-4a90-bd1e-8bcef86753fc admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:39:41.500262 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8c7aac-d6c6-45b6-8d30-aa4a447c0355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:39:41.500950 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8c7aac-d6c6-45b6-8d30-aa4a447c0355 admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:39:41.501333 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8c7aac-d6c6-45b6-8d30-aa4a447c0355 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:39:41.501688 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8c7aac-d6c6-45b6-8d30-aa4a447c0355 admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:39:41.502435 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8c7aac-d6c6-45b6-8d30-aa4a447c0355 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:39:41.504120 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8c7aac-d6c6-45b6-8d30-aa4a447c0355 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:39:41.515368 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1394/2808] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:39:41 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 16:39:41.519503 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c11f020-d789-43f9-b098-28062e9d4436 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:39:41.530562 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c11f020-d789-43f9-b098-28062e9d4436 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:39:41.535342 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61354d2d-f04e-45a6-b294-a86d20b41bd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:39:41.535996 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61354d2d-f04e-45a6-b294-a86d20b41bd5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:39:41.536272 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61354d2d-f04e-45a6-b294-a86d20b41bd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:39:41.536541 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61354d2d-f04e-45a6-b294-a86d20b41bd5 admin admin] PATH_INFO: `/v3/projects/f45cf207b42a442db92604bcc06814b7/users/df9ef3f7e4dd44acaf816b6b3f66fa24/roles/0a36d1be416f4089be19be979943b731` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:39:41.553292 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61354d2d-f04e-45a6-b294-a86d20b41bd5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f45cf207b42a442db92604bcc06814b7, user_id=df9ef3f7e4dd44acaf816b6b3f66fa24, role_id=0a36d1be416f4089be19be979943b731)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:39:41.556625 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61354d2d-f04e-45a6-b294-a86d20b41bd5 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:39:41.574050 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1415/2809] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 16:39:41 2022] PUT /identity/v3/projects/f45cf207b42a442db92604bcc06814b7/users/df9ef3f7e4dd44acaf816b6b3f66fa24/roles/0a36d1be416f4089be19be979943b731 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:39:41.578518 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8c7aac-d6c6-45b6-8d30-aa4a447c0355 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:39:41.588798 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8c7aac-d6c6-45b6-8d30-aa4a447c0355 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:39:41.646906 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e978de03-5c28-42dd-b642-296362428458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:39:41.647514 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e978de03-5c28-42dd-b642-296362428458 admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:39:41.647785 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e978de03-5c28-42dd-b642-296362428458 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:39:41.648054 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e978de03-5c28-42dd-b642-296362428458 admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:39:41.648725 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e978de03-5c28-42dd-b642-296362428458 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:39:41.650349 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e978de03-5c28-42dd-b642-296362428458 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:39:41.660512 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1395/2810] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:39:41 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 16:39:41.665277 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61354d2d-f04e-45a6-b294-a86d20b41bd5 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:39:41.676204 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61354d2d-f04e-45a6-b294-a86d20b41bd5 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:39:41.681510 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318360ac-2051-44be-9bcb-d8fb422ae18b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:39:41.682176 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318360ac-2051-44be-9bcb-d8fb422ae18b admin admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:39:41.682492 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318360ac-2051-44be-9bcb-d8fb422ae18b admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:39:41.682764 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318360ac-2051-44be-9bcb-d8fb422ae18b admin admin] PATH_INFO: `/v3/projects/f45cf207b42a442db92604bcc06814b7/users/df9ef3f7e4dd44acaf816b6b3f66fa24/roles/0a36d1be416f4089be19be979943b731` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:39:41.684914 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318360ac-2051-44be-9bcb-d8fb422ae18b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f45cf207b42a442db92604bcc06814b7, user_id=df9ef3f7e4dd44acaf816b6b3f66fa24, role_id=0a36d1be416f4089be19be979943b731)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:39:41.687865 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318360ac-2051-44be-9bcb-d8fb422ae18b admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:39:41.700178 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1416/2811] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 16:39:41 2022] PUT /identity/v3/projects/f45cf207b42a442db92604bcc06814b7/users/df9ef3f7e4dd44acaf816b6b3f66fa24/roles/0a36d1be416f4089be19be979943b731 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:39:45.965995 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f557f8ae-8df7-40f5-a47a-a6fdb3d5d925 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:39:45.966569 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f557f8ae-8df7-40f5-a47a-a6fdb3d5d925 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:39:45.966704 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f557f8ae-8df7-40f5-a47a-a6fdb3d5d925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:39:45.995281 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-f557f8ae-8df7-40f5-a47a-a6fdb3d5d925 None None] MFA Rules not processed for user `df9ef3f7e4dd44acaf816b6b3f66fa24`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:39:45.996486 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-f557f8ae-8df7-40f5-a47a-a6fdb3d5d925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:39:46.067841 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1396/2812] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:39:45 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:39:46.087724 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318360ac-2051-44be-9bcb-d8fb422ae18b admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:39:46.090709 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-318360ac-2051-44be-9bcb-d8fb422ae18b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:39:46.179363 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318360ac-2051-44be-9bcb-d8fb422ae18b admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:39:46.185843 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e2f5f4-88b1-4810-a9a6-249215808a23 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a332b9b4980646a3b14633293f77b505', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:39:46.186498 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e2f5f4-88b1-4810-a9a6-249215808a23 service nova] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:39:46.186797 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e2f5f4-88b1-4810-a9a6-249215808a23 service nova] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:39:46.187042 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e2f5f4-88b1-4810-a9a6-249215808a23 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:39:46.193073 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:39:46.255621 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e2f5f4-88b1-4810-a9a6-249215808a23 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:39:46.257252 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e2f5f4-88b1-4810-a9a6-249215808a23 service nova] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:39:46.267268 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1417/2813] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:39:46 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:39:47.320882 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ba03a7-a9bd-4c8f-a7a3-ecde411d2dda None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:39:47.321405 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ba03a7-a9bd-4c8f-a7a3-ecde411d2dda None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:39:47.321506 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ba03a7-a9bd-4c8f-a7a3-ecde411d2dda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:39:47.340227 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-05ba03a7-a9bd-4c8f-a7a3-ecde411d2dda None None] MFA Rules not processed for user `cf8b3812127a46c7a341f51ebf9b18d9`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:39:47.341415 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-05ba03a7-a9bd-4c8f-a7a3-ecde411d2dda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:39:47.348582 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1397/2814] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:39:47 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:39:56.262697 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=24 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:39:56.705195 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e2f5f4-88b1-4810-a9a6-249215808a23 service nova] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:39:56.706826 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-99e2f5f4-88b1-4810-a9a6-249215808a23 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:39:56.799057 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e2f5f4-88b1-4810-a9a6-249215808a23 service nova] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:39:56.804280 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44c856c-204d-43e4-8229-b424a57f541a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d73df92393c43b2b5ccc32a2d43d952', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:39:56.805453 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44c856c-204d-43e4-8229-b424a57f541a service placement] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:39:56.805724 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44c856c-204d-43e4-8229-b424a57f541a service placement] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:39:56.805988 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44c856c-204d-43e4-8229-b424a57f541a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:39:56.807858 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-e44c856c-204d-43e4-8229-b424a57f541a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:39:56.819678 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44c856c-204d-43e4-8229-b424a57f541a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:39:56.821254 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44c856c-204d-43e4-8229-b424a57f541a service placement] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:39:56.831566 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1418/2815] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:39:56 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:39:57.334884 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=97,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:40:06.827391 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=41 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:40:12.052640 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ba03a7-a9bd-4c8f-a7a3-ecde411d2dda None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:40:12.054035 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-05ba03a7-a9bd-4c8f-a7a3-ecde411d2dda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:40:12.109181 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ba03a7-a9bd-4c8f-a7a3-ecde411d2dda None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:40:12.112663 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc74f0f-17b5-4a23-94f3-b35f27aeabf6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f44bfdd5214e8d84a2c0a5b1fd9b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:40:12.113248 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc74f0f-17b5-4a23-94f3-b35f27aeabf6 service neutron] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:40:12.113524 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc74f0f-17b5-4a23-94f3-b35f27aeabf6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:40:12.113791 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc74f0f-17b5-4a23-94f3-b35f27aeabf6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:40:12.122999 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc74f0f-17b5-4a23-94f3-b35f27aeabf6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:40:12.124408 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc74f0f-17b5-4a23-94f3-b35f27aeabf6 service neutron] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:40:12.134700 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1398/2816] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:40:12 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:40:15.252031 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af5f15e-70cf-4798-84d4-c6595044926f None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:40:15.252548 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af5f15e-70cf-4798-84d4-c6595044926f None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:40:15.252649 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af5f15e-70cf-4798-84d4-c6595044926f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:40:15.271520 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-5af5f15e-70cf-4798-84d4-c6595044926f None None] MFA Rules not processed for user `60af222382244caaab2175c83b78c47d`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:40:15.272706 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-5af5f15e-70cf-4798-84d4-c6595044926f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:40:15.327981 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1419/2817] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:40:15 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 16:40:22.129654 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=26 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:40:25.321073 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=25 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:41:12.190455 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96777cd-0474-45b4-8a25-7e22cae4507a None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:41:12.190977 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96777cd-0474-45b4-8a25-7e22cae4507a None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:41:12.190977 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96777cd-0474-45b4-8a25-7e22cae4507a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:41:12.210729 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-f96777cd-0474-45b4-8a25-7e22cae4507a None None] MFA Rules not processed for user `60af222382244caaab2175c83b78c47d`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:41:12.211911 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-f96777cd-0474-45b4-8a25-7e22cae4507a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:41:12.218969 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1399/2818] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:41:12 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:41:22.205247 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=3 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:42:00.809846 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af5f15e-70cf-4798-84d4-c6595044926f None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:42:00.811278 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-5af5f15e-70cf-4798-84d4-c6595044926f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:42:00.868076 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af5f15e-70cf-4798-84d4-c6595044926f None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:42:00.872191 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a05ca40-fb21-4481-a54b-b114b43385ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8078e791ba68460f8b3aeafb4b79b73a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:42:00.872788 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a05ca40-fb21-4481-a54b-b114b43385ff service cinder] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:42:00.873067 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a05ca40-fb21-4481-a54b-b114b43385ff service cinder] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:42:00.873339 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a05ca40-fb21-4481-a54b-b114b43385ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:42:00.875089 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-3a05ca40-fb21-4481-a54b-b114b43385ff service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:42:00.907124 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a05ca40-fb21-4481-a54b-b114b43385ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:42:00.908546 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a05ca40-fb21-4481-a54b-b114b43385ff service cinder] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:42:00.928559 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1420/2819] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:42:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:42:02.458203 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96777cd-0474-45b4-8a25-7e22cae4507a None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:42:02.459617 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-f96777cd-0474-45b4-8a25-7e22cae4507a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:42:02.471936 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96777cd-0474-45b4-8a25-7e22cae4507a None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:42:02.475373 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba3de71-3768-486e-9ecb-c1023a1e6f7d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8078e791ba68460f8b3aeafb4b79b73a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:42:02.475956 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba3de71-3768-486e-9ecb-c1023a1e6f7d service cinder] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:42:02.476225 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba3de71-3768-486e-9ecb-c1023a1e6f7d service cinder] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:42:02.476486 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba3de71-3768-486e-9ecb-c1023a1e6f7d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:42:02.478119 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-1ba3de71-3768-486e-9ecb-c1023a1e6f7d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:42:02.490843 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba3de71-3768-486e-9ecb-c1023a1e6f7d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:42:02.492245 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba3de71-3768-486e-9ecb-c1023a1e6f7d service cinder] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:42:02.502831 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1400/2820] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:42:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:42:10.925973 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=38 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:42:12.498049 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=6 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:42:15.172452 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a05ca40-fb21-4481-a54b-b114b43385ff service cinder] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:42:15.174016 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-3a05ca40-fb21-4481-a54b-b114b43385ff service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:42:15.188272 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a05ca40-fb21-4481-a54b-b114b43385ff service cinder] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:42:15.193539 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc37b18-3392-4709-84ee-4d68c428c20e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d73df92393c43b2b5ccc32a2d43d952', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:42:15.194178 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc37b18-3392-4709-84ee-4d68c428c20e service placement] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:42:15.194497 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc37b18-3392-4709-84ee-4d68c428c20e service placement] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:42:15.194772 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc37b18-3392-4709-84ee-4d68c428c20e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:42:15.196452 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-6dc37b18-3392-4709-84ee-4d68c428c20e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:42:15.209432 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc37b18-3392-4709-84ee-4d68c428c20e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:42:15.211073 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc37b18-3392-4709-84ee-4d68c428c20e service placement] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:42:15.222603 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1421/2821] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:42:15 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:42:15.236779 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba3de71-3768-486e-9ecb-c1023a1e6f7d service cinder] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:42:15.238244 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-1ba3de71-3768-486e-9ecb-c1023a1e6f7d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:42:15.307627 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba3de71-3768-486e-9ecb-c1023a1e6f7d service cinder] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:42:15.312231 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d70c4fb-e32c-4638-931d-6487951c62e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:42:15.312850 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d70c4fb-e32c-4638-931d-6487951c62e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:42:15.313128 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d70c4fb-e32c-4638-931d-6487951c62e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:42:15.313398 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d70c4fb-e32c-4638-931d-6487951c62e1 admin admin] PATH_INFO: `/v3/users/60af222382244caaab2175c83b78c47d` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:42:15.314530 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d70c4fb-e32c-4638-931d-6487951c62e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=60af222382244caaab2175c83b78c47d)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:42:15.316424 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d70c4fb-e32c-4638-931d-6487951c62e1 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:42:15.362548 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-5d70c4fb-e32c-4638-931d-6487951c62e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60af222382244caaab2175c83b78c47d'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:42:15.370765 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-5d70c4fb-e32c-4638-931d-6487951c62e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60af222382244caaab2175c83b78c47d'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:42:15.371383 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-5d70c4fb-e32c-4638-931d-6487951c62e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60af222382244caaab2175c83b78c47d'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:42:15.378151 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-5d70c4fb-e32c-4638-931d-6487951c62e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60af222382244caaab2175c83b78c47d'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:42:15.389593 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-5d70c4fb-e32c-4638-931d-6487951c62e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60af222382244caaab2175c83b78c47d'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:42:15.395442 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1401/2822] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 16:42:15 2022] DELETE /identity/v3/users/60af222382244caaab2175c83b78c47d => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:42:15.574217 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc37b18-3392-4709-84ee-4d68c428c20e service placement] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:42:15.587018 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc37b18-3392-4709-84ee-4d68c428c20e service placement] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:42:15.646675 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f46b18d-3041-4263-990d-85558008fe59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:42:15.647309 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f46b18d-3041-4263-990d-85558008fe59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:42:15.647578 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f46b18d-3041-4263-990d-85558008fe59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:42:15.647848 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f46b18d-3041-4263-990d-85558008fe59 admin admin] PATH_INFO: `/v3/projects/61d607ed80c542a6911bbd4ad0f5c91c` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:42:15.648952 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f46b18d-3041-4263-990d-85558008fe59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=61d607ed80c542a6911bbd4ad0f5c91c)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:42:15.651413 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f46b18d-3041-4263-990d-85558008fe59 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:42:15.697841 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-9f46b18d-3041-4263-990d-85558008fe59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61d607ed80c542a6911bbd4ad0f5c91c', 'request_id': 'req-9f46b18d-3041-4263-990d-85558008fe59'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:42:15.703623 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-9f46b18d-3041-4263-990d-85558008fe59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61d607ed80c542a6911bbd4ad0f5c91c', 'request_id': 'req-9f46b18d-3041-4263-990d-85558008fe59'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:42:15.710663 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-9f46b18d-3041-4263-990d-85558008fe59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61d607ed80c542a6911bbd4ad0f5c91c', 'request_id': 'req-9f46b18d-3041-4263-990d-85558008fe59'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:42:15.721858 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-9f46b18d-3041-4263-990d-85558008fe59 admin admin] The token cache is being invalidate because project 61d607ed80c542a6911bbd4ad0f5c91c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81446) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 16:42:15.722145 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-9f46b18d-3041-4263-990d-85558008fe59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:42:15.722792 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-9f46b18d-3041-4263-990d-85558008fe59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:42:15.724235 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1422/2823] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 16:42:15 2022] DELETE /identity/v3/projects/61d607ed80c542a6911bbd4ad0f5c91c => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:42:15.729951 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cd41f4-773e-4ec1-b2da-97937f7fceed None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:42:15.730231 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cd41f4-773e-4ec1-b2da-97937f7fceed None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:42:15.730543 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cd41f4-773e-4ec1-b2da-97937f7fceed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:42:15.749629 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-00cd41f4-773e-4ec1-b2da-97937f7fceed None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:42:15.750860 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-00cd41f4-773e-4ec1-b2da-97937f7fceed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:42:15.808660 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1402/2824] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:42:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 16:42:15.817193 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9687f81b-ebeb-49e3-b2ef-78ef01c9155b None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:42:15.817482 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9687f81b-ebeb-49e3-b2ef-78ef01c9155b None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:42:15.817789 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9687f81b-ebeb-49e3-b2ef-78ef01c9155b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:42:15.837979 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-9687f81b-ebeb-49e3-b2ef-78ef01c9155b None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:42:15.839210 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-9687f81b-ebeb-49e3-b2ef-78ef01c9155b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:42:15.847243 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1423/2825] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:42:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:42:15.851782 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cd41f4-773e-4ec1-b2da-97937f7fceed None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:42:15.861516 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cd41f4-773e-4ec1-b2da-97937f7fceed None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:42:15.866186 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea65de4f-89dc-41da-951c-0c4d42443fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:42:15.866772 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea65de4f-89dc-41da-951c-0c4d42443fc3 admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:42:15.867046 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea65de4f-89dc-41da-951c-0c4d42443fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:42:15.867311 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea65de4f-89dc-41da-951c-0c4d42443fc3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:42:15.867937 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea65de4f-89dc-41da-951c-0c4d42443fc3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:42:15.868231 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea65de4f-89dc-41da-951c-0c4d42443fc3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:42:15.870371 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea65de4f-89dc-41da-951c-0c4d42443fc3 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:42:15.881531 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1403/2826] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Sep 9 16:42:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:42:15.885937 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9687f81b-ebeb-49e3-b2ef-78ef01c9155b None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:42:15.895162 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9687f81b-ebeb-49e3-b2ef-78ef01c9155b None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:42:15.899747 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b967079-704f-45ae-a718-83c5bc69d34e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:42:15.900878 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b967079-704f-45ae-a718-83c5bc69d34e admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:42:15.901152 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b967079-704f-45ae-a718-83c5bc69d34e admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:42:15.901417 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b967079-704f-45ae-a718-83c5bc69d34e admin admin] PATH_INFO: `/v3/projects` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:42:15.902031 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b967079-704f-45ae-a718-83c5bc69d34e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:42:15.903946 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b967079-704f-45ae-a718-83c5bc69d34e admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:42:15.931762 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1424/2827] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 16:42:15 2022] POST /identity/v3/projects => generated 375 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:42:15.935962 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea65de4f-89dc-41da-951c-0c4d42443fc3 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:42:15.945631 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea65de4f-89dc-41da-951c-0c4d42443fc3 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:42:15.949575 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:42:16.003776 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f2da0a-9313-48ec-b545-1bc906c78666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:42:16.004370 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f2da0a-9313-48ec-b545-1bc906c78666 admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:42:16.004650 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f2da0a-9313-48ec-b545-1bc906c78666 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:42:16.004944 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f2da0a-9313-48ec-b545-1bc906c78666 admin admin] PATH_INFO: `/v3/users` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:42:16.005537 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f2da0a-9313-48ec-b545-1bc906c78666 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:42:16.007482 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f2da0a-9313-48ec-b545-1bc906c78666 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:42:16.028483 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1404/2828] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 16:42:15 2022] POST /identity/v3/users => generated 288 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:42:16.032504 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b967079-704f-45ae-a718-83c5bc69d34e admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:42:16.043170 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b967079-704f-45ae-a718-83c5bc69d34e admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:42:16.047783 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f13dae-8973-4374-8a68-bb5d6c2308f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:42:16.048370 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f13dae-8973-4374-8a68-bb5d6c2308f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:42:16.048650 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f13dae-8973-4374-8a68-bb5d6c2308f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:42:16.048924 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f13dae-8973-4374-8a68-bb5d6c2308f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:42:16.049554 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f13dae-8973-4374-8a68-bb5d6c2308f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:42:16.051180 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f13dae-8973-4374-8a68-bb5d6c2308f8 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:42:16.061677 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1425/2829] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:42:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:42:16.065488 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f2da0a-9313-48ec-b545-1bc906c78666 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:42:16.075159 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f2da0a-9313-48ec-b545-1bc906c78666 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:42:16.079987 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4cca5d-cea2-44a8-8f3a-e65c0202f341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:42:16.080562 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4cca5d-cea2-44a8-8f3a-e65c0202f341 admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:42:16.080846 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4cca5d-cea2-44a8-8f3a-e65c0202f341 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:42:16.081115 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4cca5d-cea2-44a8-8f3a-e65c0202f341 admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:42:16.081741 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4cca5d-cea2-44a8-8f3a-e65c0202f341 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:42:16.083341 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4cca5d-cea2-44a8-8f3a-e65c0202f341 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:42:16.093424 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1405/2830] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:42:16 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:42:16.097259 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f13dae-8973-4374-8a68-bb5d6c2308f8 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:42:16.107657 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f13dae-8973-4374-8a68-bb5d6c2308f8 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:42:16.112267 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a464f59a-4bb9-451f-ac18-232ac3c02376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:42:16.112897 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a464f59a-4bb9-451f-ac18-232ac3c02376 admin admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:42:16.113181 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a464f59a-4bb9-451f-ac18-232ac3c02376 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:42:16.113458 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a464f59a-4bb9-451f-ac18-232ac3c02376 admin admin] PATH_INFO: `/v3/projects/062b8d98ce4b4038b2e26b473abb4487/users/3630313734c14684972e844fc9cc4338/roles/b38e84bf077846ee802e6bb1bad83522` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:42:16.128344 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a464f59a-4bb9-451f-ac18-232ac3c02376 admin admin] RBAC: Authorizing `identity:create_grant(project_id=062b8d98ce4b4038b2e26b473abb4487, user_id=3630313734c14684972e844fc9cc4338, role_id=b38e84bf077846ee802e6bb1bad83522)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:42:16.131005 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a464f59a-4bb9-451f-ac18-232ac3c02376 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:42:16.143809 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1426/2831] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 16:42:16 2022] PUT /identity/v3/projects/062b8d98ce4b4038b2e26b473abb4487/users/3630313734c14684972e844fc9cc4338/roles/b38e84bf077846ee802e6bb1bad83522 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:42:16.153903 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa3438e-77a6-4a9f-8d36-ff2ce2767826 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:42:16.154187 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa3438e-77a6-4a9f-8d36-ff2ce2767826 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:42:16.154491 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa3438e-77a6-4a9f-8d36-ff2ce2767826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:42:16.182180 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-1aa3438e-77a6-4a9f-8d36-ff2ce2767826 None None] MFA Rules not processed for user `3630313734c14684972e844fc9cc4338`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:42:16.183409 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-1aa3438e-77a6-4a9f-8d36-ff2ce2767826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:42:16.247205 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1406/2832] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:42:16 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:42:16.251920 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a464f59a-4bb9-451f-ac18-232ac3c02376 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:42:16.265447 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:42:16.319279 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a464f59a-4bb9-451f-ac18-232ac3c02376 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:42:16.324108 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8465affc-5c13-490e-b87a-22cc413c4504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:42:16.324715 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8465affc-5c13-490e-b87a-22cc413c4504 admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:42:16.325132 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8465affc-5c13-490e-b87a-22cc413c4504 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:42:16.325418 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8465affc-5c13-490e-b87a-22cc413c4504 admin admin] PATH_INFO: `/v3/projects` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:42:16.326085 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8465affc-5c13-490e-b87a-22cc413c4504 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:42:16.328303 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8465affc-5c13-490e-b87a-22cc413c4504 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:42:16.363557 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1427/2833] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 16:42:16 2022] POST /identity/v3/projects => generated 379 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 16:42:16.364718 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa3438e-77a6-4a9f-8d36-ff2ce2767826 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:42:16.376107 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa3438e-77a6-4a9f-8d36-ff2ce2767826 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:42:16.436308 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ed19b6-ea68-4331-be03-a622a9e4e620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:42:16.436905 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ed19b6-ea68-4331-be03-a622a9e4e620 admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:42:16.437175 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ed19b6-ea68-4331-be03-a622a9e4e620 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:42:16.437441 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ed19b6-ea68-4331-be03-a622a9e4e620 admin admin] PATH_INFO: `/v3/users` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:42:16.438052 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ed19b6-ea68-4331-be03-a622a9e4e620 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:42:16.439981 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ed19b6-ea68-4331-be03-a622a9e4e620 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:42:16.461142 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1407/2834] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 16:42:16 2022] POST /identity/v3/users => generated 296 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 16:42:16.465547 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8465affc-5c13-490e-b87a-22cc413c4504 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:42:16.475602 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8465affc-5c13-490e-b87a-22cc413c4504 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:42:16.480180 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ef8cc7-f68f-4bc2-8b8a-4f0dae21ec6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:42:16.480787 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ef8cc7-f68f-4bc2-8b8a-4f0dae21ec6b admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:42:16.481063 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ef8cc7-f68f-4bc2-8b8a-4f0dae21ec6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:42:16.481329 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ef8cc7-f68f-4bc2-8b8a-4f0dae21ec6b admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:42:16.481946 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ef8cc7-f68f-4bc2-8b8a-4f0dae21ec6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:42:16.483564 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ef8cc7-f68f-4bc2-8b8a-4f0dae21ec6b admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:42:16.494330 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1428/2835] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:42:16 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:42:16.498382 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ed19b6-ea68-4331-be03-a622a9e4e620 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:42:16.504663 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:42:16.508399 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ed19b6-ea68-4331-be03-a622a9e4e620 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:42:16.514426 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dfc012-7cb1-41fe-b6b4-8284d6a67b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:42:16.515064 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dfc012-7cb1-41fe-b6b4-8284d6a67b95 admin admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:42:16.515336 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dfc012-7cb1-41fe-b6b4-8284d6a67b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:42:16.515604 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dfc012-7cb1-41fe-b6b4-8284d6a67b95 admin admin] PATH_INFO: `/v3/projects/e96ba86387af468fa1f47f6b0720684e/users/05c475969fd6446a9c437e7b3b10670d/roles/0a36d1be416f4089be19be979943b731` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:42:16.530589 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dfc012-7cb1-41fe-b6b4-8284d6a67b95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e96ba86387af468fa1f47f6b0720684e, user_id=05c475969fd6446a9c437e7b3b10670d, role_id=0a36d1be416f4089be19be979943b731)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:42:16.533181 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dfc012-7cb1-41fe-b6b4-8284d6a67b95 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:42:16.546040 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1408/2836] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 16:42:16 2022] PUT /identity/v3/projects/e96ba86387af468fa1f47f6b0720684e/users/05c475969fd6446a9c437e7b3b10670d/roles/0a36d1be416f4089be19be979943b731 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 16:42:16.549965 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ef8cc7-f68f-4bc2-8b8a-4f0dae21ec6b admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:42:16.561705 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ef8cc7-f68f-4bc2-8b8a-4f0dae21ec6b admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:42:16.618097 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d50145-d92e-4cf7-b87c-162cb540c501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:42:16.619214 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d50145-d92e-4cf7-b87c-162cb540c501 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:42:16.619488 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d50145-d92e-4cf7-b87c-162cb540c501 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:42:16.619756 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d50145-d92e-4cf7-b87c-162cb540c501 admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:42:16.620386 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d50145-d92e-4cf7-b87c-162cb540c501 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:42:16.621998 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d50145-d92e-4cf7-b87c-162cb540c501 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:42:16.631607 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1429/2837] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:42:16 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:42:16.636403 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dfc012-7cb1-41fe-b6b4-8284d6a67b95 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:42:16.646803 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dfc012-7cb1-41fe-b6b4-8284d6a67b95 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:42:16.651401 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415d2013-5b90-4370-bdee-fe4ea63b89bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:42:16.652316 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415d2013-5b90-4370-bdee-fe4ea63b89bc admin admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:42:16.652448 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415d2013-5b90-4370-bdee-fe4ea63b89bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:42:16.652652 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415d2013-5b90-4370-bdee-fe4ea63b89bc admin admin] PATH_INFO: `/v3/projects/e96ba86387af468fa1f47f6b0720684e/users/05c475969fd6446a9c437e7b3b10670d/roles/0a36d1be416f4089be19be979943b731` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:42:16.654575 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415d2013-5b90-4370-bdee-fe4ea63b89bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=e96ba86387af468fa1f47f6b0720684e, user_id=05c475969fd6446a9c437e7b3b10670d, role_id=0a36d1be416f4089be19be979943b731)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:42:16.657160 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415d2013-5b90-4370-bdee-fe4ea63b89bc admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:42:16.667941 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1409/2838] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 16:42:16 2022] PUT /identity/v3/projects/e96ba86387af468fa1f47f6b0720684e/users/05c475969fd6446a9c437e7b3b10670d/roles/0a36d1be416f4089be19be979943b731 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:42:16.679425 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bfe185-62db-479a-adbd-14d706c3f407 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:42:16.679713 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bfe185-62db-479a-adbd-14d706c3f407 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:42:16.679987 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bfe185-62db-479a-adbd-14d706c3f407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:42:16.709309 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-91bfe185-62db-479a-adbd-14d706c3f407 None None] MFA Rules not processed for user `05c475969fd6446a9c437e7b3b10670d`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:42:16.710558 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-91bfe185-62db-479a-adbd-14d706c3f407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:42:16.781298 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1430/2839] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:42:16 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:42:16.793245 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415d2013-5b90-4370-bdee-fe4ea63b89bc admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:42:16.795089 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-415d2013-5b90-4370-bdee-fe4ea63b89bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:42:16.851483 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415d2013-5b90-4370-bdee-fe4ea63b89bc admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:42:16.855639 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72223a6d-e15a-4dc7-9b93-8b7747c3f3db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8078e791ba68460f8b3aeafb4b79b73a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:42:16.856234 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72223a6d-e15a-4dc7-9b93-8b7747c3f3db service cinder] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:42:16.856509 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72223a6d-e15a-4dc7-9b93-8b7747c3f3db service cinder] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:42:16.856778 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72223a6d-e15a-4dc7-9b93-8b7747c3f3db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:42:16.865646 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72223a6d-e15a-4dc7-9b93-8b7747c3f3db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:42:16.867116 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72223a6d-e15a-4dc7-9b93-8b7747c3f3db service cinder] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:42:16.877260 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1410/2840] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:42:16 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:42:16.950665 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bfe185-62db-479a-adbd-14d706c3f407 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:42:16.960567 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bfe185-62db-479a-adbd-14d706c3f407 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:42:16.964246 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d339f5-ab03-48e3-87c2-4a1bf24007ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8078e791ba68460f8b3aeafb4b79b73a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:42:16.964830 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d339f5-ab03-48e3-87c2-4a1bf24007ba service cinder] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:42:16.965105 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d339f5-ab03-48e3-87c2-4a1bf24007ba service cinder] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:42:16.965372 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d339f5-ab03-48e3-87c2-4a1bf24007ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:42:16.970934 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:42:17.027445 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d339f5-ab03-48e3-87c2-4a1bf24007ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:42:17.028889 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d339f5-ab03-48e3-87c2-4a1bf24007ba service cinder] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:42:17.037767 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1431/2841] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:42:16 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:42:18.557214 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72223a6d-e15a-4dc7-9b93-8b7747c3f3db service cinder] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:42:18.558817 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-72223a6d-e15a-4dc7-9b93-8b7747c3f3db service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:42:18.616159 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72223a6d-e15a-4dc7-9b93-8b7747c3f3db service cinder] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:42:18.620353 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc559d9a-5953-48ec-a697-f4aeab8d2204 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f44bfdd5214e8d84a2c0a5b1fd9b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:42:18.620937 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc559d9a-5953-48ec-a697-f4aeab8d2204 service neutron] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:42:18.621213 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc559d9a-5953-48ec-a697-f4aeab8d2204 service neutron] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:42:18.621472 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc559d9a-5953-48ec-a697-f4aeab8d2204 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:42:18.623149 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-bc559d9a-5953-48ec-a697-f4aeab8d2204 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:42:18.633625 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc559d9a-5953-48ec-a697-f4aeab8d2204 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:42:18.633778 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc559d9a-5953-48ec-a697-f4aeab8d2204 service neutron] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:42:18.642539 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1411/2842] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:42:18 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:42:21.664658 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d339f5-ab03-48e3-87c2-4a1bf24007ba service cinder] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:42:21.666886 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-82d339f5-ab03-48e3-87c2-4a1bf24007ba service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:42:21.679130 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d339f5-ab03-48e3-87c2-4a1bf24007ba service cinder] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:42:21.682724 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67910437-14b8-4c98-838b-f4afe99fbdb6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f44bfdd5214e8d84a2c0a5b1fd9b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:42:21.683313 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67910437-14b8-4c98-838b-f4afe99fbdb6 service neutron] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:42:21.683591 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67910437-14b8-4c98-838b-f4afe99fbdb6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:42:21.683882 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67910437-14b8-4c98-838b-f4afe99fbdb6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:42:21.685535 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-67910437-14b8-4c98-838b-f4afe99fbdb6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:42:21.695165 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67910437-14b8-4c98-838b-f4afe99fbdb6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:42:21.696681 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67910437-14b8-4c98-838b-f4afe99fbdb6 service neutron] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:42:21.705028 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1432/2843] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:42:21 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:42:21.812781 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc559d9a-5953-48ec-a697-f4aeab8d2204 service neutron] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:42:21.821704 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc559d9a-5953-48ec-a697-f4aeab8d2204 service neutron] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:42:21.825320 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd9e235-d715-4c3c-8d2d-df2097557ba9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f44bfdd5214e8d84a2c0a5b1fd9b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:42:21.825915 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd9e235-d715-4c3c-8d2d-df2097557ba9 service neutron] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:42:21.826262 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd9e235-d715-4c3c-8d2d-df2097557ba9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:42:21.826648 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd9e235-d715-4c3c-8d2d-df2097557ba9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:42:21.828827 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-cbd9e235-d715-4c3c-8d2d-df2097557ba9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:42:21.898658 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd9e235-d715-4c3c-8d2d-df2097557ba9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:42:21.900613 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd9e235-d715-4c3c-8d2d-df2097557ba9 service neutron] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:42:21.905337 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:42:21.912952 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1412/2844] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:42:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:42:21.972680 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67910437-14b8-4c98-838b-f4afe99fbdb6 service neutron] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:42:21.974091 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-67910437-14b8-4c98-838b-f4afe99fbdb6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:42:22.040627 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67910437-14b8-4c98-838b-f4afe99fbdb6 service neutron] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:42:22.045428 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69514a94-7bb0-4cfb-8c3f-431bbe677cdf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d73df92393c43b2b5ccc32a2d43d952', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:42:22.046008 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69514a94-7bb0-4cfb-8c3f-431bbe677cdf service placement] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:42:22.046281 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69514a94-7bb0-4cfb-8c3f-431bbe677cdf service placement] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:42:22.046579 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69514a94-7bb0-4cfb-8c3f-431bbe677cdf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:42:22.048226 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-69514a94-7bb0-4cfb-8c3f-431bbe677cdf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:42:22.059152 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69514a94-7bb0-4cfb-8c3f-431bbe677cdf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:42:22.060699 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69514a94-7bb0-4cfb-8c3f-431bbe677cdf service placement] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:42:22.070275 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1433/2845] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:42:21 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:42:23.820103 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd9e235-d715-4c3c-8d2d-df2097557ba9 service neutron] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:42:23.880990 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd9e235-d715-4c3c-8d2d-df2097557ba9 service neutron] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:42:23.886083 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d365cd05-7a6e-4792-bcd8-4571a7d96185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:42:23.886732 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d365cd05-7a6e-4792-bcd8-4571a7d96185 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:42:23.887007 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d365cd05-7a6e-4792-bcd8-4571a7d96185 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:42:23.887274 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d365cd05-7a6e-4792-bcd8-4571a7d96185 admin admin] PATH_INFO: `/v3/users/3630313734c14684972e844fc9cc4338` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:42:23.888360 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d365cd05-7a6e-4792-bcd8-4571a7d96185 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3630313734c14684972e844fc9cc4338)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:42:23.890251 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d365cd05-7a6e-4792-bcd8-4571a7d96185 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:42:23.932829 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-d365cd05-7a6e-4792-bcd8-4571a7d96185 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3630313734c14684972e844fc9cc4338'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:42:23.939843 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-d365cd05-7a6e-4792-bcd8-4571a7d96185 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3630313734c14684972e844fc9cc4338'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:42:23.940495 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-d365cd05-7a6e-4792-bcd8-4571a7d96185 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3630313734c14684972e844fc9cc4338'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:42:23.947902 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-d365cd05-7a6e-4792-bcd8-4571a7d96185 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3630313734c14684972e844fc9cc4338'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:42:23.959696 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-d365cd05-7a6e-4792-bcd8-4571a7d96185 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3630313734c14684972e844fc9cc4338'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:42:23.965651 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1413/2846] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 16:42:23 2022] DELETE /identity/v3/users/3630313734c14684972e844fc9cc4338 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:42:23.970432 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2238f2c-2a30-4487-8361-02199b0b36e3 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:42:23.970941 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2238f2c-2a30-4487-8361-02199b0b36e3 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:42:23.971045 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2238f2c-2a30-4487-8361-02199b0b36e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:42:23.989887 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-d2238f2c-2a30-4487-8361-02199b0b36e3 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:42:23.991056 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-d2238f2c-2a30-4487-8361-02199b0b36e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:42:24.050725 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1434/2847] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:42:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:42:24.061618 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d365cd05-7a6e-4792-bcd8-4571a7d96185 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:42:24.063045 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-d365cd05-7a6e-4792-bcd8-4571a7d96185 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:42:24.127547 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d365cd05-7a6e-4792-bcd8-4571a7d96185 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:42:24.132077 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690e247b-9f64-403a-97c4-10e3a608337f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f44bfdd5214e8d84a2c0a5b1fd9b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:42:24.132754 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690e247b-9f64-403a-97c4-10e3a608337f service neutron] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:42:24.133287 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690e247b-9f64-403a-97c4-10e3a608337f service neutron] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:42:24.133420 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690e247b-9f64-403a-97c4-10e3a608337f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:42:24.143337 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690e247b-9f64-403a-97c4-10e3a608337f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:42:24.144886 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690e247b-9f64-403a-97c4-10e3a608337f service neutron] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:42:24.156097 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1414/2848] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:42:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:42:24.440579 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2238f2c-2a30-4487-8361-02199b0b36e3 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:42:24.442271 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-d2238f2c-2a30-4487-8361-02199b0b36e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:42:24.457548 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2238f2c-2a30-4487-8361-02199b0b36e3 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:42:24.464087 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f15d12-feab-4862-addc-75aeeb8aef08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:42:24.464721 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f15d12-feab-4862-addc-75aeeb8aef08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:42:24.465002 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f15d12-feab-4862-addc-75aeeb8aef08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:42:24.465308 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f15d12-feab-4862-addc-75aeeb8aef08 admin admin] PATH_INFO: `/v3/projects/062b8d98ce4b4038b2e26b473abb4487` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:42:24.466670 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f15d12-feab-4862-addc-75aeeb8aef08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=062b8d98ce4b4038b2e26b473abb4487)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:42:24.468580 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f15d12-feab-4862-addc-75aeeb8aef08 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:42:24.490471 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:42:24.516948 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-b5f15d12-feab-4862-addc-75aeeb8aef08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '062b8d98ce4b4038b2e26b473abb4487', 'request_id': 'req-b5f15d12-feab-4862-addc-75aeeb8aef08'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:42:24.522406 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-b5f15d12-feab-4862-addc-75aeeb8aef08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '062b8d98ce4b4038b2e26b473abb4487', 'request_id': 'req-b5f15d12-feab-4862-addc-75aeeb8aef08'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:42:24.531754 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-b5f15d12-feab-4862-addc-75aeeb8aef08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '062b8d98ce4b4038b2e26b473abb4487', 'request_id': 'req-b5f15d12-feab-4862-addc-75aeeb8aef08'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:42:24.543424 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-b5f15d12-feab-4862-addc-75aeeb8aef08 admin admin] The token cache is being invalidate because project 062b8d98ce4b4038b2e26b473abb4487 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81446) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 16:42:24.543765 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-b5f15d12-feab-4862-addc-75aeeb8aef08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:42:24.544383 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-b5f15d12-feab-4862-addc-75aeeb8aef08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:42:24.545891 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1435/2849] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 16:42:24 2022] DELETE /identity/v3/projects/062b8d98ce4b4038b2e26b473abb4487 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:42:24.550148 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690e247b-9f64-403a-97c4-10e3a608337f service neutron] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:42:24.560627 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690e247b-9f64-403a-97c4-10e3a608337f service neutron] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:42:24.580171 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:42:24.621992 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea06a526-bd87-48d8-bd0c-aacc45d9b5c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:42:24.622656 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea06a526-bd87-48d8-bd0c-aacc45d9b5c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:42:24.622940 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea06a526-bd87-48d8-bd0c-aacc45d9b5c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:42:24.623212 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea06a526-bd87-48d8-bd0c-aacc45d9b5c9 admin admin] PATH_INFO: `/v3/users/05c475969fd6446a9c437e7b3b10670d` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:42:24.624445 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea06a526-bd87-48d8-bd0c-aacc45d9b5c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05c475969fd6446a9c437e7b3b10670d)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:42:24.626460 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea06a526-bd87-48d8-bd0c-aacc45d9b5c9 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:42:24.677300 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-ea06a526-bd87-48d8-bd0c-aacc45d9b5c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05c475969fd6446a9c437e7b3b10670d'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:42:24.685236 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-ea06a526-bd87-48d8-bd0c-aacc45d9b5c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05c475969fd6446a9c437e7b3b10670d'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:42:24.685852 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-ea06a526-bd87-48d8-bd0c-aacc45d9b5c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05c475969fd6446a9c437e7b3b10670d'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:42:24.693123 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-ea06a526-bd87-48d8-bd0c-aacc45d9b5c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05c475969fd6446a9c437e7b3b10670d'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:42:24.706142 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-ea06a526-bd87-48d8-bd0c-aacc45d9b5c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05c475969fd6446a9c437e7b3b10670d'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:42:24.712384 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1415/2850] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 16:42:24 2022] DELETE /identity/v3/users/05c475969fd6446a9c437e7b3b10670d => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:42:24.981388 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f15d12-feab-4862-addc-75aeeb8aef08 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:42:24.982956 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-b5f15d12-feab-4862-addc-75aeeb8aef08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:42:24.996698 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f15d12-feab-4862-addc-75aeeb8aef08 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:42:25.053939 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58718e1-2ba6-43d6-b582-5c6a41a8a726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:42:25.054588 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58718e1-2ba6-43d6-b582-5c6a41a8a726 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:42:25.054864 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58718e1-2ba6-43d6-b582-5c6a41a8a726 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:42:25.055131 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58718e1-2ba6-43d6-b582-5c6a41a8a726 admin admin] PATH_INFO: `/v3/projects/e96ba86387af468fa1f47f6b0720684e` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:42:25.056767 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58718e1-2ba6-43d6-b582-5c6a41a8a726 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e96ba86387af468fa1f47f6b0720684e)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:42:25.058742 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58718e1-2ba6-43d6-b582-5c6a41a8a726 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:42:25.103648 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-f58718e1-2ba6-43d6-b582-5c6a41a8a726 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e96ba86387af468fa1f47f6b0720684e', 'request_id': 'req-f58718e1-2ba6-43d6-b582-5c6a41a8a726'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:42:25.109124 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-f58718e1-2ba6-43d6-b582-5c6a41a8a726 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e96ba86387af468fa1f47f6b0720684e', 'request_id': 'req-f58718e1-2ba6-43d6-b582-5c6a41a8a726'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:42:25.116299 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-f58718e1-2ba6-43d6-b582-5c6a41a8a726 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e96ba86387af468fa1f47f6b0720684e', 'request_id': 'req-f58718e1-2ba6-43d6-b582-5c6a41a8a726'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:42:25.127677 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-f58718e1-2ba6-43d6-b582-5c6a41a8a726 admin admin] The token cache is being invalidate because project e96ba86387af468fa1f47f6b0720684e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81446) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 16:42:25.127961 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-f58718e1-2ba6-43d6-b582-5c6a41a8a726 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:42:25.128602 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-f58718e1-2ba6-43d6-b582-5c6a41a8a726 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:42:25.130047 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1436/2851] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 16:42:24 2022] DELETE /identity/v3/projects/e96ba86387af468fa1f47f6b0720684e => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:42:25.134978 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948e7f68-aaca-468d-85e5-cfe50f03c7ab None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:42:25.135471 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948e7f68-aaca-468d-85e5-cfe50f03c7ab None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:42:25.135571 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948e7f68-aaca-468d-85e5-cfe50f03c7ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:42:25.154676 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-948e7f68-aaca-468d-85e5-cfe50f03c7ab None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:42:25.155890 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-948e7f68-aaca-468d-85e5-cfe50f03c7ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:42:25.219859 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1416/2852] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:42:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:42:25.228100 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bffdcdb-990d-4544-b30d-95a73168edfd None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:42:25.228385 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bffdcdb-990d-4544-b30d-95a73168edfd None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:42:25.228655 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bffdcdb-990d-4544-b30d-95a73168edfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:42:25.248820 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-5bffdcdb-990d-4544-b30d-95a73168edfd None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:42:25.250016 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-5bffdcdb-990d-4544-b30d-95a73168edfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:42:25.258451 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1437/2853] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:42:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:42:25.262667 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948e7f68-aaca-468d-85e5-cfe50f03c7ab None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:42:25.272742 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948e7f68-aaca-468d-85e5-cfe50f03c7ab None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:42:25.277652 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a572700f-3c76-4698-b769-6735203c984c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:42:25.278272 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a572700f-3c76-4698-b769-6735203c984c admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:42:25.278603 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a572700f-3c76-4698-b769-6735203c984c admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:42:25.279431 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a572700f-3c76-4698-b769-6735203c984c admin admin] PATH_INFO: `/v3/domains` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:42:25.279568 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a572700f-3c76-4698-b769-6735203c984c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:42:25.279837 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a572700f-3c76-4698-b769-6735203c984c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:42:25.281505 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a572700f-3c76-4698-b769-6735203c984c admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:42:25.294690 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1417/2854] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Sep 9 16:42:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:42:25.299145 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bffdcdb-990d-4544-b30d-95a73168edfd None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:42:25.309020 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bffdcdb-990d-4544-b30d-95a73168edfd None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:42:25.313711 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ca8d16-83bb-453d-ae9c-b8f6f7d78171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:42:25.314989 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ca8d16-83bb-453d-ae9c-b8f6f7d78171 admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:42:25.314989 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ca8d16-83bb-453d-ae9c-b8f6f7d78171 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:42:25.314989 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ca8d16-83bb-453d-ae9c-b8f6f7d78171 admin admin] PATH_INFO: `/v3/projects` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:42:25.315508 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ca8d16-83bb-453d-ae9c-b8f6f7d78171 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:42:25.317428 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ca8d16-83bb-453d-ae9c-b8f6f7d78171 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:42:25.349375 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1438/2855] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 16:42:25 2022] POST /identity/v3/projects => generated 377 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 16:42:25.350532 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a572700f-3c76-4698-b769-6735203c984c admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:42:25.361230 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a572700f-3c76-4698-b769-6735203c984c admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:42:25.385807 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:42:25.419120 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459df145-92c7-49cd-8208-e465ab947547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:42:25.419725 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459df145-92c7-49cd-8208-e465ab947547 admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:42:25.420014 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459df145-92c7-49cd-8208-e465ab947547 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:42:25.420284 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459df145-92c7-49cd-8208-e465ab947547 admin admin] PATH_INFO: `/v3/users` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:42:25.420914 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459df145-92c7-49cd-8208-e465ab947547 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:42:25.422904 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459df145-92c7-49cd-8208-e465ab947547 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:42:25.444276 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1418/2856] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 16:42:25 2022] POST /identity/v3/users => generated 289 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 16:42:25.448895 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ca8d16-83bb-453d-ae9c-b8f6f7d78171 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:42:25.459618 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ca8d16-83bb-453d-ae9c-b8f6f7d78171 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:42:25.464321 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7328a5ef-cb1f-45f5-b75a-8056f3a8d933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:42:25.464907 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7328a5ef-cb1f-45f5-b75a-8056f3a8d933 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:42:25.465211 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7328a5ef-cb1f-45f5-b75a-8056f3a8d933 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:42:25.465481 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7328a5ef-cb1f-45f5-b75a-8056f3a8d933 admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:42:25.466184 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7328a5ef-cb1f-45f5-b75a-8056f3a8d933 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:42:25.468113 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7328a5ef-cb1f-45f5-b75a-8056f3a8d933 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:42:25.470370 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:42:25.482662 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1439/2857] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:42:25 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:42:25.487636 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459df145-92c7-49cd-8208-e465ab947547 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:42:25.499432 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459df145-92c7-49cd-8208-e465ab947547 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:42:25.504123 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4287de40-b97b-436d-a3e0-0f61da3283de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:42:25.504710 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4287de40-b97b-436d-a3e0-0f61da3283de admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:42:25.504989 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4287de40-b97b-436d-a3e0-0f61da3283de admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:42:25.505261 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4287de40-b97b-436d-a3e0-0f61da3283de admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:42:25.505943 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4287de40-b97b-436d-a3e0-0f61da3283de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:42:25.507588 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4287de40-b97b-436d-a3e0-0f61da3283de admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:42:25.518910 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1419/2858] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:42:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:42:25.522982 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7328a5ef-cb1f-45f5-b75a-8056f3a8d933 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:42:25.533238 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7328a5ef-cb1f-45f5-b75a-8056f3a8d933 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:42:25.538057 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3864ff3-063c-4a51-9d55-fd43a147d647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:42:25.538747 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3864ff3-063c-4a51-9d55-fd43a147d647 admin admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:42:25.539039 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3864ff3-063c-4a51-9d55-fd43a147d647 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:42:25.539325 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3864ff3-063c-4a51-9d55-fd43a147d647 admin admin] PATH_INFO: `/v3/projects/0fc4d1574ab6421fa04cf3f3332e7629/users/152cc01a27b1437fb2a2623d7379beb0/roles/b38e84bf077846ee802e6bb1bad83522` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:42:25.554121 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3864ff3-063c-4a51-9d55-fd43a147d647 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fc4d1574ab6421fa04cf3f3332e7629, user_id=152cc01a27b1437fb2a2623d7379beb0, role_id=b38e84bf077846ee802e6bb1bad83522)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:42:25.558649 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3864ff3-063c-4a51-9d55-fd43a147d647 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:42:25.573698 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1440/2859] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 16:42:25 2022] PUT /identity/v3/projects/0fc4d1574ab6421fa04cf3f3332e7629/users/152cc01a27b1437fb2a2623d7379beb0/roles/b38e84bf077846ee802e6bb1bad83522 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:42:25.584644 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e75f11-8298-409b-9a9b-e51387ca8803 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:42:25.584928 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e75f11-8298-409b-9a9b-e51387ca8803 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:42:25.585200 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e75f11-8298-409b-9a9b-e51387ca8803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:42:25.612523 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-f4e75f11-8298-409b-9a9b-e51387ca8803 None None] MFA Rules not processed for user `152cc01a27b1437fb2a2623d7379beb0`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:42:25.613753 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-f4e75f11-8298-409b-9a9b-e51387ca8803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:42:25.679443 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1420/2860] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:42:25 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 16:42:25.684443 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3864ff3-063c-4a51-9d55-fd43a147d647 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:42:25.745549 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3864ff3-063c-4a51-9d55-fd43a147d647 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:42:25.750181 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ebc784-57b3-46b5-8615-be85b784c10d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:42:25.750806 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ebc784-57b3-46b5-8615-be85b784c10d admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:42:25.751084 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ebc784-57b3-46b5-8615-be85b784c10d admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:42:25.751361 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ebc784-57b3-46b5-8615-be85b784c10d admin admin] PATH_INFO: `/v3/projects` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:42:25.751972 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ebc784-57b3-46b5-8615-be85b784c10d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:42:25.753848 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ebc784-57b3-46b5-8615-be85b784c10d admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:42:25.779219 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1441/2861] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 16:42:25 2022] POST /identity/v3/projects => generated 377 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:42:25.783291 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e75f11-8298-409b-9a9b-e51387ca8803 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:42:25.795107 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e75f11-8298-409b-9a9b-e51387ca8803 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:42:25.854609 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cdb7ab-b7f2-467f-b5a0-f64610686a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:42:25.855133 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cdb7ab-b7f2-467f-b5a0-f64610686a35 admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:42:25.855432 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cdb7ab-b7f2-467f-b5a0-f64610686a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:42:25.855713 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cdb7ab-b7f2-467f-b5a0-f64610686a35 admin admin] PATH_INFO: `/v3/users` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:42:25.856340 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cdb7ab-b7f2-467f-b5a0-f64610686a35 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:42:25.858310 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cdb7ab-b7f2-467f-b5a0-f64610686a35 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:42:25.879416 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1421/2862] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 16:42:25 2022] POST /identity/v3/users => generated 295 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:42:25.883569 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ebc784-57b3-46b5-8615-be85b784c10d admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:42:25.893817 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ebc784-57b3-46b5-8615-be85b784c10d admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:42:25.898504 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31ac00f-20e3-4f4c-a272-8b25e03e827e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:42:25.899119 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31ac00f-20e3-4f4c-a272-8b25e03e827e admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:42:25.899414 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31ac00f-20e3-4f4c-a272-8b25e03e827e admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:42:25.899685 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31ac00f-20e3-4f4c-a272-8b25e03e827e admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:42:25.900309 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31ac00f-20e3-4f4c-a272-8b25e03e827e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:42:25.901896 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31ac00f-20e3-4f4c-a272-8b25e03e827e admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:42:25.913336 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1442/2863] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:42:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:42:25.917794 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cdb7ab-b7f2-467f-b5a0-f64610686a35 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:42:25.927610 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cdb7ab-b7f2-467f-b5a0-f64610686a35 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:42:25.932694 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ae8c0c-a5b5-4195-bcf5-33497f6f4906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:42:25.933403 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ae8c0c-a5b5-4195-bcf5-33497f6f4906 admin admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:42:25.933690 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ae8c0c-a5b5-4195-bcf5-33497f6f4906 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:42:25.933969 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ae8c0c-a5b5-4195-bcf5-33497f6f4906 admin admin] PATH_INFO: `/v3/projects/b8671de91e2b465b9e5d632aad467305/users/f405c3396abc442983b72af0da935752/roles/0a36d1be416f4089be19be979943b731` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:42:25.948786 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ae8c0c-a5b5-4195-bcf5-33497f6f4906 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8671de91e2b465b9e5d632aad467305, user_id=f405c3396abc442983b72af0da935752, role_id=0a36d1be416f4089be19be979943b731)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:42:25.951450 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ae8c0c-a5b5-4195-bcf5-33497f6f4906 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:42:25.960283 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:42:25.965716 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1422/2864] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 16:42:25 2022] PUT /identity/v3/projects/b8671de91e2b465b9e5d632aad467305/users/f405c3396abc442983b72af0da935752/roles/0a36d1be416f4089be19be979943b731 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:42:25.969906 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31ac00f-20e3-4f4c-a272-8b25e03e827e admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:42:25.980388 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31ac00f-20e3-4f4c-a272-8b25e03e827e admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:42:26.035164 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef850cd-79a4-461e-95a5-213ab2a71d83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:42:26.035763 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef850cd-79a4-461e-95a5-213ab2a71d83 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:42:26.036032 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef850cd-79a4-461e-95a5-213ab2a71d83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:42:26.036313 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef850cd-79a4-461e-95a5-213ab2a71d83 admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:42:26.037022 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef850cd-79a4-461e-95a5-213ab2a71d83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:42:26.038677 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef850cd-79a4-461e-95a5-213ab2a71d83 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:42:26.049430 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1443/2865] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:42:25 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:42:26.053454 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ae8c0c-a5b5-4195-bcf5-33497f6f4906 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:42:26.064416 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ae8c0c-a5b5-4195-bcf5-33497f6f4906 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:42:26.069025 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff6c65d-aa9c-42ee-9316-dd3476107901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:42:26.069671 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff6c65d-aa9c-42ee-9316-dd3476107901 admin admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:42:26.069953 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff6c65d-aa9c-42ee-9316-dd3476107901 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:42:26.070223 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff6c65d-aa9c-42ee-9316-dd3476107901 admin admin] PATH_INFO: `/v3/projects/b8671de91e2b465b9e5d632aad467305/users/f405c3396abc442983b72af0da935752/roles/0a36d1be416f4089be19be979943b731` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:42:26.072168 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff6c65d-aa9c-42ee-9316-dd3476107901 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8671de91e2b465b9e5d632aad467305, user_id=f405c3396abc442983b72af0da935752, role_id=0a36d1be416f4089be19be979943b731)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:42:26.074851 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff6c65d-aa9c-42ee-9316-dd3476107901 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:42:26.085812 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1423/2866] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 16:42:26 2022] PUT /identity/v3/projects/b8671de91e2b465b9e5d632aad467305/users/f405c3396abc442983b72af0da935752/roles/0a36d1be416f4089be19be979943b731 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:42:26.097547 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606e3169-6a9d-4542-a833-ba1802746b59 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:42:26.097829 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606e3169-6a9d-4542-a833-ba1802746b59 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:42:26.098099 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606e3169-6a9d-4542-a833-ba1802746b59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:42:26.127456 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-606e3169-6a9d-4542-a833-ba1802746b59 None None] MFA Rules not processed for user `f405c3396abc442983b72af0da935752`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:42:26.128550 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-606e3169-6a9d-4542-a833-ba1802746b59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:42:26.172380 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:42:26.214668 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1444/2867] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:42:26 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:42:26.226525 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff6c65d-aa9c-42ee-9316-dd3476107901 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:42:26.228911 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-cff6c65d-aa9c-42ee-9316-dd3476107901 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:42:26.298459 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff6c65d-aa9c-42ee-9316-dd3476107901 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:42:26.302146 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab44faf0-b2e1-4425-bdd6-bf2dbc6d7659 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8078e791ba68460f8b3aeafb4b79b73a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:42:26.302775 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab44faf0-b2e1-4425-bdd6-bf2dbc6d7659 service cinder] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:42:26.303050 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab44faf0-b2e1-4425-bdd6-bf2dbc6d7659 service cinder] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:42:26.303316 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab44faf0-b2e1-4425-bdd6-bf2dbc6d7659 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:42:26.360205 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab44faf0-b2e1-4425-bdd6-bf2dbc6d7659 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:42:26.361644 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab44faf0-b2e1-4425-bdd6-bf2dbc6d7659 service cinder] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:42:26.370444 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1424/2868] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:42:26 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:42:27.769769 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606e3169-6a9d-4542-a833-ba1802746b59 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:42:27.771180 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-606e3169-6a9d-4542-a833-ba1802746b59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:42:27.783295 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606e3169-6a9d-4542-a833-ba1802746b59 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:42:27.786740 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7f709f-0c1d-4ca1-aa1b-55b192be5fbb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8078e791ba68460f8b3aeafb4b79b73a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:42:27.787327 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7f709f-0c1d-4ca1-aa1b-55b192be5fbb service cinder] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:42:27.787599 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7f709f-0c1d-4ca1-aa1b-55b192be5fbb service cinder] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:42:27.787873 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7f709f-0c1d-4ca1-aa1b-55b192be5fbb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:42:27.797133 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7f709f-0c1d-4ca1-aa1b-55b192be5fbb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:42:27.798565 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7f709f-0c1d-4ca1-aa1b-55b192be5fbb service cinder] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:42:27.808298 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1445/2869] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:42:27 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:42:31.575129 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab44faf0-b2e1-4425-bdd6-bf2dbc6d7659 service cinder] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:42:31.636037 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab44faf0-b2e1-4425-bdd6-bf2dbc6d7659 service cinder] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:42:31.640450 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8c7fe4-0354-4d1a-a5f2-9dcc66635c74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:42:31.641060 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8c7fe4-0354-4d1a-a5f2-9dcc66635c74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:42:31.641333 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8c7fe4-0354-4d1a-a5f2-9dcc66635c74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:42:31.641599 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8c7fe4-0354-4d1a-a5f2-9dcc66635c74 admin admin] PATH_INFO: `/v3/users/152cc01a27b1437fb2a2623d7379beb0` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:42:31.642722 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8c7fe4-0354-4d1a-a5f2-9dcc66635c74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=152cc01a27b1437fb2a2623d7379beb0)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:42:31.644607 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8c7fe4-0354-4d1a-a5f2-9dcc66635c74 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:42:31.686393 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:42:31.689110 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-2b8c7fe4-0354-4d1a-a5f2-9dcc66635c74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '152cc01a27b1437fb2a2623d7379beb0'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:42:31.696290 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-2b8c7fe4-0354-4d1a-a5f2-9dcc66635c74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '152cc01a27b1437fb2a2623d7379beb0'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:42:31.696919 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-2b8c7fe4-0354-4d1a-a5f2-9dcc66635c74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '152cc01a27b1437fb2a2623d7379beb0'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:42:31.704514 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-2b8c7fe4-0354-4d1a-a5f2-9dcc66635c74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '152cc01a27b1437fb2a2623d7379beb0'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:42:31.716633 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-2b8c7fe4-0354-4d1a-a5f2-9dcc66635c74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '152cc01a27b1437fb2a2623d7379beb0'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:42:31.722351 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1425/2870] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 16:42:31 2022] DELETE /identity/v3/users/152cc01a27b1437fb2a2623d7379beb0 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:42:31.726722 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff67381-b343-4db5-a219-10dfecd6e48c None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:42:31.727199 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff67381-b343-4db5-a219-10dfecd6e48c None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:42:31.727306 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff67381-b343-4db5-a219-10dfecd6e48c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:42:31.745595 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-cff67381-b343-4db5-a219-10dfecd6e48c None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:42:31.746804 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-cff67381-b343-4db5-a219-10dfecd6e48c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:42:31.805388 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1446/2871] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:42:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:42:31.815069 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8c7fe4-0354-4d1a-a5f2-9dcc66635c74 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:42:31.816535 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-2b8c7fe4-0354-4d1a-a5f2-9dcc66635c74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:42:31.873854 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8c7fe4-0354-4d1a-a5f2-9dcc66635c74 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:42:31.877409 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df2388f-202f-46ec-9024-20674327aec0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f44bfdd5214e8d84a2c0a5b1fd9b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:42:31.877995 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df2388f-202f-46ec-9024-20674327aec0 service neutron] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:42:31.878265 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df2388f-202f-46ec-9024-20674327aec0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:42:31.878557 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df2388f-202f-46ec-9024-20674327aec0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:42:31.887698 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df2388f-202f-46ec-9024-20674327aec0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:42:31.889103 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df2388f-202f-46ec-9024-20674327aec0 service neutron] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:42:31.898187 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1426/2872] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:42:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:42:32.171615 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff67381-b343-4db5-a219-10dfecd6e48c None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:42:32.173058 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-cff67381-b343-4db5-a219-10dfecd6e48c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:42:32.185902 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff67381-b343-4db5-a219-10dfecd6e48c None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:42:32.190531 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e40de8-eaf0-4be5-9288-8244065fd2ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:42:32.191172 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e40de8-eaf0-4be5-9288-8244065fd2ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:42:32.191445 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e40de8-eaf0-4be5-9288-8244065fd2ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:42:32.191713 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e40de8-eaf0-4be5-9288-8244065fd2ed admin admin] PATH_INFO: `/v3/projects/0fc4d1574ab6421fa04cf3f3332e7629` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:42:32.192837 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e40de8-eaf0-4be5-9288-8244065fd2ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=0fc4d1574ab6421fa04cf3f3332e7629)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:42:32.194799 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e40de8-eaf0-4be5-9288-8244065fd2ed admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:42:32.242869 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-76e40de8-eaf0-4be5-9288-8244065fd2ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0fc4d1574ab6421fa04cf3f3332e7629', 'request_id': 'req-76e40de8-eaf0-4be5-9288-8244065fd2ed'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:42:32.248770 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-76e40de8-eaf0-4be5-9288-8244065fd2ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0fc4d1574ab6421fa04cf3f3332e7629', 'request_id': 'req-76e40de8-eaf0-4be5-9288-8244065fd2ed'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:42:32.256034 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-76e40de8-eaf0-4be5-9288-8244065fd2ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0fc4d1574ab6421fa04cf3f3332e7629', 'request_id': 'req-76e40de8-eaf0-4be5-9288-8244065fd2ed'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:42:32.267719 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-76e40de8-eaf0-4be5-9288-8244065fd2ed admin admin] The token cache is being invalidate because project 0fc4d1574ab6421fa04cf3f3332e7629 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81446) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 16:42:32.268009 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-76e40de8-eaf0-4be5-9288-8244065fd2ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:42:32.268629 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-76e40de8-eaf0-4be5-9288-8244065fd2ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:42:32.270078 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1447/2873] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 16:42:32 2022] DELETE /identity/v3/projects/0fc4d1574ab6421fa04cf3f3332e7629 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:42:32.274060 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df2388f-202f-46ec-9024-20674327aec0 service neutron] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:42:32.284280 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df2388f-202f-46ec-9024-20674327aec0 service neutron] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:42:32.339680 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd656c8d-b5eb-495b-a569-9a65fa352fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:42:32.340221 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd656c8d-b5eb-495b-a569-9a65fa352fe3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:42:32.340492 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd656c8d-b5eb-495b-a569-9a65fa352fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:42:32.340757 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd656c8d-b5eb-495b-a569-9a65fa352fe3 admin admin] PATH_INFO: `/v3/users/f405c3396abc442983b72af0da935752` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:42:32.341842 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd656c8d-b5eb-495b-a569-9a65fa352fe3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f405c3396abc442983b72af0da935752)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:42:32.343792 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd656c8d-b5eb-495b-a569-9a65fa352fe3 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:42:32.388276 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-dd656c8d-b5eb-495b-a569-9a65fa352fe3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f405c3396abc442983b72af0da935752'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:42:32.395475 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-dd656c8d-b5eb-495b-a569-9a65fa352fe3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f405c3396abc442983b72af0da935752'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:42:32.396110 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-dd656c8d-b5eb-495b-a569-9a65fa352fe3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f405c3396abc442983b72af0da935752'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:42:32.403511 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-dd656c8d-b5eb-495b-a569-9a65fa352fe3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f405c3396abc442983b72af0da935752'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:42:32.405542 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:42:32.420039 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-dd656c8d-b5eb-495b-a569-9a65fa352fe3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f405c3396abc442983b72af0da935752'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:42:32.425938 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1427/2874] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 16:42:32 2022] DELETE /identity/v3/users/f405c3396abc442983b72af0da935752 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:42:32.687707 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e40de8-eaf0-4be5-9288-8244065fd2ed admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:42:32.689328 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-76e40de8-eaf0-4be5-9288-8244065fd2ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:42:32.705087 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e40de8-eaf0-4be5-9288-8244065fd2ed admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:42:32.745248 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:42:32.765631 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2519f7-30ce-4f75-be6d-86fb6e01dba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:42:32.766259 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2519f7-30ce-4f75-be6d-86fb6e01dba7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:42:32.766571 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2519f7-30ce-4f75-be6d-86fb6e01dba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:42:32.766846 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2519f7-30ce-4f75-be6d-86fb6e01dba7 admin admin] PATH_INFO: `/v3/projects/b8671de91e2b465b9e5d632aad467305` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:42:32.767959 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2519f7-30ce-4f75-be6d-86fb6e01dba7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8671de91e2b465b9e5d632aad467305)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:42:32.769867 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2519f7-30ce-4f75-be6d-86fb6e01dba7 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:42:32.816970 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-db2519f7-30ce-4f75-be6d-86fb6e01dba7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8671de91e2b465b9e5d632aad467305', 'request_id': 'req-db2519f7-30ce-4f75-be6d-86fb6e01dba7'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:42:32.822589 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-db2519f7-30ce-4f75-be6d-86fb6e01dba7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8671de91e2b465b9e5d632aad467305', 'request_id': 'req-db2519f7-30ce-4f75-be6d-86fb6e01dba7'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:42:32.830463 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-db2519f7-30ce-4f75-be6d-86fb6e01dba7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8671de91e2b465b9e5d632aad467305', 'request_id': 'req-db2519f7-30ce-4f75-be6d-86fb6e01dba7'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:42:32.841840 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-db2519f7-30ce-4f75-be6d-86fb6e01dba7 admin admin] The token cache is being invalidate because project b8671de91e2b465b9e5d632aad467305 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81446) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 16:42:32.842130 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-db2519f7-30ce-4f75-be6d-86fb6e01dba7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:42:32.842813 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-db2519f7-30ce-4f75-be6d-86fb6e01dba7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:42:32.844250 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1448/2875] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 16:42:32 2022] DELETE /identity/v3/projects/b8671de91e2b465b9e5d632aad467305 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:42:32.849339 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fc0351-6c44-440b-a7a0-9d425a7e547d None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:42:32.849993 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fc0351-6c44-440b-a7a0-9d425a7e547d None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:42:32.849993 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fc0351-6c44-440b-a7a0-9d425a7e547d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:42:32.869457 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-c0fc0351-6c44-440b-a7a0-9d425a7e547d None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:42:32.870609 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-c0fc0351-6c44-440b-a7a0-9d425a7e547d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:42:32.927555 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1428/2876] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:42:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 16:42:32.935158 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa0001d-9a1a-40c3-b98b-f9cac89dfc7c None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:42:32.935444 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa0001d-9a1a-40c3-b98b-f9cac89dfc7c None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:42:32.935716 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa0001d-9a1a-40c3-b98b-f9cac89dfc7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:42:32.955774 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-baa0001d-9a1a-40c3-b98b-f9cac89dfc7c None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:42:32.956956 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-baa0001d-9a1a-40c3-b98b-f9cac89dfc7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:42:32.965951 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1449/2877] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:42:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:42:32.970324 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fc0351-6c44-440b-a7a0-9d425a7e547d None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:42:32.980507 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fc0351-6c44-440b-a7a0-9d425a7e547d None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:42:32.984959 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebc24fd-800f-41a6-8bef-9b789c1448b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:42:32.985541 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebc24fd-800f-41a6-8bef-9b789c1448b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:42:32.985816 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebc24fd-800f-41a6-8bef-9b789c1448b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:42:32.986080 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebc24fd-800f-41a6-8bef-9b789c1448b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:42:32.986741 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebc24fd-800f-41a6-8bef-9b789c1448b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81445) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:42:32.987036 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebc24fd-800f-41a6-8bef-9b789c1448b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:42:32.988608 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebc24fd-800f-41a6-8bef-9b789c1448b2 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:42:32.999570 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1429/2878] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Sep 9 16:42:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:42:33.003650 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa0001d-9a1a-40c3-b98b-f9cac89dfc7c None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:42:33.012898 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa0001d-9a1a-40c3-b98b-f9cac89dfc7c None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:42:33.017439 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9af2bc1-f2ec-4b6c-8b10-53d4f4c628ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:42:33.018022 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9af2bc1-f2ec-4b6c-8b10-53d4f4c628ef admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:42:33.018297 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9af2bc1-f2ec-4b6c-8b10-53d4f4c628ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:42:33.018593 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9af2bc1-f2ec-4b6c-8b10-53d4f4c628ef admin admin] PATH_INFO: `/v3/projects` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:42:33.019218 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9af2bc1-f2ec-4b6c-8b10-53d4f4c628ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:42:33.021088 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9af2bc1-f2ec-4b6c-8b10-53d4f4c628ef admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:42:33.048135 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1450/2879] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 16:42:33 2022] POST /identity/v3/projects => generated 381 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:42:33.052156 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebc24fd-800f-41a6-8bef-9b789c1448b2 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:42:33.061831 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebc24fd-800f-41a6-8bef-9b789c1448b2 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:42:33.115297 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fdeeda-dfa7-457d-9085-0172574757a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:42:33.115876 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fdeeda-dfa7-457d-9085-0172574757a9 admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:42:33.116150 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fdeeda-dfa7-457d-9085-0172574757a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:42:33.116416 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fdeeda-dfa7-457d-9085-0172574757a9 admin admin] PATH_INFO: `/v3/users` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:42:33.117028 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fdeeda-dfa7-457d-9085-0172574757a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:42:33.118971 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fdeeda-dfa7-457d-9085-0172574757a9 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:42:33.139160 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1430/2880] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 16:42:33 2022] POST /identity/v3/users => generated 291 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:42:33.143320 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9af2bc1-f2ec-4b6c-8b10-53d4f4c628ef admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:42:33.153943 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9af2bc1-f2ec-4b6c-8b10-53d4f4c628ef admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:42:33.158522 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67766a0-8d6a-4584-a1a2-6217fed78c8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:42:33.159106 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67766a0-8d6a-4584-a1a2-6217fed78c8c admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:42:33.159381 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67766a0-8d6a-4584-a1a2-6217fed78c8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:42:33.159646 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67766a0-8d6a-4584-a1a2-6217fed78c8c admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:42:33.160274 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67766a0-8d6a-4584-a1a2-6217fed78c8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:42:33.161890 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67766a0-8d6a-4584-a1a2-6217fed78c8c admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:42:33.172178 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1451/2881] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:42:33 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:42:33.176227 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fdeeda-dfa7-457d-9085-0172574757a9 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:42:33.186184 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fdeeda-dfa7-457d-9085-0172574757a9 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:42:33.190740 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e423430b-1d86-4d6f-b21b-1dfac383e7fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:42:33.191321 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e423430b-1d86-4d6f-b21b-1dfac383e7fd admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:42:33.191593 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e423430b-1d86-4d6f-b21b-1dfac383e7fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:42:33.191857 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e423430b-1d86-4d6f-b21b-1dfac383e7fd admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:42:33.192483 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e423430b-1d86-4d6f-b21b-1dfac383e7fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:42:33.194045 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e423430b-1d86-4d6f-b21b-1dfac383e7fd admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:42:33.205063 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1431/2882] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:42:33 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:42:33.208887 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67766a0-8d6a-4584-a1a2-6217fed78c8c admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:42:33.219485 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67766a0-8d6a-4584-a1a2-6217fed78c8c admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:42:33.224239 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c805e71c-e4a4-4f35-b404-80e587ba5ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:42:33.224878 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c805e71c-e4a4-4f35-b404-80e587ba5ae2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:42:33.225156 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c805e71c-e4a4-4f35-b404-80e587ba5ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:42:33.225430 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c805e71c-e4a4-4f35-b404-80e587ba5ae2 admin admin] PATH_INFO: `/v3/projects/fb8bcf477bf54357b1717bf2771ecb57/users/82cce59a120a4e45ae7e77ca1aa955b5/roles/b38e84bf077846ee802e6bb1bad83522` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:42:33.239943 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c805e71c-e4a4-4f35-b404-80e587ba5ae2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb8bcf477bf54357b1717bf2771ecb57, user_id=82cce59a120a4e45ae7e77ca1aa955b5, role_id=b38e84bf077846ee802e6bb1bad83522)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:42:33.242678 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c805e71c-e4a4-4f35-b404-80e587ba5ae2 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:42:33.254915 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1452/2883] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 16:42:33 2022] PUT /identity/v3/projects/fb8bcf477bf54357b1717bf2771ecb57/users/82cce59a120a4e45ae7e77ca1aa955b5/roles/b38e84bf077846ee802e6bb1bad83522 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:42:33.266853 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9adcc28-c728-49a4-b51d-ed16fc3e6da2 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:42:33.267134 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9adcc28-c728-49a4-b51d-ed16fc3e6da2 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:42:33.267404 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9adcc28-c728-49a4-b51d-ed16fc3e6da2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:42:33.297961 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-f9adcc28-c728-49a4-b51d-ed16fc3e6da2 None None] MFA Rules not processed for user `82cce59a120a4e45ae7e77ca1aa955b5`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:42:33.299199 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-f9adcc28-c728-49a4-b51d-ed16fc3e6da2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:42:33.335535 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:42:33.362200 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1432/2884] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:42:33 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:42:33.366703 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c805e71c-e4a4-4f35-b404-80e587ba5ae2 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:42:33.428796 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c805e71c-e4a4-4f35-b404-80e587ba5ae2 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:42:33.433381 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6886fb-cdf8-4d88-9e14-81995cf4ad09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:42:33.433971 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6886fb-cdf8-4d88-9e14-81995cf4ad09 admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:42:33.434246 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6886fb-cdf8-4d88-9e14-81995cf4ad09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:42:33.434543 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6886fb-cdf8-4d88-9e14-81995cf4ad09 admin admin] PATH_INFO: `/v3/projects` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:42:33.435168 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6886fb-cdf8-4d88-9e14-81995cf4ad09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:42:33.437042 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6886fb-cdf8-4d88-9e14-81995cf4ad09 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:42:33.448324 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:42:33.465393 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1453/2885] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 16:42:33 2022] POST /identity/v3/projects => generated 381 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:42:33.469610 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9adcc28-c728-49a4-b51d-ed16fc3e6da2 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:42:33.480117 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9adcc28-c728-49a4-b51d-ed16fc3e6da2 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:42:33.535953 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99742f4f-922d-4456-a6d2-b9cc0a558b43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:42:33.536569 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99742f4f-922d-4456-a6d2-b9cc0a558b43 admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:42:33.536849 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99742f4f-922d-4456-a6d2-b9cc0a558b43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:42:33.537116 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99742f4f-922d-4456-a6d2-b9cc0a558b43 admin admin] PATH_INFO: `/v3/users` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:42:33.537747 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99742f4f-922d-4456-a6d2-b9cc0a558b43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:42:33.539677 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99742f4f-922d-4456-a6d2-b9cc0a558b43 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:42:33.560737 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1433/2886] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 16:42:33 2022] POST /identity/v3/users => generated 297 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 16:42:33.564853 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6886fb-cdf8-4d88-9e14-81995cf4ad09 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:42:33.575763 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6886fb-cdf8-4d88-9e14-81995cf4ad09 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:42:33.580609 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77b26d9-e8f2-4640-b72e-26e07534da04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:42:33.581190 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77b26d9-e8f2-4640-b72e-26e07534da04 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:42:33.581468 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77b26d9-e8f2-4640-b72e-26e07534da04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:42:33.581733 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77b26d9-e8f2-4640-b72e-26e07534da04 admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:42:33.582385 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77b26d9-e8f2-4640-b72e-26e07534da04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:42:33.583967 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77b26d9-e8f2-4640-b72e-26e07534da04 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:42:33.594296 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1454/2887] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:42:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:42:33.598265 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99742f4f-922d-4456-a6d2-b9cc0a558b43 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:42:33.608219 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99742f4f-922d-4456-a6d2-b9cc0a558b43 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:42:33.612867 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a02510e-093b-40ff-8aa0-020903c1adfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:42:33.613492 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a02510e-093b-40ff-8aa0-020903c1adfb admin admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:42:33.613765 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a02510e-093b-40ff-8aa0-020903c1adfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:42:33.614034 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a02510e-093b-40ff-8aa0-020903c1adfb admin admin] PATH_INFO: `/v3/projects/d77a78c2929f4614b7f7dc9ef9d02d8e/users/e01fe584a5d7496ab78eb46279d69ec3/roles/0a36d1be416f4089be19be979943b731` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:42:33.629298 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a02510e-093b-40ff-8aa0-020903c1adfb admin admin] RBAC: Authorizing `identity:create_grant(project_id=d77a78c2929f4614b7f7dc9ef9d02d8e, user_id=e01fe584a5d7496ab78eb46279d69ec3, role_id=0a36d1be416f4089be19be979943b731)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:42:33.631943 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a02510e-093b-40ff-8aa0-020903c1adfb admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:42:33.646097 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1434/2888] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 16:42:33 2022] PUT /identity/v3/projects/d77a78c2929f4614b7f7dc9ef9d02d8e/users/e01fe584a5d7496ab78eb46279d69ec3/roles/0a36d1be416f4089be19be979943b731 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:42:33.650224 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77b26d9-e8f2-4640-b72e-26e07534da04 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:42:33.660220 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77b26d9-e8f2-4640-b72e-26e07534da04 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:42:33.716723 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9bfef3-961c-4bc2-b479-2b0730cb3d9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:42:33.717264 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9bfef3-961c-4bc2-b479-2b0730cb3d9f admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:42:33.717533 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9bfef3-961c-4bc2-b479-2b0730cb3d9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:42:33.717806 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9bfef3-961c-4bc2-b479-2b0730cb3d9f admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:42:33.718471 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9bfef3-961c-4bc2-b479-2b0730cb3d9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:42:33.720059 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9bfef3-961c-4bc2-b479-2b0730cb3d9f admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:42:33.729611 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1455/2889] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:42:33 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:42:33.733859 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a02510e-093b-40ff-8aa0-020903c1adfb admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:42:33.744482 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a02510e-093b-40ff-8aa0-020903c1adfb admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:42:33.749039 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7e9d54-df8d-4071-8c9e-7c34a15547aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:42:33.749668 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7e9d54-df8d-4071-8c9e-7c34a15547aa admin admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:42:33.749943 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7e9d54-df8d-4071-8c9e-7c34a15547aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:42:33.750211 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7e9d54-df8d-4071-8c9e-7c34a15547aa admin admin] PATH_INFO: `/v3/projects/d77a78c2929f4614b7f7dc9ef9d02d8e/users/e01fe584a5d7496ab78eb46279d69ec3/roles/0a36d1be416f4089be19be979943b731` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:42:33.752123 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7e9d54-df8d-4071-8c9e-7c34a15547aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=d77a78c2929f4614b7f7dc9ef9d02d8e, user_id=e01fe584a5d7496ab78eb46279d69ec3, role_id=0a36d1be416f4089be19be979943b731)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:42:33.754740 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7e9d54-df8d-4071-8c9e-7c34a15547aa admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:42:33.765201 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1435/2890] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 16:42:33 2022] PUT /identity/v3/projects/d77a78c2929f4614b7f7dc9ef9d02d8e/users/e01fe584a5d7496ab78eb46279d69ec3/roles/0a36d1be416f4089be19be979943b731 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:42:33.828709 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e240fb-5490-4e58-a36d-5819bbdfc25a None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:42:33.829287 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e240fb-5490-4e58-a36d-5819bbdfc25a None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:42:33.829422 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e240fb-5490-4e58-a36d-5819bbdfc25a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:42:33.861643 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-23e240fb-5490-4e58-a36d-5819bbdfc25a None None] MFA Rules not processed for user `e01fe584a5d7496ab78eb46279d69ec3`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:42:33.862890 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-23e240fb-5490-4e58-a36d-5819bbdfc25a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:42:33.930631 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1456/2891] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:42:33 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 16:42:33.941983 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7e9d54-df8d-4071-8c9e-7c34a15547aa admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:42:33.943697 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-6b7e9d54-df8d-4071-8c9e-7c34a15547aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:42:34.000562 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7e9d54-df8d-4071-8c9e-7c34a15547aa admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:42:34.004037 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d507e4b-9e2f-4129-aeb3-ffa62e3d67ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8078e791ba68460f8b3aeafb4b79b73a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:42:34.004610 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d507e4b-9e2f-4129-aeb3-ffa62e3d67ce service cinder] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:42:34.004882 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d507e4b-9e2f-4129-aeb3-ffa62e3d67ce service cinder] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:42:34.005170 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d507e4b-9e2f-4129-aeb3-ffa62e3d67ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:42:34.013834 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d507e4b-9e2f-4129-aeb3-ffa62e3d67ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:42:34.015265 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d507e4b-9e2f-4129-aeb3-ffa62e3d67ce service cinder] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:42:34.024295 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1436/2892] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:42:33 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:42:34.390037 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e240fb-5490-4e58-a36d-5819bbdfc25a None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:42:34.451165 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e240fb-5490-4e58-a36d-5819bbdfc25a None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:42:34.455942 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d8e8dd-b891-4642-be22-e87dd60e4c91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:42:34.456551 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d8e8dd-b891-4642-be22-e87dd60e4c91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:42:34.456845 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d8e8dd-b891-4642-be22-e87dd60e4c91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:42:34.457115 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d8e8dd-b891-4642-be22-e87dd60e4c91 admin admin] PATH_INFO: `/v3/users/82cce59a120a4e45ae7e77ca1aa955b5` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:42:34.458254 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d8e8dd-b891-4642-be22-e87dd60e4c91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=82cce59a120a4e45ae7e77ca1aa955b5)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:42:34.460193 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d8e8dd-b891-4642-be22-e87dd60e4c91 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:42:34.462490 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:42:34.506252 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-08d8e8dd-b891-4642-be22-e87dd60e4c91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82cce59a120a4e45ae7e77ca1aa955b5'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:42:34.512963 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-08d8e8dd-b891-4642-be22-e87dd60e4c91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82cce59a120a4e45ae7e77ca1aa955b5'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:42:34.524404 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-08d8e8dd-b891-4642-be22-e87dd60e4c91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82cce59a120a4e45ae7e77ca1aa955b5'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:42:34.532161 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-08d8e8dd-b891-4642-be22-e87dd60e4c91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82cce59a120a4e45ae7e77ca1aa955b5'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:42:34.532774 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-08d8e8dd-b891-4642-be22-e87dd60e4c91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82cce59a120a4e45ae7e77ca1aa955b5'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:42:34.538625 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1457/2893] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 16:42:34 2022] DELETE /identity/v3/users/82cce59a120a4e45ae7e77ca1aa955b5 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:42:34.543700 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7483fd-9b5d-477a-8059-e9e5a2c08ef8 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:42:34.543989 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7483fd-9b5d-477a-8059-e9e5a2c08ef8 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:42:34.544263 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7483fd-9b5d-477a-8059-e9e5a2c08ef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:42:34.562652 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-9f7483fd-9b5d-477a-8059-e9e5a2c08ef8 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:42:34.563845 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-9f7483fd-9b5d-477a-8059-e9e5a2c08ef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:42:34.591869 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:42:34.623233 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1437/2894] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:42:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:42:34.632879 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d8e8dd-b891-4642-be22-e87dd60e4c91 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:42:34.634291 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-08d8e8dd-b891-4642-be22-e87dd60e4c91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:42:34.691311 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d8e8dd-b891-4642-be22-e87dd60e4c91 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:42:34.694909 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c299351-fe3a-433a-8001-362a1e6e8323 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f44bfdd5214e8d84a2c0a5b1fd9b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:42:34.695503 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c299351-fe3a-433a-8001-362a1e6e8323 service neutron] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:42:34.695775 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c299351-fe3a-433a-8001-362a1e6e8323 service neutron] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:42:34.696065 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c299351-fe3a-433a-8001-362a1e6e8323 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:42:34.705880 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c299351-fe3a-433a-8001-362a1e6e8323 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:42:34.707334 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c299351-fe3a-433a-8001-362a1e6e8323 service neutron] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:42:34.717289 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1458/2895] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:42:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:42:34.990110 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7483fd-9b5d-477a-8059-e9e5a2c08ef8 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:42:34.991675 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-9f7483fd-9b5d-477a-8059-e9e5a2c08ef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:42:35.003793 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7483fd-9b5d-477a-8059-e9e5a2c08ef8 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:42:35.008344 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05355d4-cadf-40cb-91d1-c223344376e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:42:35.008922 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05355d4-cadf-40cb-91d1-c223344376e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:42:35.009195 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05355d4-cadf-40cb-91d1-c223344376e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:42:35.009458 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05355d4-cadf-40cb-91d1-c223344376e9 admin admin] PATH_INFO: `/v3/projects/fb8bcf477bf54357b1717bf2771ecb57` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:42:35.010567 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05355d4-cadf-40cb-91d1-c223344376e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb8bcf477bf54357b1717bf2771ecb57)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:42:35.012541 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05355d4-cadf-40cb-91d1-c223344376e9 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:42:35.058273 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-b05355d4-cadf-40cb-91d1-c223344376e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb8bcf477bf54357b1717bf2771ecb57', 'request_id': 'req-b05355d4-cadf-40cb-91d1-c223344376e9'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:42:35.064202 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-b05355d4-cadf-40cb-91d1-c223344376e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb8bcf477bf54357b1717bf2771ecb57', 'request_id': 'req-b05355d4-cadf-40cb-91d1-c223344376e9'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:42:35.071275 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-b05355d4-cadf-40cb-91d1-c223344376e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb8bcf477bf54357b1717bf2771ecb57', 'request_id': 'req-b05355d4-cadf-40cb-91d1-c223344376e9'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:42:35.082195 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-b05355d4-cadf-40cb-91d1-c223344376e9 admin admin] The token cache is being invalidate because project fb8bcf477bf54357b1717bf2771ecb57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81445) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 16:42:35.082512 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-b05355d4-cadf-40cb-91d1-c223344376e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:42:35.083126 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-b05355d4-cadf-40cb-91d1-c223344376e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:42:35.084597 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1438/2896] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 16:42:34 2022] DELETE /identity/v3/projects/fb8bcf477bf54357b1717bf2771ecb57 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:42:35.089205 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c299351-fe3a-433a-8001-362a1e6e8323 service neutron] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:42:35.099024 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c299351-fe3a-433a-8001-362a1e6e8323 service neutron] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:42:35.154145 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6205106c-e000-4942-b791-91c58424a969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:42:35.154792 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6205106c-e000-4942-b791-91c58424a969 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:42:35.155118 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6205106c-e000-4942-b791-91c58424a969 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:42:35.155389 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6205106c-e000-4942-b791-91c58424a969 admin admin] PATH_INFO: `/v3/users/e01fe584a5d7496ab78eb46279d69ec3` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:42:35.156483 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6205106c-e000-4942-b791-91c58424a969 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e01fe584a5d7496ab78eb46279d69ec3)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:42:35.158407 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6205106c-e000-4942-b791-91c58424a969 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:42:35.186928 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:42:35.207012 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-6205106c-e000-4942-b791-91c58424a969 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e01fe584a5d7496ab78eb46279d69ec3'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:42:35.214761 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-6205106c-e000-4942-b791-91c58424a969 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e01fe584a5d7496ab78eb46279d69ec3'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:42:35.227040 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-6205106c-e000-4942-b791-91c58424a969 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e01fe584a5d7496ab78eb46279d69ec3'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:42:35.235366 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-6205106c-e000-4942-b791-91c58424a969 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e01fe584a5d7496ab78eb46279d69ec3'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:42:35.236008 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-6205106c-e000-4942-b791-91c58424a969 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e01fe584a5d7496ab78eb46279d69ec3'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:42:35.242202 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1459/2897] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 16:42:35 2022] DELETE /identity/v3/users/e01fe584a5d7496ab78eb46279d69ec3 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:42:35.517302 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05355d4-cadf-40cb-91d1-c223344376e9 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:42:35.518891 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-b05355d4-cadf-40cb-91d1-c223344376e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:42:35.532735 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05355d4-cadf-40cb-91d1-c223344376e9 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:42:35.591136 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da3eae1-3eff-4d80-88ee-ce3d6cc4e4d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:42:35.591811 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da3eae1-3eff-4d80-88ee-ce3d6cc4e4d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:42:35.592038 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da3eae1-3eff-4d80-88ee-ce3d6cc4e4d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:42:35.592306 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da3eae1-3eff-4d80-88ee-ce3d6cc4e4d5 admin admin] PATH_INFO: `/v3/projects/d77a78c2929f4614b7f7dc9ef9d02d8e` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:42:35.593393 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da3eae1-3eff-4d80-88ee-ce3d6cc4e4d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d77a78c2929f4614b7f7dc9ef9d02d8e)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:42:35.595330 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da3eae1-3eff-4d80-88ee-ce3d6cc4e4d5 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:42:35.640624 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-7da3eae1-3eff-4d80-88ee-ce3d6cc4e4d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd77a78c2929f4614b7f7dc9ef9d02d8e', 'request_id': 'req-7da3eae1-3eff-4d80-88ee-ce3d6cc4e4d5'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:42:35.646567 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-7da3eae1-3eff-4d80-88ee-ce3d6cc4e4d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd77a78c2929f4614b7f7dc9ef9d02d8e', 'request_id': 'req-7da3eae1-3eff-4d80-88ee-ce3d6cc4e4d5'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:42:35.650107 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:42:35.655216 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-7da3eae1-3eff-4d80-88ee-ce3d6cc4e4d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd77a78c2929f4614b7f7dc9ef9d02d8e', 'request_id': 'req-7da3eae1-3eff-4d80-88ee-ce3d6cc4e4d5'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:42:35.666689 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-7da3eae1-3eff-4d80-88ee-ce3d6cc4e4d5 admin admin] The token cache is being invalidate because project d77a78c2929f4614b7f7dc9ef9d02d8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81445) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 16:42:35.666976 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-7da3eae1-3eff-4d80-88ee-ce3d6cc4e4d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:42:35.667627 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-7da3eae1-3eff-4d80-88ee-ce3d6cc4e4d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:42:35.669111 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1439/2898] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 16:42:35 2022] DELETE /identity/v3/projects/d77a78c2929f4614b7f7dc9ef9d02d8e => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 16:42:35.673981 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a9f954-69b4-493e-9e29-fbe521f475e3 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:42:35.674268 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a9f954-69b4-493e-9e29-fbe521f475e3 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:42:35.674570 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a9f954-69b4-493e-9e29-fbe521f475e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:42:35.693789 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-36a9f954-69b4-493e-9e29-fbe521f475e3 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:42:35.695003 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-36a9f954-69b4-493e-9e29-fbe521f475e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:42:35.754781 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1460/2899] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:42:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:42:35.762573 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f4197a-eafc-4b62-938d-0111d60daa93 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:42:35.762866 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f4197a-eafc-4b62-938d-0111d60daa93 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:42:35.763139 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f4197a-eafc-4b62-938d-0111d60daa93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:42:35.782877 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-b1f4197a-eafc-4b62-938d-0111d60daa93 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:42:35.784067 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-b1f4197a-eafc-4b62-938d-0111d60daa93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:42:35.792497 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1440/2900] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:42:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:42:35.796504 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a9f954-69b4-493e-9e29-fbe521f475e3 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:42:35.806114 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a9f954-69b4-493e-9e29-fbe521f475e3 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:42:35.810691 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c5c323-2a75-4851-89d6-5e4a153eef41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:42:35.811279 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c5c323-2a75-4851-89d6-5e4a153eef41 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:42:35.811559 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c5c323-2a75-4851-89d6-5e4a153eef41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:42:35.811830 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c5c323-2a75-4851-89d6-5e4a153eef41 admin admin] PATH_INFO: `/v3/domains` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:42:35.812465 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c5c323-2a75-4851-89d6-5e4a153eef41 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:42:35.812790 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c5c323-2a75-4851-89d6-5e4a153eef41 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:42:35.814414 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c5c323-2a75-4851-89d6-5e4a153eef41 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:42:35.825725 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1461/2901] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Sep 9 16:42:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 16:42:35.829926 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f4197a-eafc-4b62-938d-0111d60daa93 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:42:35.839654 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f4197a-eafc-4b62-938d-0111d60daa93 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:42:35.844286 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ae2cc2-843c-42fc-8106-92f6b3b35950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:42:35.844813 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ae2cc2-843c-42fc-8106-92f6b3b35950 admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:42:35.845099 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ae2cc2-843c-42fc-8106-92f6b3b35950 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:42:35.845371 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ae2cc2-843c-42fc-8106-92f6b3b35950 admin admin] PATH_INFO: `/v3/projects` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:42:35.846028 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ae2cc2-843c-42fc-8106-92f6b3b35950 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:42:35.848195 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ae2cc2-843c-42fc-8106-92f6b3b35950 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:42:35.875611 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1441/2902] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 16:42:35 2022] POST /identity/v3/projects => generated 359 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:42:35.879696 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c5c323-2a75-4851-89d6-5e4a153eef41 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:42:35.889497 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c5c323-2a75-4851-89d6-5e4a153eef41 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:42:35.945342 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c7db8b-c0cc-496c-a6c6-be7b82ee8918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:42:35.945960 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c7db8b-c0cc-496c-a6c6-be7b82ee8918 admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:42:35.946239 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c7db8b-c0cc-496c-a6c6-be7b82ee8918 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:42:35.947070 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c7db8b-c0cc-496c-a6c6-be7b82ee8918 admin admin] PATH_INFO: `/v3/users` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:42:35.947186 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c7db8b-c0cc-496c-a6c6-be7b82ee8918 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:42:35.949069 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c7db8b-c0cc-496c-a6c6-be7b82ee8918 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:42:35.969739 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1462/2903] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 16:42:35 2022] POST /identity/v3/users => generated 280 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 16:42:35.973877 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ae2cc2-843c-42fc-8106-92f6b3b35950 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:42:35.985743 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ae2cc2-843c-42fc-8106-92f6b3b35950 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:42:35.990379 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7475036b-644a-415a-8b00-5fd4ea2cff78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:42:35.990955 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7475036b-644a-415a-8b00-5fd4ea2cff78 admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:42:35.991231 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7475036b-644a-415a-8b00-5fd4ea2cff78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:42:35.991501 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7475036b-644a-415a-8b00-5fd4ea2cff78 admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:42:35.992127 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7475036b-644a-415a-8b00-5fd4ea2cff78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:42:35.993714 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7475036b-644a-415a-8b00-5fd4ea2cff78 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:42:36.003461 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1442/2904] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:42:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:42:36.007500 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c7db8b-c0cc-496c-a6c6-be7b82ee8918 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:42:36.017479 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c7db8b-c0cc-496c-a6c6-be7b82ee8918 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:42:36.022029 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4746f34c-1bfe-4a31-87dd-34f4ac08502b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:42:36.022674 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4746f34c-1bfe-4a31-87dd-34f4ac08502b admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:42:36.022956 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4746f34c-1bfe-4a31-87dd-34f4ac08502b admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:42:36.023230 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4746f34c-1bfe-4a31-87dd-34f4ac08502b admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:42:36.023858 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4746f34c-1bfe-4a31-87dd-34f4ac08502b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:42:36.025997 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4746f34c-1bfe-4a31-87dd-34f4ac08502b admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:42:36.036643 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1463/2905] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:42:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:42:36.040631 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7475036b-644a-415a-8b00-5fd4ea2cff78 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:42:36.051077 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7475036b-644a-415a-8b00-5fd4ea2cff78 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:42:36.055555 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc95b47a-7b3d-415e-9114-59bde82ef4a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:42:36.056219 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc95b47a-7b3d-415e-9114-59bde82ef4a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:42:36.057079 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc95b47a-7b3d-415e-9114-59bde82ef4a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:42:36.057349 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc95b47a-7b3d-415e-9114-59bde82ef4a4 admin admin] PATH_INFO: `/v3/projects/3842c2cd59224d579059a06a9fce795e/users/174ff89dc72a461c8a92b1e922a95176/roles/b38e84bf077846ee802e6bb1bad83522` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:42:36.071339 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc95b47a-7b3d-415e-9114-59bde82ef4a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3842c2cd59224d579059a06a9fce795e, user_id=174ff89dc72a461c8a92b1e922a95176, role_id=b38e84bf077846ee802e6bb1bad83522)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:42:36.074505 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc95b47a-7b3d-415e-9114-59bde82ef4a4 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:42:36.087203 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1443/2906] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 16:42:36 2022] PUT /identity/v3/projects/3842c2cd59224d579059a06a9fce795e/users/174ff89dc72a461c8a92b1e922a95176/roles/b38e84bf077846ee802e6bb1bad83522 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 16:42:36.098627 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52df1442-5d1b-4528-a873-99e944a30016 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:42:36.099090 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52df1442-5d1b-4528-a873-99e944a30016 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:42:36.099090 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52df1442-5d1b-4528-a873-99e944a30016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:42:36.117941 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:42:36.127478 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-52df1442-5d1b-4528-a873-99e944a30016 None None] MFA Rules not processed for user `174ff89dc72a461c8a92b1e922a95176`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:42:36.129103 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-52df1442-5d1b-4528-a873-99e944a30016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:42:36.194218 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1464/2907] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:42:36 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:42:36.229497 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc95b47a-7b3d-415e-9114-59bde82ef4a4 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:42:36.231395 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-bc95b47a-7b3d-415e-9114-59bde82ef4a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:42:36.297141 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc95b47a-7b3d-415e-9114-59bde82ef4a4 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:42:36.300883 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292f69fc-acf2-4ba1-b253-8a0539447478 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8078e791ba68460f8b3aeafb4b79b73a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:42:36.301480 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292f69fc-acf2-4ba1-b253-8a0539447478 service cinder] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:42:36.301757 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292f69fc-acf2-4ba1-b253-8a0539447478 service cinder] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:42:36.302027 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292f69fc-acf2-4ba1-b253-8a0539447478 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:42:36.310447 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292f69fc-acf2-4ba1-b253-8a0539447478 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:42:36.311860 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292f69fc-acf2-4ba1-b253-8a0539447478 service cinder] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:42:36.320391 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1444/2908] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:42:36 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:42:36.337252 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52df1442-5d1b-4528-a873-99e944a30016 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:42:36.399749 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52df1442-5d1b-4528-a873-99e944a30016 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:42:36.404938 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044facc5-3ca7-408a-8f70-028724fa2e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:42:36.405570 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044facc5-3ca7-408a-8f70-028724fa2e90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:42:36.405851 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044facc5-3ca7-408a-8f70-028724fa2e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:42:36.406122 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044facc5-3ca7-408a-8f70-028724fa2e90 admin admin] PATH_INFO: `/v3/users/174ff89dc72a461c8a92b1e922a95176` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:42:36.407281 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044facc5-3ca7-408a-8f70-028724fa2e90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=174ff89dc72a461c8a92b1e922a95176)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:42:36.409210 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044facc5-3ca7-408a-8f70-028724fa2e90 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:42:36.455437 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-044facc5-3ca7-408a-8f70-028724fa2e90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '174ff89dc72a461c8a92b1e922a95176'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:42:36.462294 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-044facc5-3ca7-408a-8f70-028724fa2e90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '174ff89dc72a461c8a92b1e922a95176'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:42:36.474705 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-044facc5-3ca7-408a-8f70-028724fa2e90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '174ff89dc72a461c8a92b1e922a95176'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:42:36.482612 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-044facc5-3ca7-408a-8f70-028724fa2e90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '174ff89dc72a461c8a92b1e922a95176'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:42:36.483230 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-044facc5-3ca7-408a-8f70-028724fa2e90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '174ff89dc72a461c8a92b1e922a95176'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:42:36.489171 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1465/2909] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 16:42:36 2022] DELETE /identity/v3/users/174ff89dc72a461c8a92b1e922a95176 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:42:36.493729 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2de3aa-27d2-4913-a020-a9986996cbc1 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:42:36.494057 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2de3aa-27d2-4913-a020-a9986996cbc1 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:42:36.494383 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2de3aa-27d2-4913-a020-a9986996cbc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:42:36.513589 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-cf2de3aa-27d2-4913-a020-a9986996cbc1 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:42:36.514801 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-cf2de3aa-27d2-4913-a020-a9986996cbc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:42:36.573558 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1445/2910] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:42:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:42:36.583448 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044facc5-3ca7-408a-8f70-028724fa2e90 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:42:36.584836 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-044facc5-3ca7-408a-8f70-028724fa2e90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:42:36.605161 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:42:36.644472 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044facc5-3ca7-408a-8f70-028724fa2e90 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:42:36.648097 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9371a96d-f9ea-4161-b6f3-69ec80d71534 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f44bfdd5214e8d84a2c0a5b1fd9b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:42:36.648691 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9371a96d-f9ea-4161-b6f3-69ec80d71534 service neutron] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:42:36.648964 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9371a96d-f9ea-4161-b6f3-69ec80d71534 service neutron] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:42:36.649231 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9371a96d-f9ea-4161-b6f3-69ec80d71534 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:42:36.658082 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9371a96d-f9ea-4161-b6f3-69ec80d71534 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:42:36.659454 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9371a96d-f9ea-4161-b6f3-69ec80d71534 service neutron] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:42:36.668638 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1466/2911] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:42:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 16:42:36.935798 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2de3aa-27d2-4913-a020-a9986996cbc1 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:42:36.937302 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-cf2de3aa-27d2-4913-a020-a9986996cbc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:42:36.949952 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2de3aa-27d2-4913-a020-a9986996cbc1 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:42:36.954978 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d53fa6-e7ca-44a3-af1e-a156e09c1d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:42:36.955625 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d53fa6-e7ca-44a3-af1e-a156e09c1d45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:42:36.955884 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d53fa6-e7ca-44a3-af1e-a156e09c1d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:42:36.956180 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d53fa6-e7ca-44a3-af1e-a156e09c1d45 admin admin] PATH_INFO: `/v3/projects/3842c2cd59224d579059a06a9fce795e` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:42:36.957297 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d53fa6-e7ca-44a3-af1e-a156e09c1d45 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3842c2cd59224d579059a06a9fce795e)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:42:36.959383 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d53fa6-e7ca-44a3-af1e-a156e09c1d45 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:42:36.984144 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:42:37.008572 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-d7d53fa6-e7ca-44a3-af1e-a156e09c1d45 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3842c2cd59224d579059a06a9fce795e', 'request_id': 'req-d7d53fa6-e7ca-44a3-af1e-a156e09c1d45'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:42:37.015650 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-d7d53fa6-e7ca-44a3-af1e-a156e09c1d45 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3842c2cd59224d579059a06a9fce795e', 'request_id': 'req-d7d53fa6-e7ca-44a3-af1e-a156e09c1d45'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:42:37.023074 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-d7d53fa6-e7ca-44a3-af1e-a156e09c1d45 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3842c2cd59224d579059a06a9fce795e', 'request_id': 'req-d7d53fa6-e7ca-44a3-af1e-a156e09c1d45'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:42:37.034373 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-d7d53fa6-e7ca-44a3-af1e-a156e09c1d45 admin admin] The token cache is being invalidate because project 3842c2cd59224d579059a06a9fce795e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81445) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 16:42:37.034659 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-d7d53fa6-e7ca-44a3-af1e-a156e09c1d45 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:42:37.035275 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-d7d53fa6-e7ca-44a3-af1e-a156e09c1d45 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:42:37.036725 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1446/2912] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 16:42:36 2022] DELETE /identity/v3/projects/3842c2cd59224d579059a06a9fce795e => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:42:37.041775 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44da8143-ad5c-4883-8162-2462c7c33114 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:42:37.042076 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44da8143-ad5c-4883-8162-2462c7c33114 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:42:37.042457 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44da8143-ad5c-4883-8162-2462c7c33114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:42:37.062123 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-44da8143-ad5c-4883-8162-2462c7c33114 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:42:37.063384 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-44da8143-ad5c-4883-8162-2462c7c33114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:42:37.123980 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1467/2913] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:42:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:42:37.131769 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c1f32c-bdf7-4f70-a00f-3bf497bc0fc6 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:42:37.132054 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c1f32c-bdf7-4f70-a00f-3bf497bc0fc6 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:42:37.132324 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c1f32c-bdf7-4f70-a00f-3bf497bc0fc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:42:37.153037 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-61c1f32c-bdf7-4f70-a00f-3bf497bc0fc6 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:42:37.154217 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-61c1f32c-bdf7-4f70-a00f-3bf497bc0fc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:42:37.161840 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1447/2914] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:42:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:42:37.166482 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44da8143-ad5c-4883-8162-2462c7c33114 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:42:37.176171 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44da8143-ad5c-4883-8162-2462c7c33114 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:42:37.180866 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cf0cd9-73e6-4306-8281-719a219987f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:42:37.182012 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cf0cd9-73e6-4306-8281-719a219987f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:42:37.182295 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cf0cd9-73e6-4306-8281-719a219987f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:42:37.182592 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cf0cd9-73e6-4306-8281-719a219987f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:42:37.183235 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cf0cd9-73e6-4306-8281-719a219987f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:42:37.183539 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cf0cd9-73e6-4306-8281-719a219987f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:42:37.185152 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cf0cd9-73e6-4306-8281-719a219987f0 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:42:37.196660 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1468/2915] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Sep 9 16:42:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:42:37.200673 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c1f32c-bdf7-4f70-a00f-3bf497bc0fc6 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:42:37.210889 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c1f32c-bdf7-4f70-a00f-3bf497bc0fc6 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:42:37.215587 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97b409c-bac8-4766-a8db-52c0030828a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:42:37.216185 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97b409c-bac8-4766-a8db-52c0030828a1 admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:42:37.216463 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97b409c-bac8-4766-a8db-52c0030828a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:42:37.216763 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97b409c-bac8-4766-a8db-52c0030828a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:42:37.217390 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97b409c-bac8-4766-a8db-52c0030828a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:42:37.219320 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97b409c-bac8-4766-a8db-52c0030828a1 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:42:37.246241 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1448/2916] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 16:42:37 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:42:37.250416 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cf0cd9-73e6-4306-8281-719a219987f0 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:42:37.260160 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cf0cd9-73e6-4306-8281-719a219987f0 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:42:37.316762 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6390447f-4aeb-48c7-acd0-a46e8f9c83a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:42:37.317388 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6390447f-4aeb-48c7-acd0-a46e8f9c83a9 admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:42:37.317672 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6390447f-4aeb-48c7-acd0-a46e8f9c83a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:42:37.317946 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6390447f-4aeb-48c7-acd0-a46e8f9c83a9 admin admin] PATH_INFO: `/v3/users` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:42:37.318618 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6390447f-4aeb-48c7-acd0-a46e8f9c83a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:42:37.320530 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6390447f-4aeb-48c7-acd0-a46e8f9c83a9 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:42:37.342231 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1469/2917] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 16:42:37 2022] POST /identity/v3/users => generated 293 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 16:42:37.346417 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97b409c-bac8-4766-a8db-52c0030828a1 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:42:37.357324 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97b409c-bac8-4766-a8db-52c0030828a1 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:42:37.361917 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e99069-a265-4ce4-b342-ae5a1acc3a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:42:37.362540 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e99069-a265-4ce4-b342-ae5a1acc3a7f admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:42:37.362821 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e99069-a265-4ce4-b342-ae5a1acc3a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:42:37.363093 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e99069-a265-4ce4-b342-ae5a1acc3a7f admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:42:37.363722 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e99069-a265-4ce4-b342-ae5a1acc3a7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:42:37.365340 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e99069-a265-4ce4-b342-ae5a1acc3a7f admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:42:37.375000 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1449/2918] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:42:37 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:42:37.378913 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6390447f-4aeb-48c7-acd0-a46e8f9c83a9 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:42:37.388822 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6390447f-4aeb-48c7-acd0-a46e8f9c83a9 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:42:37.393417 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28af2465-5e50-436a-bc4b-be69df2a3b64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:42:37.394000 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28af2465-5e50-436a-bc4b-be69df2a3b64 admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:42:37.394276 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28af2465-5e50-436a-bc4b-be69df2a3b64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:42:37.394574 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28af2465-5e50-436a-bc4b-be69df2a3b64 admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:42:37.395204 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28af2465-5e50-436a-bc4b-be69df2a3b64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:42:37.396796 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28af2465-5e50-436a-bc4b-be69df2a3b64 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:42:37.407692 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1470/2919] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:42:37 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:42:37.411691 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e99069-a265-4ce4-b342-ae5a1acc3a7f admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:42:37.422136 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e99069-a265-4ce4-b342-ae5a1acc3a7f admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:42:37.426683 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295a1a73-17e3-48ac-85f3-8cb6dabeb4e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:42:37.427334 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295a1a73-17e3-48ac-85f3-8cb6dabeb4e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:42:37.427607 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295a1a73-17e3-48ac-85f3-8cb6dabeb4e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:42:37.427874 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295a1a73-17e3-48ac-85f3-8cb6dabeb4e7 admin admin] PATH_INFO: `/v3/projects/1e58ce3848454d5bb6996160327a38e6/users/3cef6fea7a6f4c67a4589e39edc04e2c/roles/b38e84bf077846ee802e6bb1bad83522` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:42:37.443361 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295a1a73-17e3-48ac-85f3-8cb6dabeb4e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e58ce3848454d5bb6996160327a38e6, user_id=3cef6fea7a6f4c67a4589e39edc04e2c, role_id=b38e84bf077846ee802e6bb1bad83522)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:42:37.446623 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295a1a73-17e3-48ac-85f3-8cb6dabeb4e7 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:42:37.460070 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1450/2920] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 16:42:37 2022] PUT /identity/v3/projects/1e58ce3848454d5bb6996160327a38e6/users/3cef6fea7a6f4c67a4589e39edc04e2c/roles/b38e84bf077846ee802e6bb1bad83522 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:42:37.471168 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28da7da0-fe0a-4a66-9867-1bfd4baaa852 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:42:37.471450 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28da7da0-fe0a-4a66-9867-1bfd4baaa852 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:42:37.471721 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28da7da0-fe0a-4a66-9867-1bfd4baaa852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:42:37.499103 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-28da7da0-fe0a-4a66-9867-1bfd4baaa852 None None] MFA Rules not processed for user `3cef6fea7a6f4c67a4589e39edc04e2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:42:37.500283 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-28da7da0-fe0a-4a66-9867-1bfd4baaa852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:42:37.512887 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:42:37.566438 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1471/2921] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:42:37 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:42:37.577677 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295a1a73-17e3-48ac-85f3-8cb6dabeb4e7 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:42:37.579443 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-295a1a73-17e3-48ac-85f3-8cb6dabeb4e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:42:37.634036 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295a1a73-17e3-48ac-85f3-8cb6dabeb4e7 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:42:37.637617 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f5cd60-a01b-47d9-aaaf-f63d41bebba1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8078e791ba68460f8b3aeafb4b79b73a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:42:37.638197 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f5cd60-a01b-47d9-aaaf-f63d41bebba1 service cinder] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:42:37.638499 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f5cd60-a01b-47d9-aaaf-f63d41bebba1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:42:37.638770 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f5cd60-a01b-47d9-aaaf-f63d41bebba1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:42:37.646971 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f5cd60-a01b-47d9-aaaf-f63d41bebba1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:42:37.648400 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f5cd60-a01b-47d9-aaaf-f63d41bebba1 service cinder] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:42:37.657627 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1451/2922] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:42:37 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:42:40.197846 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28da7da0-fe0a-4a66-9867-1bfd4baaa852 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:42:40.261193 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28da7da0-fe0a-4a66-9867-1bfd4baaa852 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:42:40.265753 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e28db6-5c2f-47fc-a640-4d113881ac52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:42:40.266406 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e28db6-5c2f-47fc-a640-4d113881ac52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:42:40.266683 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e28db6-5c2f-47fc-a640-4d113881ac52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:42:40.266950 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e28db6-5c2f-47fc-a640-4d113881ac52 admin admin] PATH_INFO: `/v3/users/3cef6fea7a6f4c67a4589e39edc04e2c` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:42:40.268046 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e28db6-5c2f-47fc-a640-4d113881ac52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3cef6fea7a6f4c67a4589e39edc04e2c)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:42:40.269945 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e28db6-5c2f-47fc-a640-4d113881ac52 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:42:40.318578 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-57e28db6-5c2f-47fc-a640-4d113881ac52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3cef6fea7a6f4c67a4589e39edc04e2c'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:42:40.326167 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-57e28db6-5c2f-47fc-a640-4d113881ac52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3cef6fea7a6f4c67a4589e39edc04e2c'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:42:40.338547 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-57e28db6-5c2f-47fc-a640-4d113881ac52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3cef6fea7a6f4c67a4589e39edc04e2c'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:42:40.345770 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-57e28db6-5c2f-47fc-a640-4d113881ac52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3cef6fea7a6f4c67a4589e39edc04e2c'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:42:40.346417 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-57e28db6-5c2f-47fc-a640-4d113881ac52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3cef6fea7a6f4c67a4589e39edc04e2c'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:42:40.352369 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1472/2923] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 16:42:40 2022] DELETE /identity/v3/users/3cef6fea7a6f4c67a4589e39edc04e2c => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:42:40.356864 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d9dc52-4058-433e-bf61-c399e3a27b5b None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:42:40.357348 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d9dc52-4058-433e-bf61-c399e3a27b5b None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:42:40.357468 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d9dc52-4058-433e-bf61-c399e3a27b5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:42:40.376166 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-29d9dc52-4058-433e-bf61-c399e3a27b5b None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:42:40.377335 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-29d9dc52-4058-433e-bf61-c399e3a27b5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:42:40.419709 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:DELETE=7,keystone:SELECT=90,keystone:INSERT=3 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:42:40.436428 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1452/2924] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:42:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:42:40.446027 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e28db6-5c2f-47fc-a640-4d113881ac52 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:42:40.447482 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-57e28db6-5c2f-47fc-a640-4d113881ac52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:42:40.488074 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:42:40.507535 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e28db6-5c2f-47fc-a640-4d113881ac52 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:42:40.511134 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f000f8f3-f080-4d03-bff9-4f8fb92f9c60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f44bfdd5214e8d84a2c0a5b1fd9b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:42:40.511725 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f000f8f3-f080-4d03-bff9-4f8fb92f9c60 service neutron] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:42:40.511997 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f000f8f3-f080-4d03-bff9-4f8fb92f9c60 service neutron] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:42:40.512262 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f000f8f3-f080-4d03-bff9-4f8fb92f9c60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:42:40.521052 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f000f8f3-f080-4d03-bff9-4f8fb92f9c60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:42:40.522497 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f000f8f3-f080-4d03-bff9-4f8fb92f9c60 service neutron] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:42:40.533273 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1473/2925] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:42:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:42:40.799623 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d9dc52-4058-433e-bf61-c399e3a27b5b None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:42:40.801144 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-29d9dc52-4058-433e-bf61-c399e3a27b5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:42:40.812953 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d9dc52-4058-433e-bf61-c399e3a27b5b None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:42:40.817932 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d22879-ab50-4235-b95f-7eaba118d604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:42:40.818589 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d22879-ab50-4235-b95f-7eaba118d604 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:42:40.818864 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d22879-ab50-4235-b95f-7eaba118d604 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:42:40.819137 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d22879-ab50-4235-b95f-7eaba118d604 admin admin] PATH_INFO: `/v3/projects/1e58ce3848454d5bb6996160327a38e6` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:42:40.820237 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d22879-ab50-4235-b95f-7eaba118d604 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e58ce3848454d5bb6996160327a38e6)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:42:40.822754 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d22879-ab50-4235-b95f-7eaba118d604 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:42:40.869376 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-22d22879-ab50-4235-b95f-7eaba118d604 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e58ce3848454d5bb6996160327a38e6', 'request_id': 'req-22d22879-ab50-4235-b95f-7eaba118d604'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:42:40.875390 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-22d22879-ab50-4235-b95f-7eaba118d604 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e58ce3848454d5bb6996160327a38e6', 'request_id': 'req-22d22879-ab50-4235-b95f-7eaba118d604'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:42:40.882530 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-22d22879-ab50-4235-b95f-7eaba118d604 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e58ce3848454d5bb6996160327a38e6', 'request_id': 'req-22d22879-ab50-4235-b95f-7eaba118d604'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:42:40.893427 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-22d22879-ab50-4235-b95f-7eaba118d604 admin admin] The token cache is being invalidate because project 1e58ce3848454d5bb6996160327a38e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81445) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 16:42:40.893718 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-22d22879-ab50-4235-b95f-7eaba118d604 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:42:40.894404 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-22d22879-ab50-4235-b95f-7eaba118d604 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:42:40.895903 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1453/2926] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 16:42:40 2022] DELETE /identity/v3/projects/1e58ce3848454d5bb6996160327a38e6 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:42:40.901819 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904109ab-5687-47ed-be28-373fcb1c39db None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:42:40.902100 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904109ab-5687-47ed-be28-373fcb1c39db None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:42:40.902414 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904109ab-5687-47ed-be28-373fcb1c39db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:42:40.922386 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-904109ab-5687-47ed-be28-373fcb1c39db None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:42:40.924234 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-904109ab-5687-47ed-be28-373fcb1c39db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:42:40.995919 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1474/2927] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:42:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:42:41.004778 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28cad42-7809-4822-b857-e7b52500a942 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:42:41.005068 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28cad42-7809-4822-b857-e7b52500a942 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:42:41.005344 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28cad42-7809-4822-b857-e7b52500a942 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:42:41.025869 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-c28cad42-7809-4822-b857-e7b52500a942 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:42:41.027101 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-c28cad42-7809-4822-b857-e7b52500a942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:42:41.035121 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1454/2928] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:42:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:42:41.039141 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904109ab-5687-47ed-be28-373fcb1c39db None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:42:41.048799 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904109ab-5687-47ed-be28-373fcb1c39db None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:42:41.053395 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1692fbc1-3a0f-4908-9472-fce4a297236b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:42:41.054048 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1692fbc1-3a0f-4908-9472-fce4a297236b admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:42:41.054360 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1692fbc1-3a0f-4908-9472-fce4a297236b admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:42:41.054636 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1692fbc1-3a0f-4908-9472-fce4a297236b admin admin] PATH_INFO: `/v3/domains` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:42:41.055271 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1692fbc1-3a0f-4908-9472-fce4a297236b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81446) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 16:42:41.055572 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1692fbc1-3a0f-4908-9472-fce4a297236b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:42:41.057679 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1692fbc1-3a0f-4908-9472-fce4a297236b admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:42:41.069074 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1475/2929] 10.222.0.27 () {58 vars in 1153 bytes} [Fri Sep 9 16:42:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 16:42:41.073846 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28cad42-7809-4822-b857-e7b52500a942 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:42:41.083083 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28cad42-7809-4822-b857-e7b52500a942 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:42:41.087664 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22196e6c-ff34-4bff-bce2-d2884f2952ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:42:41.088251 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22196e6c-ff34-4bff-bce2-d2884f2952ce admin admin] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:42:41.088528 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22196e6c-ff34-4bff-bce2-d2884f2952ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:42:41.088793 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22196e6c-ff34-4bff-bce2-d2884f2952ce admin admin] PATH_INFO: `/v3/projects` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:42:41.089414 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22196e6c-ff34-4bff-bce2-d2884f2952ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:42:41.091325 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22196e6c-ff34-4bff-bce2-d2884f2952ce admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:42:41.116965 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1455/2930] 10.222.0.27 () {60 vars in 1153 bytes} [Fri Sep 9 16:42:41 2022] POST /identity/v3/projects => generated 369 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:42:41.121594 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1692fbc1-3a0f-4908-9472-fce4a297236b admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:42:41.131391 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1692fbc1-3a0f-4908-9472-fce4a297236b admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:42:41.186643 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41d08c7-2606-4801-a49b-c7184e5af900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:42:41.187325 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41d08c7-2606-4801-a49b-c7184e5af900 admin admin] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:42:41.187672 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41d08c7-2606-4801-a49b-c7184e5af900 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:42:41.187973 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41d08c7-2606-4801-a49b-c7184e5af900 admin admin] PATH_INFO: `/v3/users` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:42:41.188593 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41d08c7-2606-4801-a49b-c7184e5af900 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:42:41.190519 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41d08c7-2606-4801-a49b-c7184e5af900 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:42:41.212368 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1476/2931] 10.222.0.27 () {60 vars in 1144 bytes} [Fri Sep 9 16:42:41 2022] POST /identity/v3/users => generated 285 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 16:42:41.216355 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22196e6c-ff34-4bff-bce2-d2884f2952ce admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:42:41.226444 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22196e6c-ff34-4bff-bce2-d2884f2952ce admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:42:41.231016 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc0ee9b-d25f-4755-8871-a1a0f42a6866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:42:41.231598 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc0ee9b-d25f-4755-8871-a1a0f42a6866 admin admin] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:42:41.231868 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc0ee9b-d25f-4755-8871-a1a0f42a6866 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:42:41.232127 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc0ee9b-d25f-4755-8871-a1a0f42a6866 admin admin] PATH_INFO: `/v3/roles` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:42:41.232749 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc0ee9b-d25f-4755-8871-a1a0f42a6866 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:42:41.234374 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc0ee9b-d25f-4755-8871-a1a0f42a6866 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:42:41.244799 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1456/2932] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:42:41 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:42:41.248933 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41d08c7-2606-4801-a49b-c7184e5af900 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:42:41.260036 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41d08c7-2606-4801-a49b-c7184e5af900 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:42:41.265126 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed198f07-2a05-4bc2-8026-808e0aa4e24d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:42:41.265906 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed198f07-2a05-4bc2-8026-808e0aa4e24d admin admin] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:42:41.266181 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed198f07-2a05-4bc2-8026-808e0aa4e24d admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:42:41.266519 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed198f07-2a05-4bc2-8026-808e0aa4e24d admin admin] PATH_INFO: `/v3/roles` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:42:41.267142 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed198f07-2a05-4bc2-8026-808e0aa4e24d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:42:41.268953 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed198f07-2a05-4bc2-8026-808e0aa4e24d admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:42:41.280038 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1477/2933] 10.222.0.27 () {58 vars in 1122 bytes} [Fri Sep 9 16:42:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 16:42:41.284185 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc0ee9b-d25f-4755-8871-a1a0f42a6866 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:42:41.294703 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc0ee9b-d25f-4755-8871-a1a0f42a6866 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:42:41.299578 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbca943-dd98-4280-bb11-ec1398ff3291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:42:41.300230 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbca943-dd98-4280-bb11-ec1398ff3291 admin admin] REQUEST_METHOD: `PUT` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:42:41.300510 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbca943-dd98-4280-bb11-ec1398ff3291 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:42:41.300784 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbca943-dd98-4280-bb11-ec1398ff3291 admin admin] PATH_INFO: `/v3/projects/f79cb8685c5143daaab3e41d324a901b/users/048880a9f8c54eca952d1f0ff15fd6c4/roles/b38e84bf077846ee802e6bb1bad83522` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:42:41.315653 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbca943-dd98-4280-bb11-ec1398ff3291 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f79cb8685c5143daaab3e41d324a901b, user_id=048880a9f8c54eca952d1f0ff15fd6c4, role_id=b38e84bf077846ee802e6bb1bad83522)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:42:41.318274 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbca943-dd98-4280-bb11-ec1398ff3291 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:42:41.331649 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1457/2934] 10.222.0.27 () {60 vars in 1483 bytes} [Fri Sep 9 16:42:41 2022] PUT /identity/v3/projects/f79cb8685c5143daaab3e41d324a901b/users/048880a9f8c54eca952d1f0ff15fd6c4/roles/b38e84bf077846ee802e6bb1bad83522 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:42:41.341816 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5db4d5-dac1-4b61-8d39-9826c89c8442 None None] REQUEST_METHOD: `POST` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:42:41.342122 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5db4d5-dac1-4b61-8d39-9826c89c8442 None None] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:42:41.342431 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5db4d5-dac1-4b61-8d39-9826c89c8442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:42:41.369933 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.auth.core [None req-0e5db4d5-dac1-4b61-8d39-9826c89c8442 None None] MFA Rules not processed for user `048880a9f8c54eca952d1f0ff15fd6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81446) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:42:41.371197 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-0e5db4d5-dac1-4b61-8d39-9826c89c8442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:42:41.403545 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:42:41.437100 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1478/2935] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:42:41 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:42:41.449076 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbca943-dd98-4280-bb11-ec1398ff3291 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:42:41.450786 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-bfbca943-dd98-4280-bb11-ec1398ff3291 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:42:41.506115 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbca943-dd98-4280-bb11-ec1398ff3291 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:42:41.509675 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65c25e7-86ab-4a69-b77b-3dee1598d0c5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ddd42508eee4412ae139cb8526090d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:42:41.510266 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65c25e7-86ab-4a69-b77b-3dee1598d0c5 service glance] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:42:41.510571 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65c25e7-86ab-4a69-b77b-3dee1598d0c5 service glance] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:42:41.510842 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65c25e7-86ab-4a69-b77b-3dee1598d0c5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:42:41.518920 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65c25e7-86ab-4a69-b77b-3dee1598d0c5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:42:41.520349 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65c25e7-86ab-4a69-b77b-3dee1598d0c5 service glance] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:42:41.528926 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1458/2936] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:42:41 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:42:51.434235 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=12 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:42:51.525027 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=85,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:43:03.072603 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5db4d5-dac1-4b61-8d39-9826c89c8442 None None] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:43:03.134608 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5db4d5-dac1-4b61-8d39-9826c89c8442 None None] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:43:03.139547 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ba9149-4330-461a-a1fa-64445c246cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:43:03.140161 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ba9149-4330-461a-a1fa-64445c246cb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:43:03.140437 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ba9149-4330-461a-a1fa-64445c246cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:43:03.140705 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ba9149-4330-461a-a1fa-64445c246cb4 admin admin] PATH_INFO: `/v3/users/048880a9f8c54eca952d1f0ff15fd6c4` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:43:03.141827 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ba9149-4330-461a-a1fa-64445c246cb4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=048880a9f8c54eca952d1f0ff15fd6c4)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:43:03.143744 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ba9149-4330-461a-a1fa-64445c246cb4 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:43:03.188428 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-e5ba9149-4330-461a-a1fa-64445c246cb4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '048880a9f8c54eca952d1f0ff15fd6c4'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:43:03.195301 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-e5ba9149-4330-461a-a1fa-64445c246cb4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '048880a9f8c54eca952d1f0ff15fd6c4'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:43:03.207856 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-e5ba9149-4330-461a-a1fa-64445c246cb4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '048880a9f8c54eca952d1f0ff15fd6c4'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:43:03.215867 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-e5ba9149-4330-461a-a1fa-64445c246cb4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '048880a9f8c54eca952d1f0ff15fd6c4'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:43:03.216498 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-e5ba9149-4330-461a-a1fa-64445c246cb4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '048880a9f8c54eca952d1f0ff15fd6c4'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:43:03.222297 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1479/2937] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 16:43:03 2022] DELETE /identity/v3/users/048880a9f8c54eca952d1f0ff15fd6c4 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:43:03.226763 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0705ce3f-6fda-48d1-a77b-b3a230ff5825 None None] REQUEST_METHOD: `POST` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:43:03.227255 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0705ce3f-6fda-48d1-a77b-b3a230ff5825 None None] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:43:03.227366 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0705ce3f-6fda-48d1-a77b-b3a230ff5825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:43:03.246654 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.auth.core [None req-0705ce3f-6fda-48d1-a77b-b3a230ff5825 None None] MFA Rules not processed for user `1a543813ca244c90b6fbbe30c16ad55b`. Rule list: `[]` (Enabled: `True`). {{(pid=81445) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 16:43:03.247832 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-0705ce3f-6fda-48d1-a77b-b3a230ff5825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:43:03.305173 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1459/2938] 10.222.0.27 () {58 vars in 958 bytes} [Fri Sep 9 16:43:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 16:43:03.314994 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ba9149-4330-461a-a1fa-64445c246cb4 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:43:03.316379 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-e5ba9149-4330-461a-a1fa-64445c246cb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:43:03.375078 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ba9149-4330-461a-a1fa-64445c246cb4 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:43:03.378703 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e4032f-e6a3-4316-94ab-7e2be337e22b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5f44bfdd5214e8d84a2c0a5b1fd9b84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:43:03.379295 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e4032f-e6a3-4316-94ab-7e2be337e22b service neutron] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:43:03.379571 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e4032f-e6a3-4316-94ab-7e2be337e22b service neutron] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:43:03.379838 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e4032f-e6a3-4316-94ab-7e2be337e22b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:43:03.389253 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e4032f-e6a3-4316-94ab-7e2be337e22b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:43:03.390724 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e4032f-e6a3-4316-94ab-7e2be337e22b service neutron] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:43:03.399970 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1480/2939] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:43:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:43:03.655228 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0705ce3f-6fda-48d1-a77b-b3a230ff5825 None None] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:43:03.656696 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-0705ce3f-6fda-48d1-a77b-b3a230ff5825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:43:03.668360 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0705ce3f-6fda-48d1-a77b-b3a230ff5825 None None] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:43:03.673572 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b358eec-5182-4e84-91e4-bb4b7a0371b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:43:03.674347 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b358eec-5182-4e84-91e4-bb4b7a0371b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:43:03.674702 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b358eec-5182-4e84-91e4-bb4b7a0371b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:43:03.675045 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b358eec-5182-4e84-91e4-bb4b7a0371b0 admin admin] PATH_INFO: `/v3/projects/f79cb8685c5143daaab3e41d324a901b` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:43:03.676253 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b358eec-5182-4e84-91e4-bb4b7a0371b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f79cb8685c5143daaab3e41d324a901b)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:43:03.678706 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b358eec-5182-4e84-91e4-bb4b7a0371b0 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:43:03.724791 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-9b358eec-5182-4e84-91e4-bb4b7a0371b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f79cb8685c5143daaab3e41d324a901b', 'request_id': 'req-9b358eec-5182-4e84-91e4-bb4b7a0371b0'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:43:03.730836 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-9b358eec-5182-4e84-91e4-bb4b7a0371b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f79cb8685c5143daaab3e41d324a901b', 'request_id': 'req-9b358eec-5182-4e84-91e4-bb4b7a0371b0'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:43:03.737916 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-9b358eec-5182-4e84-91e4-bb4b7a0371b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f79cb8685c5143daaab3e41d324a901b', 'request_id': 'req-9b358eec-5182-4e84-91e4-bb4b7a0371b0'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:43:03.748707 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-9b358eec-5182-4e84-91e4-bb4b7a0371b0 admin admin] The token cache is being invalidate because project f79cb8685c5143daaab3e41d324a901b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81445) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 16:43:03.748997 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-9b358eec-5182-4e84-91e4-bb4b7a0371b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:43:03.749619 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-9b358eec-5182-4e84-91e4-bb4b7a0371b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:43:03.751125 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1460/2940] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 16:43:03 2022] DELETE /identity/v3/projects/f79cb8685c5143daaab3e41d324a901b => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:43:13.395956 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:43:13.745076 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:43:43.086939 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e4032f-e6a3-4316-94ab-7e2be337e22b service neutron] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:43:43.090818 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-99e4032f-e6a3-4316-94ab-7e2be337e22b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:43:43.177948 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e4032f-e6a3-4316-94ab-7e2be337e22b service neutron] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:43:43.261389 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e446f8c7-bce9-44a2-a0b0-c35bd065e085 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a332b9b4980646a3b14633293f77b505', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:43:43.263328 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e446f8c7-bce9-44a2-a0b0-c35bd065e085 service nova] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:43:43.263328 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e446f8c7-bce9-44a2-a0b0-c35bd065e085 service nova] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:43:43.263546 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e446f8c7-bce9-44a2-a0b0-c35bd065e085 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:43:43.265191 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-e446f8c7-bce9-44a2-a0b0-c35bd065e085 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:43:43.282524 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e446f8c7-bce9-44a2-a0b0-c35bd065e085 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:43:43.283968 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e446f8c7-bce9-44a2-a0b0-c35bd065e085 service nova] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:43:43.296860 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1481/2941] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:43:43 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:43:45.156696 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b358eec-5182-4e84-91e4-bb4b7a0371b0 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:43:45.158459 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-9b358eec-5182-4e84-91e4-bb4b7a0371b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:43:45.175491 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b358eec-5182-4e84-91e4-bb4b7a0371b0 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:43:45.181068 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d87a13-9074-4fcb-bb36-dead75488238 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a332b9b4980646a3b14633293f77b505', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:43:45.181670 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d87a13-9074-4fcb-bb36-dead75488238 service nova] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:43:45.181943 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d87a13-9074-4fcb-bb36-dead75488238 service nova] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:43:45.182210 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d87a13-9074-4fcb-bb36-dead75488238 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:43:45.184582 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-34d87a13-9074-4fcb-bb36-dead75488238 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:43:45.196997 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d87a13-9074-4fcb-bb36-dead75488238 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:43:45.198807 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d87a13-9074-4fcb-bb36-dead75488238 service nova] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:43:45.209891 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1461/2942] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:43:45 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:43:49.913044 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e446f8c7-bce9-44a2-a0b0-c35bd065e085 service nova] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:43:49.914507 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-e446f8c7-bce9-44a2-a0b0-c35bd065e085 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:43:50.025407 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e446f8c7-bce9-44a2-a0b0-c35bd065e085 service nova] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:43:50.031567 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6d4ec1-a917-4b9e-abcf-bf533f7429dd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d73df92393c43b2b5ccc32a2d43d952', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:43:50.032199 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6d4ec1-a917-4b9e-abcf-bf533f7429dd service placement] REQUEST_METHOD: `GET` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:43:50.032481 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6d4ec1-a917-4b9e-abcf-bf533f7429dd service placement] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:43:50.032756 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6d4ec1-a917-4b9e-abcf-bf533f7429dd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:43:50.034633 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-6e6d4ec1-a917-4b9e-abcf-bf533f7429dd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:43:50.054871 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6d4ec1-a917-4b9e-abcf-bf533f7429dd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:43:50.056502 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6d4ec1-a917-4b9e-abcf-bf533f7429dd service placement] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:43:50.068573 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1482/2943] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:43:49 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:43:53.316670 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d87a13-9074-4fcb-bb36-dead75488238 service nova] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:43:53.318277 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-34d87a13-9074-4fcb-bb36-dead75488238 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:43:53.383672 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d87a13-9074-4fcb-bb36-dead75488238 service nova] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:43:53.388612 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bf0391-0d41-4581-bcdb-e6d194a4d3e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:43:53.389250 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bf0391-0d41-4581-bcdb-e6d194a4d3e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:43:53.389529 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bf0391-0d41-4581-bcdb-e6d194a4d3e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:43:53.389797 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bf0391-0d41-4581-bcdb-e6d194a4d3e8 admin admin] PATH_INFO: `/v3/users/cf8b3812127a46c7a341f51ebf9b18d9` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:43:53.390945 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bf0391-0d41-4581-bcdb-e6d194a4d3e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf8b3812127a46c7a341f51ebf9b18d9)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:43:53.392860 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bf0391-0d41-4581-bcdb-e6d194a4d3e8 admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:43:53.437901 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-a8bf0391-0d41-4581-bcdb-e6d194a4d3e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf8b3812127a46c7a341f51ebf9b18d9'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:43:53.445118 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-a8bf0391-0d41-4581-bcdb-e6d194a4d3e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf8b3812127a46c7a341f51ebf9b18d9'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:43:53.445732 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-a8bf0391-0d41-4581-bcdb-e6d194a4d3e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf8b3812127a46c7a341f51ebf9b18d9'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:43:53.453471 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-a8bf0391-0d41-4581-bcdb-e6d194a4d3e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf8b3812127a46c7a341f51ebf9b18d9'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:43:53.465149 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-a8bf0391-0d41-4581-bcdb-e6d194a4d3e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf8b3812127a46c7a341f51ebf9b18d9'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:43:53.471529 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1462/2944] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 16:43:53 2022] DELETE /identity/v3/users/cf8b3812127a46c7a341f51ebf9b18d9 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:43:53.640875 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6d4ec1-a917-4b9e-abcf-bf533f7429dd service placement] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:43:53.653433 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6d4ec1-a917-4b9e-abcf-bf533f7429dd service placement] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:43:53.663253 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=100 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:43:53.712513 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016cea6b-c7eb-4ebf-a813-a45f3a8ca0c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:43:53.713127 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016cea6b-c7eb-4ebf-a813-a45f3a8ca0c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:43:53.713398 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016cea6b-c7eb-4ebf-a813-a45f3a8ca0c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:43:53.713663 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016cea6b-c7eb-4ebf-a813-a45f3a8ca0c0 admin admin] PATH_INFO: `/v3/projects/8f7f3e4298e84ca9bceefc4321e50a7a` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:43:53.714795 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016cea6b-c7eb-4ebf-a813-a45f3a8ca0c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f7f3e4298e84ca9bceefc4321e50a7a)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:43:53.716729 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016cea6b-c7eb-4ebf-a813-a45f3a8ca0c0 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:43:53.761539 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-016cea6b-c7eb-4ebf-a813-a45f3a8ca0c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f7f3e4298e84ca9bceefc4321e50a7a', 'request_id': 'req-016cea6b-c7eb-4ebf-a813-a45f3a8ca0c0'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:43:53.767847 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-016cea6b-c7eb-4ebf-a813-a45f3a8ca0c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f7f3e4298e84ca9bceefc4321e50a7a', 'request_id': 'req-016cea6b-c7eb-4ebf-a813-a45f3a8ca0c0'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:43:53.774709 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-016cea6b-c7eb-4ebf-a813-a45f3a8ca0c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f7f3e4298e84ca9bceefc4321e50a7a', 'request_id': 'req-016cea6b-c7eb-4ebf-a813-a45f3a8ca0c0'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:43:53.785921 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-016cea6b-c7eb-4ebf-a813-a45f3a8ca0c0 admin admin] The token cache is being invalidate because project 8f7f3e4298e84ca9bceefc4321e50a7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81446) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 16:43:53.786210 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-016cea6b-c7eb-4ebf-a813-a45f3a8ca0c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:43:53.786863 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-016cea6b-c7eb-4ebf-a813-a45f3a8ca0c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:43:53.788342 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1483/2945] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 16:43:53 2022] DELETE /identity/v3/projects/8f7f3e4298e84ca9bceefc4321e50a7a => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:43:53.792528 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bf0391-0d41-4581-bcdb-e6d194a4d3e8 admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:43:53.793947 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-a8bf0391-0d41-4581-bcdb-e6d194a4d3e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:43:53.806714 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bf0391-0d41-4581-bcdb-e6d194a4d3e8 admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:43:53.862844 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1fc5e3-08c3-4109-a0b3-3be7b75f389e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:43:53.863463 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1fc5e3-08c3-4109-a0b3-3be7b75f389e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:43:53.863735 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1fc5e3-08c3-4109-a0b3-3be7b75f389e admin admin] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:43:53.864001 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1fc5e3-08c3-4109-a0b3-3be7b75f389e admin admin] PATH_INFO: `/v3/users/df9ef3f7e4dd44acaf816b6b3f66fa24` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:43:53.871236 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1fc5e3-08c3-4109-a0b3-3be7b75f389e admin admin] RBAC: Authorizing `identity:delete_user(user_id=df9ef3f7e4dd44acaf816b6b3f66fa24)` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:43:53.873762 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1fc5e3-08c3-4109-a0b3-3be7b75f389e admin admin] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:43:53.879353 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:43:53.924585 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-2f1fc5e3-08c3-4109-a0b3-3be7b75f389e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df9ef3f7e4dd44acaf816b6b3f66fa24'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:43:53.932010 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-2f1fc5e3-08c3-4109-a0b3-3be7b75f389e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df9ef3f7e4dd44acaf816b6b3f66fa24'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:43:53.932652 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-2f1fc5e3-08c3-4109-a0b3-3be7b75f389e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df9ef3f7e4dd44acaf816b6b3f66fa24'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:43:53.940270 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-2f1fc5e3-08c3-4109-a0b3-3be7b75f389e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df9ef3f7e4dd44acaf816b6b3f66fa24'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:43:53.952993 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.notifications [None req-2f1fc5e3-08c3-4109-a0b3-3be7b75f389e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df9ef3f7e4dd44acaf816b6b3f66fa24'} {{(pid=81445) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:43:53.958883 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1463/2946] 10.222.0.27 () {58 vars in 1224 bytes} [Fri Sep 9 16:43:53 2022] DELETE /identity/v3/users/df9ef3f7e4dd44acaf816b6b3f66fa24 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:43:54.125176 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016cea6b-c7eb-4ebf-a813-a45f3a8ca0c0 admin admin] Authenticating user token {{(pid=81446) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:43:54.126624 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.fernet_utils [None req-016cea6b-c7eb-4ebf-a813-a45f3a8ca0c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81446) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:43:54.139623 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016cea6b-c7eb-4ebf-a813-a45f3a8ca0c0 admin admin] Validating token access rules against request {{(pid=81446) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:43:54.198977 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15c2409-161a-48ce-a052-aa58805944f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a543813ca244c90b6fbbe30c16ad55b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e37a1d93b9b4afb9e8aecb24b733b95', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81446) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:43:54.199520 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15c2409-161a-48ce-a052-aa58805944f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:43:54.199825 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15c2409-161a-48ce-a052-aa58805944f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:43:54.200097 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15c2409-161a-48ce-a052-aa58805944f3 admin admin] PATH_INFO: `/v3/projects/f45cf207b42a442db92604bcc06814b7` {{(pid=81446) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:43:54.201202 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15c2409-161a-48ce-a052-aa58805944f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f45cf207b42a442db92604bcc06814b7)` {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:43:54.203387 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15c2409-161a-48ce-a052-aa58805944f3 admin admin] RBAC: Authorization granted {{(pid=81446) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:43:54.245645 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:43:54.249357 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-e15c2409-161a-48ce-a052-aa58805944f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f45cf207b42a442db92604bcc06814b7', 'request_id': 'req-e15c2409-161a-48ce-a052-aa58805944f3'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:43:54.255708 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-e15c2409-161a-48ce-a052-aa58805944f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f45cf207b42a442db92604bcc06814b7', 'request_id': 'req-e15c2409-161a-48ce-a052-aa58805944f3'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:43:54.262663 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-e15c2409-161a-48ce-a052-aa58805944f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f45cf207b42a442db92604bcc06814b7', 'request_id': 'req-e15c2409-161a-48ce-a052-aa58805944f3'} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:43:54.273447 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-e15c2409-161a-48ce-a052-aa58805944f3 admin admin] The token cache is being invalidate because project f45cf207b42a442db92604bcc06814b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81446) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 16:43:54.273730 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-e15c2409-161a-48ce-a052-aa58805944f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:43:54.274370 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG keystone.notifications [None req-e15c2409-161a-48ce-a052-aa58805944f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81446) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 16:43:54.275826 dv-cinder-831247-27-smb devstack@keystone.service[81446]: [pid: 81446|app: 0|req: 1484/2947] 10.222.0.27 () {58 vars in 1233 bytes} [Fri Sep 9 16:43:54 2022] DELETE /identity/v3/projects/f45cf207b42a442db92604bcc06814b7 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 16:44:03.955361 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=23,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:44:04.270649 dv-cinder-831247-27-smb devstack@keystone.service[81446]: DEBUG dbcounter [-] [81446] Writing DB stats keystone:DELETE=4,keystone:SELECT=7,keystone:INSERT=1 {{(pid=81446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 16:45:03.027821 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1fc5e3-08c3-4109-a0b3-3be7b75f389e admin admin] Authenticating user token {{(pid=81445) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 16:45:03.029781 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-2f1fc5e3-08c3-4109-a0b3-3be7b75f389e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:45:03.096627 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1fc5e3-08c3-4109-a0b3-3be7b75f389e admin admin] Validating token access rules against request {{(pid=81445) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 16:45:03.152912 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22479153-4318-4bb7-8754-451558782e3a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d73df92393c43b2b5ccc32a2d43d952', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68d6aaafab824657b08ca91f3d46d5f8', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81445) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 16:45:03.154160 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22479153-4318-4bb7-8754-451558782e3a service placement] REQUEST_METHOD: `GET` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 16:45:03.154467 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22479153-4318-4bb7-8754-451558782e3a service placement] SCRIPT_NAME: `/identity` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 16:45:03.154738 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22479153-4318-4bb7-8754-451558782e3a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81445) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 16:45:03.156435 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.fernet_utils [None req-22479153-4318-4bb7-8754-451558782e3a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81445) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 16:45:03.167271 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22479153-4318-4bb7-8754-451558782e3a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 16:45:03.169349 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22479153-4318-4bb7-8754-451558782e3a service placement] RBAC: Authorization granted {{(pid=81445) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 16:45:03.179240 dv-cinder-831247-27-smb devstack@keystone.service[81445]: [pid: 81445|app: 0|req: 1464/2948] 10.222.0.27 () {60 vars in 1365 bytes} [Fri Sep 9 16:45:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 16:45:13.174839 dv-cinder-831247-27-smb devstack@keystone.service[81445]: DEBUG dbcounter [-] [81445] Writing DB stats keystone:SELECT=58 {{(pid=81445) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}